Welcome! VIVA tutorial speech is holding evey Thursdays during Summer 2018.
List of broad interests:
 Bagging and Boosting, adaBoost, GBM and XGBoost (This is NEW)
 Regression, Multilinear regression, Ridge regression, Lasso regression, Logistic regression, Support vector regression, Group Lasso, Fused Lasso, Elastic net, graphLasso (This is NEW)
 Baye's theorem, Bayesian network, Bayesian inference
 Markov property, Markov chain, Reducible and irreducible Markov chain, homogeneous and inhomogeneous Markov chain
 Regularization, L1, L2, L12, L0, L_inf, Tikhonov, TV minimization
 PCA, Spiketriggered Covariance (only in Neuroscience), Factor Analysis, LDA, ICA, Canonical PCA, Sparse PCA, SVD, LLE, nonnegative Matrix factorization (NMF), Isomap, CUR (This is NEW), tSNE (This is NEW)
 Sampling, downsampling, upsampling, kNN sampling (This is new), particle sampling, Particle filter
 Fourier, Polar Fourier, BesselFourier
 Kernel, kernel regularization, Kernel projection, Kernel properties, Different types of kernels and their usage, kernel generation
 Gradient descent, Newtonian descent, stochastic gradient descent, conjugate dradient descent, BFGS, momentum, Nesterov, ADAM (widely used now a days)
 Convex optimization, convex set, convex function, Primaldual, KKT, Linear Program, Lagrangian, relaxation, convex relaxation, softmax
 Nonconvex optimization, pareto set, alternating direction minimization, variable splitting
 Least squares, weighted least squares, partial least squares, least mean squares, recursive least squares, lattice recursive least squares
 Tensor, tensor analysis, tensor factorization, covariant and contravariant derivative
 Manifold and topology : differences and properties, construction, sampling on manifold, tangent space on manifold, principal curvatures, saddle points, finding geodesic on manifold, Logexponential map, curvatureextrinsic and intrinsic, Gaussian curvature, Ricci curvature (optional)
 Distance measure: (See Statistics section also) Euclidean, Hamming, graph edit, Dice, Levenshtein, Minkowski, Manhattan
 Convergence, boundedness, and staibility, Lyapunov stability, BIBO stability, Asymptotic stability ,functionfunctionalfunctor, summability, EulerLagrange (very useful), Functional derivative, Green function
Statistics:
 mean, variance, correlation, covariance, rank correlation (Spearman), skewness, kurtosis, biasvariance tradeoff
 random variable, probability space, distribution, sampling from distribution, conditional distribution, multivariate analysis, expectationmaximization, Maximum likelihood estimator, Bayesian statistics
 Types of distributions, important but old and classic distributions (Bernoulli, Binomial, Poisson, Gaussian, Negative Binomial, Geometric, Laplace, Hypergeometric, exponential), distributions which our lab does not use but widely used in the literature (logNormal, Cauchy, Langevin, Dirichlet, scalefree, Weibull, Hotelling Tsquared, Inverse Gaussian, heavytailed, Wishart, matrix Normal, matrix t, multinomial, wrapped Cauchy, wrapped exponential, Frechet, YuleSimon)
 Estimation of distribution, measure (such as, Fisher information metric, KolmogorovSmirnov, KL divergence, Jensen Log divergence, Bregman's divergence, Mahalanobis, Chebychev, Hamming)
