|
Walid Krichene
Course work
Control and Optimization
Convex sets and functions. Linear programming, SOCP and SDP. Weak and strong duality. Optimality conditions and sensitivity analysis.
First order methods: gradient methods, sub-gradient, stochastic sub-gradient.
Second order methods: Newton method, interior point methods. Proximal gradient.
Dual decomposition. Augmented Lagrangian and ADMM.
Robust optimization: bounds on probabilities, robust convex problems and chance constraints. Duality in robust optimization.
Convex optimization in machine learning. SVM, Kernel learning, logistic regression.
Project on Robust PCA, with Maximilian Balandat, Chi Pang Lam and Ka-Kit Lam.
Taught by Professor Laurent El Ghaoui.
Linear algebra: eigenspaces, SVD, Jordan form, spectral mapping theorem. Least sqaures problems, pseudo-inverse.
Cauchy-Lipschitz (also known as Picard-Lindel:{o}f) theorem for ODEs.
Stability: internal stability, input-output stability, Lyapunov methods.
Controllability and observability, duality, the Kalman decomposition.
Feedback: pole placement, stabilizability and detectability, observers, state estimation, the separation principle.
Taught by Professor Claire Tomlin.
Discrete Event Systems (Spring 2010, Mines Paristech)
Introduction to max-plus algebras.
Max-plus linear systems, homogenious monotonous systems, linear equations on dioids, path algebras.
Linear representation of temporal event graphs, Petri graphs.
Spectral and asymptotic properties of max-plus matrices, Perron-Frobenius theorem.
Applications to discrete event systems and automata.
Taught by Professor Stéphane Gaubert.
Introduction to Non Linear Control and applications to Robotics (Spring 2010, Mines Paristech)
Dynamical systems, Lyapunov stability.
Differential geometry. System linearization using nonlinear feedback.
Applications to wheel robots, nonholonomic constraints.
Taught by Professor Brigitte d'Andréa-Novel.
Signal Processing and telecommunication (Spring 2010, Mines Paristech)
Sampling. DFT and FFT. Aliasing, Nyquist-Shannon theorem. Impulse response and Finite Response filters.
Digital transmission: white noise channel, Viterbi algorithm.
Synchronization: PLL. Coding: entropy, Huffman coding, LZW.
Error detection and correction: introduction to Galois fields, convolution codes, block codes: linear codes, group codes, cyclic codes and polynomial codes, BCH.
Taught by Professor Yves Rouchaleau.
Distribution theory (Fall 2009, Mines Paristech)
Distribution spaces. Fourier transform, convolution.
Applications to equations of mathematical physics: jump formula, Poisson equation, Stokes formula, wave and heat equations.
Taught by Professor Olivier Laffite.
Introduction to optimization (Spring 2009, Mines Paristech, audited)
Unconstrained optimization. Numerical methods, line search, convergence, Newton method, conjugate gradient.
Constrained optimization. Lagrange multipliers, KKT conditions, duality, quadratic programming.
Inroduction to Convex optimization.
Graph optimization, max flow.
Taught by Professor Nicolas Petit.
Stability, Lyapunov, controllability and state space feedback. Linear systems and discrete time systems.
Transfer functions, Bode plots, loop analysis, Nyquist analysis, Frequency domain control design. PID control, root locus analysis, uncertainty analysis.
Taught by Professor Richard Murray.
Dynamical Systems and Control (Spring 2008, Mines Paristech)
Introduction to linear control. Stability, robustness, perturbations.
Controllability, path planning. Introduction to optimal control.
Observability, estimation, Kalman filtering.
Taught by Professor Nicolas Petit and Professor Pierre Rouchon.
Machine Learning and Statistics
Graphical Models, inference and statistical estimation. Markov properties, elimination. Junction tree algorithm.
Exponential families, IPF (iterative proportional fitting). Factor analysis. Expectation-Maximization algorithm. Kalman filtering. HMM.
Model selection, error estimation, Informaion Criteria (AIC and BIC).
Sampling: Gibbs sampling, particle filtering, MCMC.
Taughy by Professor Martin Wainwright
Random Processes in Systems EE226 (Fall 2011, Berkeley)
Probability theory, discrete time Markov chains, ergodicity, queuing systems, reversibility.
Poisson processes, continuous time Markov chain, Kolmogorov equations, MM1 queues. Jackson networks. Markov decision process.
Jointly Gaussian distributions. Detection, sufficient statistic, Neyman-Pearson theorem, Sequential probability ratio test (SQRT).
MMSE, LLSE, Kalman filtering.
Taught by Professor Jean Walrand
Practical Machine Learning (Spring 2009, Mines Paristech)
Neural Networks and back propagation.
Classification, regression, clustering, dimensionality reduction, feature selection.
SVMs, Kernel methods.
Taught by Professor Fabien Moutarde.
Statistics (Spring 2009, Mines Paristech)
Statistical modeling, estimators, confidence tests.
Parameter estimation.
Taught by Professor Pascal Le Masson.
The learning problem. Model complexity and over-fitting. VC dimension, bias-variance tradeoff, and regularization.
Learning algorithms: computation issues. Optimization techniques.
Linear programming and quadratic programming.
Neural networks and back propagation, Support Vector Machines, Kernel methods, RBFs. Classification, nearest neighbor, k-means.
Model aggregation: bagging and boosting.
Taught by Professor Yasser Abu-Mostafa.
Probability Theory (Spring 2008, Mines Paristech)
Random variables, moments, conditional laws, transformations, convergence.
Gaussian variables and vectors.
Point processes, Poisson process.
Taught by Professor Francis Maisonneuve.
Computer Science
Nash equilibria. 2 player zero-sum games, min-max solutions and linear programming.
Pure, mixed, and correlated equilibria. No-regret equilibria and the Multiplicative Updates algorithm.
Existence of Nash equilibria and Complexity of computing them.
Market equilibria, Arrow-Debreu existence theorem, complexity of market equilibria.
Algorithmic mechanism design, Vickrey auctions.
Taught by Professor Christos Papadimitriou.
Distributed applications (Spring 2010, Mines Paristech)
Low level and high level network protocols (Ethernet, TCP, UDP, HTTP).
Network security. Socket programming.
Web application programming in Servlet/JSP.
Taught by Professor Fabien Coelho.
Cryptography and Number Theory (Fall 2009, Mines Paristech)
Number theory: arithmetics, Euler function, zeta function, Lucas theorem, prime number distribution.
Complexity classes, one way functions, Diffie-Hellman protocol, signature and DSS, RSA systems, Miller-Rabin test.
Quantum cryptography: n-state systems, n-qubits, Bell's theorem, BB84 protocol.
Taught by Professor Pierre Rouchon.
Computational Steering in Science and Engineering (November 2009, Munich Technical University)
Athens intensive course (exchange program)
Computer Architecture. Concurrent processing and threading. Software Transactional Memory.
Applications to computational steering.
Taught by Professor Martin Ruess.
Information Systems (Spring 2009, Mines Paristech)
Relational databases theory. Design and implementation of databases.
Taught by Professor Fabien Coelho.
Information and Complexity (Fall 2008, Caltech, audited)
Entropy and mutual information, symbol coding, unique decodability, Huffman coding, rate-distortion.
Computational complexity, Turing Machines, and uncomputability.
Kolmogorov complexity and algorithmic information.
Taught by Professor Yasser Abu-Mostafa.
|