Theory: Optimization Methods

• Introduction
• Minimization in One Dimension
  • Golden Section Search
• Multi-Dimensional Search
• Multi-Dimensional Search (No derivatives)
  • Conjugate Directions
• Multi-Dimensional Search (With First Derivatives)
  • Quasi-Newton (Variable Metric) Methods
• Use of Second Derivatives : Levenberg-Marquardt
  • Memory Constraints
• Global Optimization
  • Simplex Algorithm
  • Simulated Annealing
  • Genetic Algorithms
  • Multi-Resolution Methods and Graduated Non-Convexity
  • The Hough Transform