What are statistical optimization algorithms?

• Simple idea: “Guess” the most likely position of the optimum based on available observations

• Formalization: A subjective probability is associated with each point of the design space. It represents our belief that that point is the optimum based on our knowledge.

• Goal: identify the features that are responsible for high fitness evaluations and locate promising regions