Optimization glossary

Optimization is a branch of mathematics which is concerned with finding maxima and minima of `real-valued functions.

A function f: A $\to$ R to be minimized or maximized is called a cost function or an objective function.

The domain A of f is called the search space, while the elements of A are called candidate solutions or feasible solutions.