Thesis Defence: Q-fully quadratic modeling and its application in a random subspace derivative-free method

Yiwen Chen, supervised by Dr. Warren Hare and Dr. Amy Wiebe, will defend their thesis titled “Q-fully quadratic modeling and its application in a random subspace derivative-free method” in partial fulfillment of the requirements for the degree of Master of Science in Mathematics.

An abstract for Yiwen Chen’s thesis is included below.

Defences are open to all members of the campus community as well as the general public. Registration is not required for in person defences.

---

ABSTRACT

Model-based derivative-free optimization (DFO) methods are an important class of DFO methods that are known to struggle with solving high dimensional optimization problems. Recent research has shown that incorporating random subspaces into model-based DFO methods has the potential to improve their performance on high-dimensional problems. However, most of the current theoretical and practical results are based on linear approximation models due to the complexity of quadratic approximation models. This thesis proposes a random subspace trust-region algorithm based on quadratic approximations. Unlike most of its precursors, this algorithm does not require any special form of objective function. We study the geometry of sample sets, the error bounds for approximations, and the quality of subspaces. In particular, we provide a technique to construct Q-fully quadratic models, which is easy to analyze and implement. We present an almost-sure global convergence result of our algorithm and give an upper bound on the expected number of iterations to find a sufficiently small gradient. We also develop numerical experiments to compare the performance
of our algorithm using both linear and quadratic approximation models. The numerical results demonstrate the strengths and weaknesses of using quadratic approximations.