Other Surrogate Models:
Other surrogate models can be used in place of the GP to model mixed-variable problems such as random forests, an approach used by SMAC3 [1]} or tree based estimators, used in the Tree-Parzen Estimator (TPE) [2]}. [3]} considers a linear model with cross-product features. BORE [4]} leverages the connection to density ratio estimation.
