We are interested blackin the relative order of blackthe models' performances within closed loop and open loop blackscenarios.
blackTherefore, following previous research [1]}, blackwe vary the hyperparameter controlling the size of the latent factors in {10, 20, ..., 100}, blackfor each model that supports this hyperparameterblackAll the examined models support a latent variable hyperparameter except BO, GA, POP and MLP.. blackblackThis leads to blacka total of 104 models blackthat are evaluated in our experiments. blackEach examined model differs on the algorithm or the latent variable size. blackWhen discussing a particular model, we denote the hyperparameter value in superscript - e.g. MF40 represents blackthe MF model blackusing latent factor size \(m=40\) .
For reproducibility, our code and the used datasets are available from: https://github.com/terrierteam/stratified_recsys_eval.
