@inproceedings{
bai2024fslquickboost,
title={{FSL}-QuickBoost: Minimal-Cost Ensemble for Few-Shot Learning},
author={Yunwei Bai and Bill Cai and Ying Kiat Tan and Zangwei Zheng and Shiming Chen and Tsuhan Chen},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=F02jfSVPmR}
}
Few-shot learning (FSL) usually trains models on data from one set of classes, but tests them on data from a different set of classes, providing a few labeled support samples of the unseen classes as a reference for the trained model. Due to the lack of training data relevant to the target, there is usually high generalization error with respect to the test classes. Some existing methods attempt to address this generalization issue through ensemble. However, current ensemble-based FSL methods can be computationally expensive. In this work, we conduct empirical explorations and propose an ensemble method (namely QuickBoost), which is efficient and effective for improving the generalization of FSL. Specifically, QuickBoost includes an alternative-architecture pretrained encoder with a one-vs-all binary classifier (namely FSL-Forest) based on random forest algorithm, and is ensembled with the off-the-shelf FSL models via logit-level averaging.  Extensive experiments on three benchmarks demonstrate that our method achieves state-of-the-art performance with good efficiency.
FSL-QuickBoost: Minimal-Cost Ensemble for Few-Shot Learning
Yunwei Bai Bill Cai Ying Kiat Tan Zangwei Zheng Shiming Chen Tsuhan Chen