@inproceedings{
tan2024handling,
title={Handling Learnwares from Heterogeneous Feature Spaces with Explicit Label Exploitation},
author={Peng Tan and Hai-Tian Liu and Zhi-Hao Tan and Zhi-Hua Zhou},
booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems},
year={2024},
url={https://openreview.net/forum?id=3YIyB82rjX}
}
The learnware paradigm aims to help users leverage numerous existing high-performing models instead of starting from scratch, where a learnware consists of a well-trained model and the specification describing its capability. Numerous learnwares are accommodated by a learnware dock system. When users solve tasks with the system, models that fully match the task feature space are often rare or even unavailable. However, models with heterogeneous feature space can still be helpful. This paper finds that label information, particularly model outputs, is helpful yet previously less exploited in the accommodation of heterogeneous learnwares. We extend the specification to better leverage model pseudo-labels and subsequently enrich the unified embedding space for better specification evolvement. With label information, the learnware identification can also be improved by additionally comparing conditional distributions. Experiments demonstrate that, even without a model explicitly tailored to user tasks, the system can effectively handle tasks by leveraging models from diverse feature spaces.
Handling Learnwares from Heterogeneous Feature Spaces with Explicit Label Exploitation
Peng Tan Hai-Tian Liu Zhi-Hao Tan Zhi-Hua Zhou