NCU IISR/AS GIS: Results of Various Pre trained Biomedical Language Models and Linear Regression Model in BioASQ Task 9b Phase B
Transformer has been widely applied in Natural Language Processing (NLP) field, and it also results in an amount of pre trained language models like BioBERT, SciBERT, NCBI_Bluebert, and PubMedBERT. In this paper, we introduce our system for the BioASQ Task 9b Phase B. We employed various pre trained biomedical language models, including BioBERT, BioBERT MNLI, and PubMedBERT, to generate "exact" answers for the questions, and a linear regression model with our sentence embedding to construct the top n sentences as a prediction for "ideal" answers.
CLEF