We use a few-shot learning paradigm, introducing a new lexical item into the vocabulary of the language model, either “wug" (intended as a new singular noun), or “wuz" (intended as a plural). We then fine-tune the language model using several example sentences containing this word.
Note that this paradigm is distinct from nearly all of the few-shot learning experiments performed in [1]}, [2]}, which operate on a known vocabulary.[2]} perform several experiments on novel vocabulary items.
