daryl149's picture
lowered max_position_embeddings back to 2048, since 4096 severely hinders how well context is taken into account
d8654a4