zhengr
/

MixTAO-7Bx2-MoE-v8.1

What is the context length of this model and preset？

by EidosL - opened Mar 15

EidosL

Mar 15

What is the context length of this model and preset？

Apr 1

From the config file:
"max_position_embeddings": 32768

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment