Interim-MN-fp16

This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here.

Probably best if using normal Nemo settings, no weird stuff. (Or just use the recommended ones in the Recommended Settings repo)

iMat GGUFs courtesy of your local Cartel frens

Downloads last month: 8

Safetensors

Model size

12.2B params

Tensor type

BF16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for rAIfle/Interim-MN-fp16

Quantizations

2 models

Collection including rAIfle/Interim-MN-fp16

Home baked

Collection

Home-baked merges and tunes. • 13 items • Updated Sep 21