Why did you convert to float16 and not bfloat16?

by PhilipMay - opened May 8

May 8

Hi,

is there a special reason why you store this model as float16 and not bfloat16?
Since the base model is in bfloat16...

Many thanks
Philip

Owner May 8

Hi Philip, no particular reason for FP16

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment