Separate branches for quants?
#1
by
mfeldstein67
- opened
I've been pulling the larger quants, doing a manual merge, and trying to load them into Ooba. They consistently fail for reasons I can't figure out. Would you consider organizing the quants into branches? Ooba will do an auto-merge if a branch has all and only the files needed for a particular quant.
I would consider and reject it: nobody else does that, and branches are not the correct instrument (quants are not branches of a model). It would only be confusing to do something weird like that.
If ooba requires that, I would consider that a bug, because it basically wouldn't work with any GGUF repository on hf.
mradermacher
changed discussion status to
closed