PrunaAI
/

aaditya-Llama3-OpenBioLLM-8B-HQQ-4bit-smashed

Text Generation

Inference Endpoints

Model card Files Files and versions Community

aaditya-Llama3-OpenBioLLM-8B-HQQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

c44a8cee4fb1dcd3ce6c25838ac98b7c5b4818e0e415be10ca58b5bc21afb5df

87aaa42 verified 6 months ago

.gitattributes

1.52 kB

initial commit 6 months ago
README.md

5.53 kB

c44a8cee4fb1dcd3ce6c25838ac98b7c5b4818e0e415be10ca58b5bc21afb5df 6 months ago
config.json

688 Bytes

c44a8cee4fb1dcd3ce6c25838ac98b7c5b4818e0e415be10ca58b5bc21afb5df 6 months ago
plots.png

384 kB

c44a8cee4fb1dcd3ce6c25838ac98b7c5b4818e0e415be10ca58b5bc21afb5df 6 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.ByteStorage",
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_parameter",
- "torch.float16",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "torch.uint8"
How to fix it?
5.76 GB
LFS

151a2d0aa104b38939bc45c6a9a8c62bbee0f3792d775b0a875fb6c15241d878 6 months ago
results.json

1.61 kB

c44a8cee4fb1dcd3ce6c25838ac98b7c5b4818e0e415be10ca58b5bc21afb5df 6 months ago
smash_config.json

1.02 kB

c44a8cee4fb1dcd3ce6c25838ac98b7c5b4818e0e415be10ca58b5bc21afb5df 6 months ago