Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PrunaAI
/
grimjim-rogue-enchantress-32k-7B-QUANTO-float8bit-smashed
like
0
Follow
Pruna AI
112
Transformers
pruna-ai
Inference Endpoints
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
grimjim-rogue-enchantress-32k-7B-QUANTO-float8bit-smashed
1 contributor
History:
3 commits
sharpenb
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
9700c1c
verified
4 months ago
.gitattributes
Safe
1.52 kB
initial commit
4 months ago
README.md
Safe
5.37 kB
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago
config.json
0 Bytes
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago
model.pt
pickle
Detected Pickle imports (23)
"quanto.nn.qlinear.QLinear"
,
"transformers.models.mistral.modeling_mistral.MistralSdpaAttention"
,
"transformers.models.mistral.configuration_mistral.MistralConfig"
,
"transformers.models.mistral.modeling_mistral.MistralForCausalLM"
,
"torch.BFloat16Storage"
,
"torch._utils._rebuild_parameter"
,
"torch.nn.modules.activation.SiLU"
,
"collections.OrderedDict"
,
"__builtin__.set"
,
"transformers.models.mistral.modeling_mistral.MistralModel"
,
"torch.nn.modules.sparse.Embedding"
,
"transformers.models.mistral.modeling_mistral.MistralRMSNorm"
,
"torch.device"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.nn.modules.container.ModuleList"
,
"transformers.models.mistral.modeling_mistral.MistralMLP"
,
"transformers.models.mistral.modeling_mistral.MistralDecoderLayer"
,
"torch.bfloat16"
,
"torch.float8_e4m3fn"
,
"transformers.generation.configuration_utils.GenerationConfig"
,
"torch.FloatStorage"
,
"quanto.tensor.qtype.qtype"
,
"transformers.models.mistral.modeling_mistral.MistralRotaryEmbedding"
How to fix it?
14.5 GB
LFS
99370554f5a9e210aad7025aa51d1067b1696cd15f3b9119cad9d9b7314b4852
4 months ago
smash_config.json
Safe
1.03 kB
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago
special_tokens_map.json
Safe
624 Bytes
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago
tokenizer.json
Safe
1.8 MB
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago
tokenizer.model
Safe
493 kB
LFS
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago
tokenizer_config.json
Safe
1.51 kB
1d8b0fd99400349d878d2eb72a5936f0958fe4d709d1c34b22f7e3c6a352b320
4 months ago