fakezeta
/

gemma-2-9b-it-ov-int8

Text Generation

Inference Endpoints

Model card Files Files and versions Community

gemma-2-9b-it-ov-int8 / model.yaml

fakezeta's picture

Upload folder using huggingface_hub

d0d8c4b verified 2 months ago

history blame contribute delete

179 Bytes

	name: gemma-2-9b-it
	backend: transformers
	parameters:
	model: fakezeta/gemma-2-9b-it-ov-int8
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true