mskov
/

falcon-7b-completion

RefinedWebModel

Model card Files Files and versions Community

falcon-7b-completion / config.json

mskov's picture

Update config.json

7e68864 over 1 year ago

206 Bytes

	{
	"lora_alpha": 16,
	"lora_dropout": 0.1,
	"r": 64,
	"bias": "none",
	"task_type": "CAUSAL_LM",
	"target_modules": [
	"query_key_value",
	"dense",
	"dense_h_to_4h",
	"dense_4h_to_h"
	]
	}