ybelkada

/

falcon-7b-sharded-bf16

like 20

Original Code is working guys the tiiuae/falcon got the config file restored

##Note: For time being anyone can use the following code while loading:

config = AutoConfig.from_pretrained('https://github.com/avnCode/Falcon-QAMaster/blob/main/config.json')
model = AutoModel.from_pretrained('ybelkada/falcon-7b-sharded-bf16', config=config)
or
model = AutoModelForCausalLM.from_pretrained(
"ybelkada/falcon-7b-sharded-bf16'",
config=config,
return_dict = True,
quantization_config = bnb_config,
device_map = 'auto',
trust_remote_code = True,
)
##

Due to changes in the names of tiiuae/falcon-7b files. Error is popping.
Following are the major changes(for all changes see the Files changed section):
configuration_RW-->configuration_falcon.FalconConfig
modelling_RW-->modeling_falcon.FalconModel
New Function names: FalconConfig, FalconModel, FalconForCausalLM, FalconForQuestionAnswering, FalconForSequenceClassification, FalconForTokenClassification

Please update the config file as modified by me( New config file is tried and tested and its Working!!!)