ValueError: Error raised by inference API: Cannot override task for LLM models
#119
by
joangonzaleezzz
- opened
I am on a DataCamp course. I was trying to use this model through the code:
/---
from langchain_community.llms import HuggingFaceHub
Set your Hugging Face API token
huggingfacehub_api_token = '****'
Define the LLM
llm = HuggingFaceHub(repo_id='tiiuae/falcon-7b-instruct', huggingfacehub_api_token=huggingfacehub_api_token)
Predict the words following the text in question
question = 'Whatever you do, take care of your shoes'
output = llm.invoke(question)
print(output)
/---
And I get the error:
/---
ValueError: Error raised by inference API: Cannot override task for LLM models
/---
Some people using other models are also getting this error suddenly. Check: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/discussions/115
Update streamlit, huggingface and langchain