ValueError: Error raised by inference API: Cannot override task for LLM models

#119
by joangonzaleezzz - opened

I am on a DataCamp course. I was trying to use this model through the code:

/---
from langchain_community.llms import HuggingFaceHub

Set your Hugging Face API token

huggingfacehub_api_token = '****'

Define the LLM

llm = HuggingFaceHub(repo_id='tiiuae/falcon-7b-instruct', huggingfacehub_api_token=huggingfacehub_api_token)

Predict the words following the text in question

question = 'Whatever you do, take care of your shoes'
output = llm.invoke(question)

print(output)
/---

And I get the error:

/---
ValueError: Error raised by inference API: Cannot override task for LLM models
/---

Some people using other models are also getting this error suddenly. Check: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/discussions/115

Update streamlit, huggingface and langchain

Sign up or log in to comment