Cached Results

#2
by rajistics - opened

I like this a lot and would like to quickly change/compare different templates. Could you just cache the results and return them when people are using the known examples you are providing? It would save running a prediction each time.
Otherwise, this is super interesting way of showing LLMs. Great work

EuroPython 2022 org

Hey Rajistics, great suggestion i have implemented caching now. Closing this request.

ysharma changed discussion status to closed

Sign up or log in to comment