DEPRECATED: use temperature, max_tokens, resolution directly
optional parameters to pass to api
param provider: str [Required]¶
Generative provider to use (eg: openai,stabilityai,cohere,google etc.)
param resolution: Optional[Literal['256x256', '512x512', '1024x1024']] = None¶
param stop_sequences: Optional[List[str]] = None¶
Stop sequences to use.
param subfeature: Literal['generation'] = 'generation'¶
Subfeature of above feature, use generation by default
param tags: Optional[List[str]] = None¶
Tags to add to the run trace.
param temperature: Optional[float] = None¶
Constraints
minimum = 0
maximum = 1
param verbose: bool [Optional]¶
Whether to print out response text.
__call__(prompt: str, stop: Optional[List[str]] = None, callbacks: Optional[Union[List[BaseCallbackHandler], BaseCallbackManager]] = None, *, tags: Optional[List[str]] = None, metadata: Optional[Dict[str, Any]] = None, **kwargs: Any) → str¶
Check Cache and run the LLM on the given prompt and input.
async abatch(inputs: List[Union[PromptValue, str, List[BaseMessage]]], config: Optional[Union[RunnableConfig, List[RunnableConfig]]] = None, *, return_exceptions: bool = False, **kwargs: Any) → List[str]¶
Default implementation of abatch, which calls ainvoke N times.
Subclasses should override this method if they can batch more efficiently.