minimum: 0
param tags: Optional[List[str]] = None¶
Tags to add to the run trace.
param temperature: Optional[float] = 0.6¶
Temperature value.
exclusiveMinimum: 0
param tfs: Optional[float] = 0.9¶
Tail free sampling value.
maximum: 1
minimum: 0
param top_a: Optional[float] = 0.9¶
Top-a sampling value.
minimum: 0
param top_k: Optional[int] = 0¶
Top-k sampling value.
minimum: 0
param top_p: Optional[float] = 0.95¶
Top-p sampling value.
maximum: 1
minimum: 0
param typical: Optional[float] = 0.5¶
Typical sampling value.
maximum: 1
minimum: 0
param use_authors_note: Optional[bool] = False¶
Whether to use the author’s note from the KoboldAI GUI when generating text.
This has no effect unless use_story is also enabled.
param use_memory: Optional[bool] = False¶
Whether to use the memory from the KoboldAI GUI when generating text.
param use_story: Optional[bool] = False¶
Whether or not to use the story from the KoboldAI GUI when generating text.
param use_world_info: Optional[bool] = False¶
Whether to use the world info from the KoboldAI GUI when generating text.
param verbose: bool [Optional]¶
Whether to print out response text.
__call__(prompt: str, stop: Optional[List[str]] = None, callbacks: Optional[Union[List[BaseCallbackHandler], BaseCallbackManager]] = None, *, tags: Optional[List[str]] = None, metadata: Optional[Dict[str, Any]] = None, **kwargs: Any) → str¶