langchain.llms.titan_takeoff.TitanTakeoff¶
class langchain.llms.titan_takeoff.TitanTakeoff[source]¶
Bases: LLM
Create a new model by parsing and validating input data from keyword arguments.
Raises ValidationError if the input data cannot be parsed to form a valid model.
param base_url: str = 'http://localhost:8000'¶
Specifies the baseURL to use for the Titan Takeoff API.
Default = http://localhost:8000.
param cache: Optional[bool] = None¶
param callback_manager: Optional[BaseCallbackManager] = None¶
param callbacks: Callbacks = None¶
param generate_max_length: int = 128¶
Maximum generation length. Default = 128.
param metadata: Optional[Dict[str, Any]] = None¶
Metadata to add to the run trace.
param no_repeat_ngram_size: int = 0¶
Prevent repetitions of ngrams of this size. Default = 0 (turned off).
param repetition_penalty: float = 1.0¶
Penalise the generation of tokens that have been generated before.
Set to > 1 to penalize. Default = 1 (no penalty).
param sampling_temperature: float = 1.0¶
Sample with randomness. Bigger temperatures are associated with
more randomness and ‘creativity’. Default = 1.0.
param sampling_topk: int = 1¶
Sample predictions from the top K most probable candidates. Default = 1.
param sampling_topp: float = 1.0¶
Sample from predictions whose cumulative probability exceeds this value.
Default = 1.0.
param streaming: bool = False¶
Whether to stream the output. Default = False.
param tags: Optional[List[str]] = None¶
Tags to add to the run trace.