langchain.llms.javelin_ai_gateway.JavelinAIGateway¶
class langchain.llms.javelin_ai_gateway.JavelinAIGateway[source]¶
Bases: LLM
Wrapper around completions LLMs in the Javelin AI Gateway.
To use, you should have the javelin_sdk python package installed.
For more information, see https://docs.getjavelin.io
Example
from langchain.llms import JavelinAIGateway
completions = JavelinAIGateway(
    gateway_uri="<your-javelin-ai-gateway-uri>",
    route="<your-javelin-ai-gateway-completions-route>",
    params={
        "temperature": 0.1
    }
)
Create a new model by parsing and validating input data from keyword arguments.
Raises ValidationError if the input data cannot be parsed to form a valid model.
param cache: Optional[bool] = None¶
param callback_manager: Optional[BaseCallbackManager] = None¶
param callbacks: Callbacks = None¶
param client: Optional[Any] = None¶
The Javelin AI Gateway client.
param gateway_uri: Optional[str] = None¶
The URI of the Javelin AI Gateway API.
param javelin_api_key: Optional[str] = None¶
The API key for the Javelin AI Gateway API.
param metadata: Optional[Dict[str, Any]] = None¶
Metadata to add to the run trace.
param params: Optional[Params] = None¶
Parameters for the Javelin AI Gateway API.
param route: str [Required]¶
The route to use for the Javelin AI Gateway API.
param tags: Optional[List[str]] = None¶
Tags to add to the run trace.
param verbose: bool [Optional]¶