AzureMLBaseEndpoint#
- class langchain_community.llms.azureml_endpoint.AzureMLBaseEndpoint[source]#
Bases:
BaseModelAzure ML Online Endpoint models.
Create a new model by parsing and validating input data from keyword arguments.
Raises ValidationError if the input data cannot be parsed to form a valid model.
- param content_formatter: Any = None#
The content formatter that provides an input and output transform function to handle formats between the LLM and the endpoint
- param deployment_name: str = ''#
Deployment Name for Endpoint. NOT REQUIRED to call endpoint. Should be passed to constructor or specified as env var AZUREML_DEPLOYMENT_NAME.
- param endpoint_api_key: SecretStr = SecretStr('')#
Authentication Key for Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_API_KEY.
- Constraints:
type = string
writeOnly = True
format = password
- param endpoint_api_type: AzureMLEndpointApiType = AzureMLEndpointApiType.dedicated#
Type of the endpoint being consumed. Possible values are serverless for pay-as-you-go and dedicated for dedicated endpoints.
- param endpoint_url: str = ''#
URL of pre-existing Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_URL.
- param max_retries: int = 1#
- param model_kwargs: dict | None = None#
Keyword arguments to pass to the model.
- param timeout: int = 50#
Request timeout for calls to the endpoint