Class AzureOpenAiStreamingChatModel
- All Implemented Interfaces:
StreamingChatModel
StreamingResponseHandler
.
Mandatory parameters for initialization are: endpoint and apikey (or an alternate authentication method, see below for more information).
Optionally you can set serviceVersion (if not, the latest version is used) and deploymentName (if not, a default name is used).
You can also provide your own OpenAIAsyncClient
instance, if you need more flexibility.
There are 3 authentication methods:
1. Azure OpenAI API Key Authentication: this is the most common method, using an Azure OpenAI API key. You need to provide the OpenAI API Key as a parameter, using the apiKey() method in the Builder, or the apiKey parameter in the constructor: For example, you would use `builder.apiKey("{key}")`.
2. non-Azure OpenAI API Key Authentication: this method allows to use the OpenAI service, instead of Azure OpenAI. You can use the nonAzureApiKey() method in the Builder, which will also automatically set the endpoint to "https://api.openai.com/v1". For example, you would use `builder.nonAzureApiKey("{key}")`. The constructor requires a KeyCredential instance, which can be created using `new AzureKeyCredential("{key}")`, and doesn't set up the endpoint.
3. Azure OpenAI client with Microsoft Entra ID (formerly Azure Active Directory) credentials. - This requires to add the `com.azure:azure-identity` dependency to your project. - You need to provide a TokenCredential instance, using the tokenCredential() method in the Builder, or the tokenCredential parameter in the constructor. As an example, DefaultAzureCredential can be used to authenticate the client: Set the values of the client ID, tenant ID, and client secret of the AAD application as environment variables: AZURE_CLIENT_ID, AZURE_TENANT_ID, AZURE_CLIENT_SECRET. Then, provide the DefaultAzureCredential instance to the builder: `builder.tokenCredential(new DefaultAzureCredentialBuilder().build())`.
-
Nested Class Summary
Nested Classes -
Constructor Summary
ConstructorsConstructorDescription -
Method Summary
Modifier and TypeMethodDescriptionbuilder()
void
doChat
(ChatRequest request, StreamingChatResponseHandler handler) provider()
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
Methods inherited from interface dev.langchain4j.model.chat.StreamingChatModel
chat, chat, chat
-
Constructor Details
-
AzureOpenAiStreamingChatModel
-
-
Method Details
-
defaultRequestParameters
- Specified by:
defaultRequestParameters
in interfaceStreamingChatModel
-
supportedCapabilities
- Specified by:
supportedCapabilities
in interfaceStreamingChatModel
-
doChat
- Specified by:
doChat
in interfaceStreamingChatModel
-
listeners
- Specified by:
listeners
in interfaceStreamingChatModel
-
provider
- Specified by:
provider
in interfaceStreamingChatModel
-
builder
-