Package dev.langchain4j.model.bedrock.internal

Class AbstractBedrockStreamingChatModel

java.lang.Object

dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

dev.langchain4j.model.bedrock.internal.AbstractBedrockStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel

Direct Known Subclasses:

BedrockAnthropicStreamingChatModel

public abstract class AbstractBedrockStreamingChatModel
extends AbstractSharedBedrockChatModel
implements StreamingChatLanguageModel

Bedrock Streaming chat model

Field Summary

Fields inherited from class dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

anthropicVersion, ASSISTANT_PROMPT, assistantPrompt, credentialsProvider, DEFAULT_ANTHROPIC_VERSION, HUMAN_PROMPT, humanPrompt, maxRetries, maxTokens, region, stopSequences, temperature, topK, topP

Constructor Summary

Constructors

Constructor	Description
AbstractBedrockStreamingChatModel()

Method Summary

Modifier and Type	Method	Description
void	generate(String userMessage, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a message from a user.
void	generate(List<ChatMessage> messages, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a sequence of messages.

Methods inherited from class dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

chatMessageToString, convertMessagesToAwsBody, getModelId, getRequestParameters

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate, generate, generate

Constructor Details

AbstractBedrockStreamingChatModel

public AbstractBedrockStreamingChatModel()

Method Details

generate

public void generate(String userMessage,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a message from a user.

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

userMessage - The message from the user.

handler - The handler for streaming the response.

generate

public void generate(List<ChatMessage> messages,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a sequence of messages. Typically, the sequence contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

handler - The handler for streaming the response.