Package dev.langchain4j.model.bedrock.internal

Class AbstractBedrockChatModel<T extends BedrockChatModelResponse>

java.lang.Object

dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

dev.langchain4j.model.bedrock.internal.AbstractBedrockChatModel<T>

All Implemented Interfaces:

ChatLanguageModel

Direct Known Subclasses:

BedrockAI21LabsChatModel, BedrockAnthropicCompletionChatModel, BedrockAnthropicMessageChatModel, BedrockCohereChatModel, BedrockLlamaChatModel, BedrockMistralAiChatModel, BedrockStabilityAIChatModel, BedrockTitanChatModel

public abstract class AbstractBedrockChatModel<T extends BedrockChatModelResponse>
extends AbstractSharedBedrockChatModel
implements ChatLanguageModel

Bedrock chat model using the Bedrock InvokeAPI.

See Also:

• https://docs.aws.amazon.com/bedrock/latest/userguide/inference-invoke.html

Field Summary

Fields inherited from class dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

anthropicVersion, ASSISTANT_PROMPT, assistantPrompt, credentialsProvider, DEFAULT_ANTHROPIC_VERSION, HUMAN_PROMPT, humanPrompt, listeners, maxRetries, maxTokens, region, stopSequences, temperature, timeout, topK, topP

Constructor Summary

Constructors

Constructor	Description
AbstractBedrockChatModel()

Method Summary

Modifier and Type	Method	Description
ChatResponse	chat(ChatRequest chatRequest)	This is the main API to interact with the chat model.
protected Response<AiMessage>	generate(List<ChatMessage> messages)
software.amazon.awssdk.services.bedrockruntime.BedrockRuntimeClient	getClient()
protected abstract Map<String,Object>	getRequestParameters(String prompt)	Get request parameters
protected abstract Class<T>	getResponseClassType()	Get response class type
List<ChatModelListener>	listeners()
protected static Map<String,Object>	of(String key, Object value)	Create map with single entry
ModelProvider	provider()
Response<AiMessage>	toAiMessage(T result)

Methods inherited from class dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

chatMessageToString, convertMessagesToAwsBody, createModelListenerRequest, createModelListenerRequest, createModelListenerResponse, getModelId, listenerErrorResponse

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.ChatLanguageModel

chat, chat, chat, defaultRequestParameters, doChat, supportedCapabilities

Constructor Details

AbstractBedrockChatModel

public AbstractBedrockChatModel()

Method Details

chat

public ChatResponse chat(ChatRequest chatRequest)

Description copied from interface: ChatLanguageModel

This is the main API to interact with the chat model. A temporary default implementation of this method is necessary until all ChatLanguageModel implementations adopt it. It should be removed once that occurs.

Specified by:

chat in interface ChatLanguageModel

Parameters:

chatRequest - a ChatRequest, containing all the inputs to the LLM

Returns:

a ChatResponse, containing all the outputs from the LLM

generate

protected Response<AiMessage> generate(List<ChatMessage> messages)

toAiMessage

public Response<AiMessage> toAiMessage(T result)

getRequestParameters

protected abstract Map<String,Object> getRequestParameters(String prompt)

Get request parameters

Overrides:

getRequestParameters in class AbstractSharedBedrockChatModel

Parameters:

prompt - prompt

Returns:

request body

getResponseClassType

protected abstract Class<T> getResponseClassType()

Get response class type

Returns:

response class type

getClient

public software.amazon.awssdk.services.bedrockruntime.BedrockRuntimeClient getClient()

of

protected static Map<String,Object> of(String key,
 Object value)

Create map with single entry

Parameters:

key - key

value - value

Returns:

map

listeners

public List<ChatModelListener> listeners()

Specified by:

listeners in interface ChatLanguageModel

provider

public ModelProvider provider()

Specified by:

provider in interface ChatLanguageModel