Package dev.langchain4j.model.bedrock.internal

Class AbstractBedrockChatModel<T extends BedrockChatModelResponse>

java.lang.Object

dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

dev.langchain4j.model.bedrock.internal.AbstractBedrockChatModel<T>

All Implemented Interfaces:

ChatLanguageModel

Direct Known Subclasses:

BedrockAI21LabsChatModel, BedrockAnthropicCompletionChatModel, BedrockAnthropicMessageChatModel, BedrockCohereChatModel, BedrockLlamaChatModel, BedrockMistralAiChatModel, BedrockStabilityAIChatModel, BedrockTitanChatModel

public abstract class AbstractBedrockChatModel<T extends BedrockChatModelResponse>
extends AbstractSharedBedrockChatModel
implements ChatLanguageModel

Bedrock chat model

Field Summary

Fields inherited from class dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

anthropicVersion, ASSISTANT_PROMPT, assistantPrompt, credentialsProvider, DEFAULT_ANTHROPIC_VERSION, HUMAN_PROMPT, humanPrompt, maxRetries, maxTokens, region, stopSequences, temperature, topK, topP

Constructor Summary

Constructors

Constructor	Description
AbstractBedrockChatModel()

Method Summary

Modifier and Type	Method	Description
Response<AiMessage>	generate(List<ChatMessage> messages)	Generates a response from the model based on a sequence of messages.
protected abstract Map<String,Object>	getRequestParameters(String prompt)	Get request parameters
protected abstract Class<T>	getResponseClassType()	Get response class type
protected software.amazon.awssdk.services.bedrockruntime.model.InvokeModelResponse	invoke(String body)	Invoke call to the API
protected static Map<String,Object>	of(String key, Object value)	Create map with single entry

Methods inherited from class dev.langchain4j.model.bedrock.internal.AbstractSharedBedrockChatModel

chatMessageToString, convertMessagesToAwsBody, getModelId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.ChatLanguageModel

chat, generate, generate, generate, generate, supportedCapabilities

Constructor Details

AbstractBedrockChatModel

public AbstractBedrockChatModel()

Method Details

generate

public Response<AiMessage> generate(List<ChatMessage> messages)

Description copied from interface: ChatLanguageModel

Generates a response from the model based on a sequence of messages. Typically, the sequence contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface ChatLanguageModel

Parameters:

messages - A list of messages.

Returns:

The response generated by the model.

getRequestParameters

protected abstract Map<String,Object> getRequestParameters(String prompt)

Get request parameters

Overrides:

getRequestParameters in class AbstractSharedBedrockChatModel

Parameters:

prompt - prompt

Returns:

request body

getResponseClassType

protected abstract Class<T> getResponseClassType()

Get response class type

Returns:

response class type

invoke

protected software.amazon.awssdk.services.bedrockruntime.model.InvokeModelResponse invoke(String body)

Invoke call to the API

Parameters:

body - body

Returns:

invoke model response

of

protected static Map<String,Object> of(String key,
 Object value)

Create map with single entry

Parameters:

key - key

value - value

Returns:

map