Skip to main content

Amazon Bedrock

Maven Dependency​

<dependency>
    <groupId>dev.langchain4j</groupId>
    <artifactId>langchain4j-bedrock</artifactId>
    <version>0.36.2</version>
</dependency>

AWS credentials​

In order to use Amazon Bedrock models, you need to configure AWS credentials. One of the options is to set the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables. More information can be found here.

AI21 Models​

  • BedrockAI21LabsChatModel

Anthropic Models​

  • BedrockAnthropicMessageChatModel: supports new Messages API
  • BedrockAnthropicCompletionChatModel: supports old Text Completions API
  • BedrockAnthropicStreamingChatModel

Example:

ChatLanguageModel model = BedrockAnthropicMessageChatModel.builder()
.model("anthropic.claude-3-sonnet-20240229-v1:0")
.build();

Cohere Models​

  • BedrockCohereChatModel

Meta Llama Models​

  • BedrockLlamaChatModel

Mistral Models​

  • BedrockMistralAiChatModel

Titan Models​

  • BedrockTitanChatModel
  • BedrockTitanEmbeddingModel

Examples​