Package dev.langchain4j.model.bedrock

Class BedrockChatRequestParameters.Builder

java.lang.Object

dev.langchain4j.model.chat.request.DefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>

dev.langchain4j.model.bedrock.BedrockChatRequestParameters.Builder

Enclosing class:

BedrockChatRequestParameters

public static class BedrockChatRequestParameters.Builder
extends DefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
BedrockChatRequestParameters.Builder	additionalModelRequestField(String key, Object value)
BedrockChatRequestParameters.Builder	additionalModelRequestFields(Map<String,Object> additionalModelRequestFields)
BedrockChatRequestParameters	build()
BedrockChatRequestParameters.Builder	enableReasoning(Integer tokenBudget)	Enables reasoning.
BedrockChatRequestParameters.Builder	overrideWith(ChatRequestParameters parameters)
BedrockChatRequestParameters.Builder	promptCaching(BedrockCachePointPlacement placement)	Enables prompt caching and sets where to place the cache point in the conversation.

Methods inherited from class dev.langchain4j.model.chat.request.DefaultChatRequestParameters.Builder

frequencyPenalty, maxOutputTokens, modelName, presencePenalty, responseFormat, responseFormat, stopSequences, stopSequences, temperature, toolChoice, toolSpecifications, toolSpecifications, topK, topP

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

overrideWith

public BedrockChatRequestParameters.Builder overrideWith(ChatRequestParameters parameters)

Overrides:

overrideWith in class DefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>

additionalModelRequestFields

public BedrockChatRequestParameters.Builder additionalModelRequestFields(Map<String,Object> additionalModelRequestFields)

additionalModelRequestField

public BedrockChatRequestParameters.Builder additionalModelRequestField(String key,
 Object value)

enableReasoning

public BedrockChatRequestParameters.Builder enableReasoning(Integer tokenBudget)

Enables reasoning.

See Also:

• AbstractBedrockChatModel.AbstractBuilder.returnThinking(Boolean)
• AbstractBedrockChatModel.AbstractBuilder.sendThinking(Boolean)

promptCaching

public BedrockChatRequestParameters.Builder promptCaching(BedrockCachePointPlacement placement)

Enables prompt caching and sets where to place the cache point in the conversation. Cache points mark where to cache content for reuse across API calls. The cache has a 5-minute TTL which resets on each cache hit. Supported models include Claude 3.5 Sonnet, Claude 3.5 Haiku, Amazon Nova, etc. This can reduce latency by up to 85% and costs by up to 90% for cached prompts.

Parameters:

placement - where to place the cache point (null disables caching)

Returns:

this builder

See Also:

• AWS Bedrock Prompt Caching

build

public BedrockChatRequestParameters build()

Overrides:

build in class DefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>