Class BedrockChatRequestParameters.Builder
java.lang.Object
dev.langchain4j.model.chat.request.DefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>
dev.langchain4j.model.bedrock.BedrockChatRequestParameters.Builder
- Enclosing class:
BedrockChatRequestParameters
public static class BedrockChatRequestParameters.Builder
extends DefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionadditionalModelRequestField
(String key, Object value) additionalModelRequestFields
(Map<String, Object> additionalModelRequestFields) build()
enableReasoning
(Integer tokenBudget) Enables reasoning.overrideWith
(ChatRequestParameters parameters) promptCaching
(BedrockCachePointPlacement placement) Enables prompt caching and sets where to place the cache point in the conversation.Methods inherited from class DefaultChatRequestParameters.Builder
frequencyPenalty, maxOutputTokens, modelName, presencePenalty, responseFormat, responseFormat, stopSequences, stopSequences, temperature, toolChoice, toolSpecifications, toolSpecifications, topK, topP
-
Constructor Details
-
Builder
public Builder()
-
-
Method Details
-
overrideWith
- Overrides:
overrideWith
in classDefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>
-
additionalModelRequestFields
public BedrockChatRequestParameters.Builder additionalModelRequestFields(Map<String, Object> additionalModelRequestFields) -
additionalModelRequestField
-
enableReasoning
Enables reasoning.- See Also:
-
promptCaching
Enables prompt caching and sets where to place the cache point in the conversation. Cache points mark where to cache content for reuse across API calls. The cache has a 5-minute TTL which resets on each cache hit. Supported models include Claude 3.5 Sonnet, Claude 3.5 Haiku, Amazon Nova, etc. This can reduce latency by up to 85% and costs by up to 90% for cached prompts.- Parameters:
placement
- where to place the cache point (null disables caching)- Returns:
- this builder
- See Also:
-
build
- Overrides:
build
in classDefaultChatRequestParameters.Builder<BedrockChatRequestParameters.Builder>
-