Class DecisionModelChatModelRouter.Builder

java.lang.Object

dev.langchain4j.model.chat.router.DecisionModelChatModelRouter.Builder

Enclosing class:

DecisionModelChatModelRouter

public static class DecisionModelChatModelRouter.Builder
extends Object

Since:

1.21.0

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
DecisionModelChatModelRouter	build()
DecisionModelChatModelRouter.Builder	decisionModel(DecisionModel decisionModel)	Sets the decision model that selects the route.
DecisionModelChatModelRouter.Builder	fallbackStrategy(DecisionModelChatModelRouter.FallbackStrategy fallbackStrategy)	Sets what happens when the decision model fails.
DecisionModelChatModelRouter.Builder	maxMessages(Integer maxMessages)	Sets the maximum number of messages of the conversation (user messages and text responses of the AI, up to and including the last user message) that the decision model receives.
DecisionModelChatModelRouter.Builder	minProbability(Double minProbability)	Sets the minimum probability of the chosen route.
DecisionModelChatModelRouter.Builder	question(String question)	Sets the question asked to choose between the routes, whose descriptions are the options.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

decisionModel

public DecisionModelChatModelRouter.Builder decisionModel(DecisionModel decisionModel)

Sets the decision model that selects the route. Required.

question

public DecisionModelChatModelRouter.Builder question(String question)

Sets the question asked to choose between the routes, whose descriptions are the options.

It is a plain question rather than a template: all routes are the options of a single choice question, so there is nothing to insert into the question.

Default value is "Which model should handle this request?".

minProbability

public DecisionModelChatModelRouter.Builder minProbability(Double minProbability)

Sets the minimum probability of the chosen route. Below it, the router does not select a route, so the default route of the routing chat model is used, for example a larger model when the decision model is not sure. Requires a decision model that reports probabilities. Optional: by default, the chosen route is always used.

fallbackStrategy

public DecisionModelChatModelRouter.Builder fallbackStrategy(DecisionModelChatModelRouter.FallbackStrategy fallbackStrategy)

Sets what happens when the decision model fails.

Default value is DecisionModelChatModelRouter.FallbackStrategy.DEFAULT_ROUTE.

maxMessages

public DecisionModelChatModelRouter.Builder maxMessages(Integer maxMessages)

Sets the maximum number of messages of the conversation (user messages and text responses of the AI, up to and including the last user message) that the decision model receives. System messages, tool calls and tool results are never sent, and do not count. Previous messages help with follow-ups whose meaning depends on them; too many can make an older topic outweigh the last message.

Default value is 3. With 1, only the text of the last user message is sent.

build

public DecisionModelChatModelRouter build()