Class OllamaDecisionModel.OllamaDecisionModelBuilder

java.lang.Object

dev.langchain4j.model.ollama.OllamaDecisionModel.OllamaDecisionModelBuilder

Enclosing class:

OllamaDecisionModel

public static class OllamaDecisionModel.OllamaDecisionModelBuilder
extends Object

Since:

1.23.0

Constructor Summary

Constructors

Constructor	Description
OllamaDecisionModelBuilder()

Method Summary

Modifier and Type	Method	Description
OllamaDecisionModel.OllamaDecisionModelBuilder	baseUrl(String baseUrl)	The URL of the Ollama server, for example http://localhost:11434.
OllamaDecisionModel	build()
OllamaDecisionModel.OllamaDecisionModelBuilder	customHeaders(Supplier<Map<String,String>> customHeadersSupplier)	Sets a supplier for custom HTTP headers.
OllamaDecisionModel.OllamaDecisionModelBuilder	customHeaders(Map<String,String> customHeaders)	Sets custom HTTP headers.
OllamaDecisionModel.OllamaDecisionModelBuilder	httpClientBuilder(HttpClientBuilder httpClientBuilder)	Sets the HttpClientBuilder used to create the HTTP client that communicates with Ollama.
OllamaDecisionModel.OllamaDecisionModelBuilder	keepAlive(Integer keepAlive)	How long, in seconds, Ollama keeps the model loaded in memory after a request.
OllamaDecisionModel.OllamaDecisionModelBuilder	listeners(DecisionModelListener... listeners)
OllamaDecisionModel.OllamaDecisionModelBuilder	listeners(List<DecisionModelListener> listeners)	Sets the listeners that are notified of every request, response and error.
OllamaDecisionModel.OllamaDecisionModelBuilder	logger(org.slf4j.Logger logger)	An alternate Logger to be used instead of the default one for logging requests and responses.
OllamaDecisionModel.OllamaDecisionModelBuilder	logRequests(Boolean logRequests)	Whether to log requests.
OllamaDecisionModel.OllamaDecisionModelBuilder	logResponses(Boolean logResponses)	Whether to log responses.
OllamaDecisionModel.OllamaDecisionModelBuilder	maxRetries(Integer maxRetries)	The number of retries after the first attempt, for transient errors such as timeouts and server errors.
OllamaDecisionModel.OllamaDecisionModelBuilder	modelName(String modelName)	The decision model to use when a request does not specify one, for example nimble.
OllamaDecisionModel.OllamaDecisionModelBuilder	timeout(Duration timeout)	The connect and read timeout.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OllamaDecisionModelBuilder

public OllamaDecisionModelBuilder()

Method Details

httpClientBuilder

public OllamaDecisionModel.OllamaDecisionModelBuilder httpClientBuilder(HttpClientBuilder httpClientBuilder)

Sets the HttpClientBuilder used to create the HTTP client that communicates with Ollama.

NOTE: timeout(Duration) overrides timeouts set on the HttpClientBuilder.

baseUrl

public OllamaDecisionModel.OllamaDecisionModelBuilder baseUrl(String baseUrl)

The URL of the Ollama server, for example http://localhost:11434. Required.

modelName

public OllamaDecisionModel.OllamaDecisionModelBuilder modelName(String modelName)

The decision model to use when a request does not specify one, for example nimble. The model name must be set either here or on each request, and the model must have been downloaded (ollama pull nimble).

timeout

public OllamaDecisionModel.OllamaDecisionModelBuilder timeout(Duration timeout)

The connect and read timeout. When not set, the timeouts of the httpClientBuilder(HttpClientBuilder) are used, or 15 seconds (connect) and 60 seconds (read). Without a GPU, or while a model is being loaded, a request can take several seconds.

maxRetries

public OllamaDecisionModel.OllamaDecisionModelBuilder maxRetries(Integer maxRetries)

The number of retries after the first attempt, for transient errors such as timeouts and server errors. Default value is 2.

keepAlive

public OllamaDecisionModel.OllamaDecisionModelBuilder keepAlive(Integer keepAlive)

How long, in seconds, Ollama keeps the model loaded in memory after a request. 0 unloads it right away, and a negative value keeps it loaded. When not set, the Ollama server's setting is used (5 minutes, unless configured otherwise). Loading a decision model can take several seconds, so a longer value avoids that delay when requests are infrequent.

logRequests

public OllamaDecisionModel.OllamaDecisionModelBuilder logRequests(Boolean logRequests)

Whether to log requests. Default value is false.

logResponses

public OllamaDecisionModel.OllamaDecisionModelBuilder logResponses(Boolean logResponses)

Whether to log responses. Default value is false.

logger

public OllamaDecisionModel.OllamaDecisionModelBuilder logger(org.slf4j.Logger logger)

An alternate Logger to be used instead of the default one for logging requests and responses.

customHeaders

public OllamaDecisionModel.OllamaDecisionModelBuilder customHeaders(Map<String,String> customHeaders)

Sets custom HTTP headers.

customHeaders

public OllamaDecisionModel.OllamaDecisionModelBuilder customHeaders(Supplier<Map<String,String>> customHeadersSupplier)

Sets a supplier for custom HTTP headers. The supplier is called before each request, allowing dynamic header values, for example OAuth2 tokens that expire and need refreshing.

listeners

public OllamaDecisionModel.OllamaDecisionModelBuilder listeners(List<DecisionModelListener> listeners)

Sets the listeners that are notified of every request, response and error.

listeners

public OllamaDecisionModel.OllamaDecisionModelBuilder listeners(DecisionModelListener... listeners)

build

public OllamaDecisionModel build()