Package dev.langchain4j.model.ollama

Class OllamaChatRequestParameters.Builder

java.lang.Object

dev.langchain4j.model.chat.request.DefaultChatRequestParameters.Builder<OllamaChatRequestParameters.Builder>

dev.langchain4j.model.ollama.OllamaChatRequestParameters.Builder

Enclosing class:

OllamaChatRequestParameters

public static class OllamaChatRequestParameters.Builder
extends DefaultChatRequestParameters.Builder<OllamaChatRequestParameters.Builder>

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
OllamaChatRequestParameters	build()
OllamaChatRequestParameters.Builder	keepAlive(Integer keepAlive)	Controls how long the model will stay loaded into memory following the request
OllamaChatRequestParameters.Builder	minP(Double minP)	Alternative to the topP, and aims to ensure a balance of quality and variety.
OllamaChatRequestParameters.Builder	mirostat(Integer mirostat)	Enable Mirostat sampling for controlling perplexity.
OllamaChatRequestParameters.Builder	mirostatEta(Double mirostatEta)	Influences how quickly the algorithm responds to feedback from the generated text.
OllamaChatRequestParameters.Builder	mirostatTau(Double mirostatTau)	Controls the balance between coherence and diversity of the output.
OllamaChatRequestParameters.Builder	numCtx(Integer numCtx)
OllamaChatRequestParameters.Builder	overrideWith(ChatRequestParameters parameters)
OllamaChatRequestParameters.Builder	repeatLastN(Integer repeatLastN)
OllamaChatRequestParameters.Builder	repeatPenalty(Double repeatPenalty)
OllamaChatRequestParameters.Builder	seed(Integer seed)

Methods inherited from class dev.langchain4j.model.chat.request.DefaultChatRequestParameters.Builder

frequencyPenalty, maxOutputTokens, modelName, presencePenalty, responseFormat, responseFormat, stopSequences, stopSequences, temperature, toolChoice, toolSpecifications, toolSpecifications, topK, topP

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

overrideWith

public OllamaChatRequestParameters.Builder overrideWith(ChatRequestParameters parameters)

Overrides:

overrideWith in class DefaultChatRequestParameters.Builder<OllamaChatRequestParameters.Builder>

mirostat

public OllamaChatRequestParameters.Builder mirostat(Integer mirostat)

Enable Mirostat sampling for controlling perplexity.

Default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0

Returns:

builder

mirostatEta

public OllamaChatRequestParameters.Builder mirostatEta(Double mirostatEta)

Influences how quickly the algorithm responds to feedback from the generated text.

A lower learning rate will result in slower adjustments, while a higher learning rate will make the algorithm more responsive.

Default: 0.1

Returns:

builder

mirostatTau

public OllamaChatRequestParameters.Builder mirostatTau(Double mirostatTau)

Controls the balance between coherence and diversity of the output.

A lower value will result in more focused and coherent text.

Default: 5.0

Returns:

builder

numCtx

public OllamaChatRequestParameters.Builder numCtx(Integer numCtx)

repeatLastN

public OllamaChatRequestParameters.Builder repeatLastN(Integer repeatLastN)

repeatPenalty

public OllamaChatRequestParameters.Builder repeatPenalty(Double repeatPenalty)

seed

public OllamaChatRequestParameters.Builder seed(Integer seed)

minP

public OllamaChatRequestParameters.Builder minP(Double minP)

Alternative to the topP, and aims to ensure a balance of quality and variety. The parameter p represents the minimum probability for a token to be considered, relative to the probability of the most likely token.

For example, with p=0.05 and the most likely token having a probability of 0.9, logits with a value less than 0.045 are filtered out.

Default: 0.0

Returns:

builder

keepAlive

public OllamaChatRequestParameters.Builder keepAlive(Integer keepAlive)

Controls how long the model will stay loaded into memory following the request

Default: 5m

Returns:

builder

build

public OllamaChatRequestParameters build()

Overrides:

build in class DefaultChatRequestParameters.Builder<OllamaChatRequestParameters.Builder>