Package dev.langchain4j.model.ollama

Class OllamaChatModel

java.lang.Object

dev.langchain4j.model.ollama.OllamaChatModel

All Implemented Interfaces:

ChatLanguageModel

public class OllamaChatModel
extends Object
implements ChatLanguageModel

Ollama API reference
Ollama API parameters.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OllamaChatModel.OllamaChatModelBuilder

Constructor Summary

Constructors

Constructor

Description

OllamaChatModel(HttpClientBuilder httpClientBuilder, String baseUrl, String modelName, Double temperature, Integer topK, Double topP, Double repeatPenalty, Integer seed, Integer numPredict, Integer numCtx, List<String> stop, String format, ResponseFormat responseFormat, Duration timeout, Integer maxRetries, Map<String,String> customHeaders, Boolean logRequests, Boolean logResponses, List<ChatModelListener> listeners, Set<Capability> supportedCapabilities)

Method Summary

Modifier and Type	Method	Description
static OllamaChatModel.OllamaChatModelBuilder	builder()
ChatResponse	chat(ChatRequest request)	This is the main API to interact with the chat model.
List<ChatModelListener>	listeners()
ModelProvider	provider()
Set<Capability>	supportedCapabilities()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.ChatLanguageModel

chat, chat, chat, defaultRequestParameters, doChat

Constructor Details

OllamaChatModel

public OllamaChatModel(HttpClientBuilder httpClientBuilder,
 String baseUrl,
 String modelName,
 Double temperature,
 Integer topK,
 Double topP,
 Double repeatPenalty,
 Integer seed,
 Integer numPredict,
 Integer numCtx,
 List<String> stop,
 String format,
 ResponseFormat responseFormat,
 Duration timeout,
 Integer maxRetries,
 Map<String,String> customHeaders,
 Boolean logRequests,
 Boolean logResponses,
 List<ChatModelListener> listeners,
 Set<Capability> supportedCapabilities)

Method Details

builder

public static OllamaChatModel.OllamaChatModelBuilder builder()

chat

public ChatResponse chat(ChatRequest request)

Description copied from interface: ChatLanguageModel

This is the main API to interact with the chat model. A temporary default implementation of this method is necessary until all ChatLanguageModel implementations adopt it. It should be removed once that occurs.

Specified by:

chat in interface ChatLanguageModel

Parameters:

request - a ChatRequest, containing all the inputs to the LLM

Returns:

a ChatResponse, containing all the outputs from the LLM

supportedCapabilities

public Set<Capability> supportedCapabilities()

Specified by:

supportedCapabilities in interface ChatLanguageModel

listeners

public List<ChatModelListener> listeners()

Specified by:

listeners in interface ChatLanguageModel

provider

public ModelProvider provider()

Specified by:

provider in interface ChatLanguageModel