Package dev.langchain4j.model.ollama

Class OllamaChatModel

java.lang.Object

dev.langchain4j.model.ollama.OllamaChatModel

All Implemented Interfaces:

ChatModel

public class OllamaChatModel
extends Object
implements ChatModel

Ollama API reference
Ollama API parameters.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OllamaChatModel.OllamaChatModelBuilder

Constructor Summary

Constructors

Constructor

Description

OllamaChatModel(HttpClientBuilder httpClientBuilder, String baseUrl, String modelName, Double temperature, Integer topK, Double topP, Double repeatPenalty, Integer seed, Integer numPredict, Integer numCtx, List<String> stop, String format, ResponseFormat responseFormat, Duration timeout, Integer maxRetries, Map<String,String> customHeaders, Boolean logRequests, Boolean logResponses, List<ChatModelListener> listeners, Set<Capability> supportedCapabilities)

Method Summary

Modifier and Type	Method	Description
static OllamaChatModel.OllamaChatModelBuilder	builder()
ChatResponse	chat(ChatRequest request)	This is the main API to interact with the chat model.
List<ChatModelListener>	listeners()
ModelProvider	provider()
Set<Capability>	supportedCapabilities()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.ChatModel

chat, chat, chat, defaultRequestParameters, doChat

Constructor Details

OllamaChatModel

public OllamaChatModel(HttpClientBuilder httpClientBuilder,
 String baseUrl,
 String modelName,
 Double temperature,
 Integer topK,
 Double topP,
 Double repeatPenalty,
 Integer seed,
 Integer numPredict,
 Integer numCtx,
 List<String> stop,
 String format,
 ResponseFormat responseFormat,
 Duration timeout,
 Integer maxRetries,
 Map<String,String> customHeaders,
 Boolean logRequests,
 Boolean logResponses,
 List<ChatModelListener> listeners,
 Set<Capability> supportedCapabilities)

Method Details

builder

public static OllamaChatModel.OllamaChatModelBuilder builder()

chat

public ChatResponse chat(ChatRequest request)

Description copied from interface: ChatModel

This is the main API to interact with the chat model.

Specified by:

chat in interface ChatModel

Parameters:

request - a ChatRequest, containing all the inputs to the LLM

Returns:

a ChatResponse, containing all the outputs from the LLM

supportedCapabilities

public Set<Capability> supportedCapabilities()

Specified by:

supportedCapabilities in interface ChatModel

listeners

public List<ChatModelListener> listeners()

Specified by:

listeners in interface ChatModel

provider

public ModelProvider provider()

Specified by:

provider in interface ChatModel