Package dev.langchain4j.model.ollama

Class OllamaStreamingChatModel

java.lang.Object

dev.langchain4j.model.ollama.OllamaStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel

public class OllamaStreamingChatModel
extends Object
implements StreamingChatLanguageModel

Ollama API reference
Ollama API parameters.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OllamaStreamingChatModel.OllamaStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor

Description

OllamaStreamingChatModel(HttpClientBuilder httpClientBuilder, String baseUrl, String modelName, Double temperature, Integer topK, Double topP, Double repeatPenalty, Integer seed, Integer numPredict, Integer numCtx, List<String> stop, String format, ResponseFormat responseFormat, Duration timeout, Boolean logRequests, Boolean logResponses, Map<String,String> customHeaders, List<ChatModelListener> listeners, Set<Capability> supportedCapabilities)

Method Summary

Modifier and Type	Method	Description
static OllamaStreamingChatModel.OllamaStreamingChatModelBuilder	builder()
void	doChat(ChatRequest chatRequest, StreamingChatResponseHandler handler)
ModelProvider	provider()
Set<Capability>	supportedCapabilities()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

chat, chat, chat, defaultRequestParameters, listeners

Constructor Details

OllamaStreamingChatModel

public OllamaStreamingChatModel(HttpClientBuilder httpClientBuilder,
 String baseUrl,
 String modelName,
 Double temperature,
 Integer topK,
 Double topP,
 Double repeatPenalty,
 Integer seed,
 Integer numPredict,
 Integer numCtx,
 List<String> stop,
 String format,
 ResponseFormat responseFormat,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses,
 Map<String,String> customHeaders,
 List<ChatModelListener> listeners,
 Set<Capability> supportedCapabilities)

Method Details

doChat

public void doChat(ChatRequest chatRequest,
 StreamingChatResponseHandler handler)

Specified by:

doChat in interface StreamingChatLanguageModel

supportedCapabilities

public Set<Capability> supportedCapabilities()

Specified by:

supportedCapabilities in interface StreamingChatLanguageModel

provider

public ModelProvider provider()

Specified by:

provider in interface StreamingChatLanguageModel

builder

public static OllamaStreamingChatModel.OllamaStreamingChatModelBuilder builder()