Package dev.langchain4j.model.ollama

Class OllamaStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.ollama.OllamaStreamingLanguageModel

All Implemented Interfaces:

StreamingLanguageModel

public class OllamaStreamingLanguageModel
extends Object
implements StreamingLanguageModel

Ollama API reference
Ollama API parameters.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OllamaStreamingLanguageModel.OllamaStreamingLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
OllamaStreamingLanguageModel(String baseUrl, String modelName, Double temperature, Integer topK, Double topP, Double repeatPenalty, Integer seed, Integer numPredict, Integer numCtx, List<String> stop, String format, Duration timeout, Boolean logRequests, Boolean logResponses, Map<String,String> customHeaders)

Method Summary

Modifier and Type	Method	Description
static OllamaStreamingLanguageModel.OllamaStreamingLanguageModelBuilder	builder()
void	generate(String prompt, StreamingResponseHandler<String> handler)	Generates a response from the model based on a prompt.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.StreamingLanguageModel

generate

Constructor Details

OllamaStreamingLanguageModel

public OllamaStreamingLanguageModel(String baseUrl,
 String modelName,
 Double temperature,
 Integer topK,
 Double topP,
 Double repeatPenalty,
 Integer seed,
 Integer numPredict,
 Integer numCtx,
 List<String> stop,
 String format,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses,
 Map<String,String> customHeaders)

Method Details

builder

public static OllamaStreamingLanguageModel.OllamaStreamingLanguageModelBuilder builder()

generate

public void generate(String prompt,
 StreamingResponseHandler<String> handler)

Description copied from interface: StreamingLanguageModel

Generates a response from the model based on a prompt.

Specified by:

generate in interface StreamingLanguageModel

Parameters:

prompt - The prompt.

handler - The handler for streaming the response.