Package dev.langchain4j.model.localai

Class LocalAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingLanguageModel

All Implemented Interfaces:

StreamingLanguageModel

public class LocalAiStreamingLanguageModel
extends Object
implements StreamingLanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
LocalAiStreamingLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method	Description
static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder	builder()
void	generate(String prompt, StreamingResponseHandler<String> handler)	Generates a response from the model based on a prompt.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.StreamingLanguageModel

generate

Constructor Details

LocalAiStreamingLanguageModel

public LocalAiStreamingLanguageModel(String baseUrl,
 String modelName,
 Double temperature,
 Double topP,
 Integer maxTokens,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses)

Method Details

generate

public void generate(String prompt,
 StreamingResponseHandler<String> handler)

Description copied from interface: StreamingLanguageModel

Generates a response from the model based on a prompt.

Specified by:

generate in interface StreamingLanguageModel

Parameters:

prompt - The prompt.

handler - The handler for streaming the response.

builder

public static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder()