Class LocalAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingLanguageModel

All Implemented Interfaces:

StreamingLanguageModel

public class LocalAiStreamingLanguageModel
extends Object
implements StreamingLanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
LocalAiStreamingLanguageModel(LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder)
LocalAiStreamingLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)	Deprecated, for removal: This API element is subject to removal in a future version.

Method Summary

Modifier and Type	Method	Description
static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder	builder()
void	generate(String prompt, StreamingResponseHandler<String> handler)	Generates a response from the model based on a prompt.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface StreamingLanguageModel

generate

Constructor Details

LocalAiStreamingLanguageModel

@Deprecated(forRemoval=true,
            since="1.5.0")
public LocalAiStreamingLanguageModel(String baseUrl,
 String modelName,
 Double temperature,
 Double topP,
 Integer maxTokens,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses)

Deprecated, for removal: This API element is subject to removal in a future version.

LocalAiStreamingLanguageModel

public LocalAiStreamingLanguageModel(LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder)

Method Details

generate

public void generate(String prompt,
 StreamingResponseHandler<String> handler)

Description copied from interface: StreamingLanguageModel

Generates a response from the model based on a prompt.

Specified by:

generate in interface StreamingLanguageModel

Parameters:

prompt - The prompt.

handler - The handler for streaming the response.

builder

public static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder()