Package dev.langchain4j.model.localai

Class LocalAiLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiLanguageModel

All Implemented Interfaces:

LanguageModel

public class LocalAiLanguageModel
extends Object
implements LanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LocalAiLanguageModel.LocalAiLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
LocalAiLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Integer maxRetries, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method	Description
static LocalAiLanguageModel.LocalAiLanguageModelBuilder	builder()
Response<String>	generate(String prompt)	Generate a response to the given prompt.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.LanguageModel

generate

Constructor Details

LocalAiLanguageModel

public LocalAiLanguageModel(String baseUrl,
 String modelName,
 Double temperature,
 Double topP,
 Integer maxTokens,
 Duration timeout,
 Integer maxRetries,
 Boolean logRequests,
 Boolean logResponses)

Method Details

generate

public Response<String> generate(String prompt)

Description copied from interface: LanguageModel

Generate a response to the given prompt.

Specified by:

generate in interface LanguageModel

Parameters:

prompt - the prompt.

Returns:

the response.

builder

public static LocalAiLanguageModel.LocalAiLanguageModelBuilder builder()