Class LocalAiChatModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiChatModel

All Implemented Interfaces:

ChatModel

public class LocalAiChatModel
extends Object
implements ChatModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LocalAiChatModel.LocalAiChatModelBuilder

Constructor Summary

Constructors

Constructor	Description
LocalAiChatModel(LocalAiChatModel.LocalAiChatModelBuilder builder)
LocalAiChatModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Integer maxRetries, Boolean logRequests, Boolean logResponses)	Deprecated, for removal: This API element is subject to removal in a future version.

Method Summary

Modifier and Type	Method	Description
static LocalAiChatModel.LocalAiChatModelBuilder	builder()
ChatResponse	chat(ChatRequest chatRequest)	This is the main API to interact with the chat model.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ChatModel

chat, chat, chat, defaultRequestParameters, doChat, listeners, provider, supportedCapabilities

Constructor Details

LocalAiChatModel

@Deprecated(forRemoval=true,
            since="1.5.0")
public LocalAiChatModel(String baseUrl,
 String modelName,
 Double temperature,
 Double topP,
 Integer maxTokens,
 Duration timeout,
 Integer maxRetries,
 Boolean logRequests,
 Boolean logResponses)

Deprecated, for removal: This API element is subject to removal in a future version.

LocalAiChatModel

public LocalAiChatModel(LocalAiChatModel.LocalAiChatModelBuilder builder)

Method Details

chat

public ChatResponse chat(ChatRequest chatRequest)

Description copied from interface: ChatModel

This is the main API to interact with the chat model.

Specified by:

chat in interface ChatModel

Parameters:

chatRequest - a ChatRequest, containing all the inputs to the LLM

Returns:

a ChatResponse, containing all the outputs from the LLM

builder

public static LocalAiChatModel.LocalAiChatModelBuilder builder()