Class LocalAiStreamingChatModel
java.lang.Object
dev.langchain4j.model.localai.LocalAiStreamingChatModel
- All Implemented Interfaces:
StreamingChatModel
See LocalAI documentation for more details.
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic class -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbuilder()voidchat(ChatRequest chatRequest, StreamingChatResponseHandler handler) This is the main API to interact with the chat model.Methods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface StreamingChatModel
chat, chat, defaultRequestParameters, doChat, listeners, provider, supportedCapabilities
-
Constructor Details
-
LocalAiStreamingChatModel
@Deprecated(forRemoval=true, since="1.5.0") public LocalAiStreamingChatModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses) Deprecated, for removal: This API element is subject to removal in a future version. -
LocalAiStreamingChatModel
public LocalAiStreamingChatModel(LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder builder)
-
-
Method Details
-
chat
Description copied from interface:StreamingChatModelThis is the main API to interact with the chat model.- Specified by:
chatin interfaceStreamingChatModel- Parameters:
chatRequest- aChatRequest, containing all the inputs to the LLMhandler- aStreamingChatResponseHandlerthat will handle streaming response from the LLM
-
builder
-