Class LocalAiStreamingChatModel
java.lang.Object
dev.langchain4j.model.localai.LocalAiStreamingChatModel
- All Implemented Interfaces:
StreamingChatModel
See LocalAI documentation for more details.
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic class
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbuilder()
void
chat
(ChatRequest chatRequest, StreamingChatResponseHandler handler) This is the main API to interact with the chat model.Methods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
Methods inherited from interface StreamingChatModel
chat, chat, defaultRequestParameters, doChat, listeners, provider, supportedCapabilities
-
Constructor Details
-
LocalAiStreamingChatModel
@Deprecated(forRemoval=true, since="1.5.0") public LocalAiStreamingChatModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses) Deprecated, for removal: This API element is subject to removal in a future version. -
LocalAiStreamingChatModel
public LocalAiStreamingChatModel(LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder builder)
-
-
Method Details
-
chat
Description copied from interface:StreamingChatModel
This is the main API to interact with the chat model.- Specified by:
chat
in interfaceStreamingChatModel
- Parameters:
chatRequest
- aChatRequest
, containing all the inputs to the LLMhandler
- aStreamingChatResponseHandler
that will handle streaming response from the LLM
-
builder
-