Package dev.langchain4j.model.zhipu

Class ZhipuAiStreamingChatModel

java.lang.Object

dev.langchain4j.model.zhipu.ZhipuAiStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel

public class ZhipuAiStreamingChatModel
extends Object
implements StreamingChatLanguageModel

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ZhipuAiStreamingChatModel.ZhipuAiStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor	Description
ZhipuAiStreamingChatModel(String baseUrl, String apiKey, Double temperature, Double topP, List<String> stops, String model, Integer maxToken, Boolean logRequests, Boolean logResponses, List<ChatModelListener> listeners, Duration callTimeout, Duration connectTimeout, Duration readTimeout, Duration writeTimeout)

Method Summary

Modifier and Type	Method	Description
static ZhipuAiStreamingChatModel.ZhipuAiStreamingChatModelBuilder	builder()
void	generate(String userMessage, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a message from a user.
void	generate(List<ChatMessage> messages, ToolSpecification toolSpecification, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a list of messages and a tool specification.
void	generate(List<ChatMessage> messages, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a sequence of messages.
void	generate(List<ChatMessage> messages, List<ToolSpecification> toolSpecifications, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a list of messages and a list of tool specifications.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate

Constructor Details

ZhipuAiStreamingChatModel

public ZhipuAiStreamingChatModel(String baseUrl,
 String apiKey,
 Double temperature,
 Double topP,
 List<String> stops,
 String model,
 Integer maxToken,
 Boolean logRequests,
 Boolean logResponses,
 List<ChatModelListener> listeners,
 Duration callTimeout,
 Duration connectTimeout,
 Duration readTimeout,
 Duration writeTimeout)

Method Details

builder

public static ZhipuAiStreamingChatModel.ZhipuAiStreamingChatModelBuilder builder()

generate

public void generate(String userMessage,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a message from a user.

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

userMessage - The message from the user.

handler - The handler for streaming the response.

generate

public void generate(List<ChatMessage> messages,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a sequence of messages. Typically, the sequence contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

handler - The handler for streaming the response.

generate

public void generate(List<ChatMessage> messages,
 List<ToolSpecification> toolSpecifications,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a list of messages and a list of tool specifications. The response may either be a text message or a request to execute one of the specified tools. Typically, the list contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

toolSpecifications - A list of tools that the model is allowed to execute. The model autonomously decides whether to use any of these tools.

handler - The handler for streaming the response. AiMessage can contain either a textual response or a request to execute one of the tools.

generate

public void generate(List<ChatMessage> messages,
 ToolSpecification toolSpecification,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a list of messages and a tool specification.

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

toolSpecification - A tool that the model is allowed to execute.

handler - The handler for streaming the response.