Package dev.langchain4j.model.qianfan

Class QianfanStreamingChatModel

java.lang.Object

dev.langchain4j.model.qianfan.QianfanStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel

public class QianfanStreamingChatModel
extends Object
implements StreamingChatLanguageModel

see details here: https://cloud.baidu.com/doc/WENXINWORKSHOP/s/Nlks5zkzu

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	QianfanStreamingChatModel.QianfanStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor	Description
QianfanStreamingChatModel(String baseUrl, String apiKey, String secretKey, Double temperature, Double topP, String modelName, String endpoint, String responseFormat, Double penaltyScore, Boolean logRequests, Boolean logResponses, Proxy proxy)

Method Summary

Modifier and Type	Method	Description
static QianfanStreamingChatModel.QianfanStreamingChatModelBuilder	builder()
void	generate(List<ChatMessage> messages, ToolSpecification toolSpecification, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a list of messages and a tool specification.
void	generate(List<ChatMessage> messages, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a sequence of messages.
void	generate(List<ChatMessage> messages, List<ToolSpecification> toolSpecifications, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a list of messages and a list of tool specifications.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate, generate

Constructor Details

QianfanStreamingChatModel

public QianfanStreamingChatModel(String baseUrl,
 String apiKey,
 String secretKey,
 Double temperature,
 Double topP,
 String modelName,
 String endpoint,
 String responseFormat,
 Double penaltyScore,
 Boolean logRequests,
 Boolean logResponses,
 Proxy proxy)

Method Details

generate

public void generate(List<ChatMessage> messages,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a sequence of messages. Typically, the sequence contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

handler - The handler for streaming the response.

generate

public void generate(List<ChatMessage> messages,
 List<ToolSpecification> toolSpecifications,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a list of messages and a list of tool specifications. The response may either be a text message or a request to execute one of the specified tools. Typically, the list contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

toolSpecifications - A list of tools that the model is allowed to execute. The model autonomously decides whether to use any of these tools.

handler - The handler for streaming the response. AiMessage can contain either a textual response or a request to execute one of the tools.

generate

public void generate(List<ChatMessage> messages,
 ToolSpecification toolSpecification,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a list of messages and a tool specification.

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

toolSpecification - A tool that the model is allowed to execute.

handler - The handler for streaming the response.

builder

public static QianfanStreamingChatModel.QianfanStreamingChatModelBuilder builder()