Package dev.langchain4j.model.dashscope

Class QwenStreamingChatModel

java.lang.Object

dev.langchain4j.model.dashscope.QwenStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel

public class QwenStreamingChatModel
extends Object
implements StreamingChatLanguageModel

Represents a Qwen language model with a chat completion interface. The model's response is streamed token by token and should be handled with StreamingResponseHandler.
More details are available here

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	QwenStreamingChatModel.QwenStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor	Description
QwenStreamingChatModel(String baseUrl, String apiKey, String modelName, Double topP, Integer topK, Boolean enableSearch, Integer seed, Float repetitionPenalty, Float temperature, List<String> stops, Integer maxTokens)

Method Summary

Modifier and Type	Method	Description
static QwenStreamingChatModel.QwenStreamingChatModelBuilder	builder()
void	generate(List<ChatMessage> messages, StreamingResponseHandler<AiMessage> handler)	Generates a response from the model based on a sequence of messages.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate, generate, generate, generate

Constructor Details

QwenStreamingChatModel

public QwenStreamingChatModel(String baseUrl,
 String apiKey,
 String modelName,
 Double topP,
 Integer topK,
 Boolean enableSearch,
 Integer seed,
 Float repetitionPenalty,
 Float temperature,
 List<String> stops,
 Integer maxTokens)

Method Details

generate

public void generate(List<ChatMessage> messages,
 StreamingResponseHandler<AiMessage> handler)

Description copied from interface: StreamingChatLanguageModel

Generates a response from the model based on a sequence of messages. Typically, the sequence contains messages in the following order: System (optional) - User - AI - User - AI - User ...

Specified by:

generate in interface StreamingChatLanguageModel

Parameters:

messages - A list of messages.

handler - The handler for streaming the response.

builder

public static QwenStreamingChatModel.QwenStreamingChatModelBuilder builder()