Package dev.langchain4j.model.googleai

Class GoogleAiGeminiStreamingChatModel

java.lang.Object

dev.langchain4j.model.googleai.GoogleAiGeminiStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel

public class GoogleAiGeminiStreamingChatModel
extends Object
implements StreamingChatLanguageModel

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	GoogleAiGeminiStreamingChatModel.GoogleAiGeminiStreamingChatModelBuilder

Field Summary

Fields

Modifier and Type	Field	Description
protected final boolean	allowCodeExecution
protected final String	apiKey
protected final dev.langchain4j.model.googleai.GeminiService	geminiService
protected final boolean	includeCodeExecutionOutput
protected final List<ChatModelListener>	listeners
protected final Integer	maxOutputTokens
protected final Integer	maxRetries
protected final String	modelName
protected final ResponseFormat	responseFormat
protected final List<GeminiSafetySetting>	safetySettings
protected final List<String>	stopSequences
protected final Double	temperature
protected final GeminiFunctionCallingConfig	toolConfig
protected final Integer	topK
protected final Double	topP

Constructor Summary

Constructors

Constructor

Description

GoogleAiGeminiStreamingChatModel(String apiKey, String modelName, Double temperature, Integer topK, Double topP, Integer maxOutputTokens, Duration timeout, ResponseFormat responseFormat, List<String> stopSequences, GeminiFunctionCallingConfig toolConfig, Boolean allowCodeExecution, Boolean includeCodeExecutionOutput, Boolean logRequestsAndResponses, List<GeminiSafetySetting> safetySettings, List<ChatModelListener> listeners, Integer maxRetries)

Method Summary

Modifier and Type	Method	Description
void	chat(ChatRequest chatRequest, StreamingChatResponseHandler handler)	This is the main API to interact with the chat model.
protected static String	computeMimeType(ResponseFormat responseFormat)
protected ChatModelRequest	createChatModelRequest(String modelName, List<ChatMessage> messages, List<ToolSpecification> toolSpecifications, ChatRequestParameters requestParameters)
protected dev.langchain4j.model.googleai.GeminiGenerateContentRequest	createGenerateContentRequest(List<ChatMessage> messages, List<ToolSpecification> toolSpecifications, ResponseFormat responseFormat, ChatRequestParameters requestParameters)
List<ChatModelListener>	listeners()
protected void	notifyListenersOnError(Exception exception, ChatModelRequest request, ModelProvider modelProvider, Map<Object,Object> attributes)
protected void	notifyListenersOnRequest(ChatModelRequestContext context)
protected void	notifyListenersOnResponse(Response<AiMessage> response, ChatModelRequest request, ModelProvider modelProvider, Map<Object,Object> attributes)
ModelProvider	provider()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

chat, chat, defaultRequestParameters, doChat, supportedCapabilities

Field Details

geminiService

protected final dev.langchain4j.model.googleai.GeminiService geminiService

apiKey

protected final String apiKey

modelName

protected final String modelName

temperature

protected final Double temperature

topK

protected final Integer topK

topP

protected final Double topP

maxOutputTokens

protected final Integer maxOutputTokens

stopSequences

protected final List<String> stopSequences

responseFormat

protected final ResponseFormat responseFormat

toolConfig

protected final GeminiFunctionCallingConfig toolConfig

allowCodeExecution

protected final boolean allowCodeExecution

includeCodeExecutionOutput

protected final boolean includeCodeExecutionOutput

safetySettings

protected final List<GeminiSafetySetting> safetySettings

listeners

protected final List<ChatModelListener> listeners

maxRetries

protected final Integer maxRetries

Constructor Details

GoogleAiGeminiStreamingChatModel

public GoogleAiGeminiStreamingChatModel(String apiKey,
 String modelName,
 Double temperature,
 Integer topK,
 Double topP,
 Integer maxOutputTokens,
 Duration timeout,
 ResponseFormat responseFormat,
 List<String> stopSequences,
 GeminiFunctionCallingConfig toolConfig,
 Boolean allowCodeExecution,
 Boolean includeCodeExecutionOutput,
 Boolean logRequestsAndResponses,
 List<GeminiSafetySetting> safetySettings,
 List<ChatModelListener> listeners,
 Integer maxRetries)

Method Details

chat

public void chat(ChatRequest chatRequest,
 StreamingChatResponseHandler handler)

Description copied from interface: StreamingChatLanguageModel

This is the main API to interact with the chat model.

A temporary default implementation of this method is necessary until all StreamingChatLanguageModel implementations adopt it. It should be removed once that occurs.

Specified by:

chat in interface StreamingChatLanguageModel

Parameters:

chatRequest - a ChatRequest, containing all the inputs to the LLM

handler - a StreamingChatResponseHandler that will handle streaming response from the LLM

listeners

public List<ChatModelListener> listeners()

Specified by:

listeners in interface StreamingChatLanguageModel

provider

public ModelProvider provider()

Specified by:

provider in interface StreamingChatLanguageModel

createGenerateContentRequest

protected dev.langchain4j.model.googleai.GeminiGenerateContentRequest createGenerateContentRequest(List<ChatMessage> messages,
 List<ToolSpecification> toolSpecifications,
 ResponseFormat responseFormat,
 ChatRequestParameters requestParameters)

createChatModelRequest

protected ChatModelRequest createChatModelRequest(String modelName,
 List<ChatMessage> messages,
 List<ToolSpecification> toolSpecifications,
 ChatRequestParameters requestParameters)

computeMimeType

protected static String computeMimeType(ResponseFormat responseFormat)

notifyListenersOnRequest

protected void notifyListenersOnRequest(ChatModelRequestContext context)

notifyListenersOnResponse

protected void notifyListenersOnResponse(Response<AiMessage> response,
 ChatModelRequest request,
 ModelProvider modelProvider,
 Map<Object,Object> attributes)

notifyListenersOnError

protected void notifyListenersOnError(Exception exception,
 ChatModelRequest request,
 ModelProvider modelProvider,
 Map<Object,Object> attributes)