Package dev.langchain4j.model.googleai

Class GoogleAiGeminiTokenizer

java.lang.Object

dev.langchain4j.model.googleai.GoogleAiGeminiTokenizer

All Implemented Interfaces:

Tokenizer

public class GoogleAiGeminiTokenizer
extends Object
implements Tokenizer

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	GoogleAiGeminiTokenizer.GoogleAiGeminiTokenizerBuilder

Method Summary

Modifier and Type	Method	Description
static GoogleAiGeminiTokenizer.GoogleAiGeminiTokenizerBuilder	builder()
int	estimateTokenCountInMessage(ChatMessage message)	Estimates the count of tokens in the given message.
int	estimateTokenCountInMessages(Iterable<ChatMessage> messages)	Estimates the count of tokens in the given messages.
int	estimateTokenCountInText(String text)	Estimates the count of tokens in the given text.
int	estimateTokenCountInToolExecutionRequests(Iterable<ToolExecutionRequest> toolExecutionRequests)
int	estimateTokenCountInToolSpecifications(Iterable<ToolSpecification> toolSpecifications)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

builder

public static GoogleAiGeminiTokenizer.GoogleAiGeminiTokenizerBuilder builder()

estimateTokenCountInText

public int estimateTokenCountInText(String text)

Description copied from interface: Tokenizer

Estimates the count of tokens in the given text.

Specified by:

estimateTokenCountInText in interface Tokenizer

Parameters:

text - the text.

Returns:

the estimated count of tokens.

estimateTokenCountInMessage

public int estimateTokenCountInMessage(ChatMessage message)

Description copied from interface: Tokenizer

Estimates the count of tokens in the given message.

Specified by:

estimateTokenCountInMessage in interface Tokenizer

Parameters:

message - the message.

Returns:

the estimated count of tokens.

estimateTokenCountInToolExecutionRequests

public int estimateTokenCountInToolExecutionRequests(Iterable<ToolExecutionRequest> toolExecutionRequests)

estimateTokenCountInMessages

public int estimateTokenCountInMessages(Iterable<ChatMessage> messages)

Description copied from interface: Tokenizer

Estimates the count of tokens in the given messages.

Specified by:

estimateTokenCountInMessages in interface Tokenizer

Parameters:

messages - the messages.

Returns:

the estimated count of tokens.

estimateTokenCountInToolSpecifications

public int estimateTokenCountInToolSpecifications(Iterable<ToolSpecification> toolSpecifications)