Uses of Interface
dev.langchain4j.model.TokenCountEstimator

Packages that use TokenCountEstimator

Package	Description
dev.langchain4j.data.document.splitter
dev.langchain4j.memory.chat
dev.langchain4j.model.anthropic
dev.langchain4j.model.azure
dev.langchain4j.model.googleai
dev.langchain4j.model.openai
dev.langchain4j.model.openaiofficial
dev.langchain4j.model.watsonx

Uses of TokenCountEstimator in dev.langchain4j.data.document.splitter

Fields in dev.langchain4j.data.document.splitter declared as TokenCountEstimator

Modifier and Type	Field	Description
protected final TokenCountEstimator	HierarchicalDocumentSplitter.tokenCountEstimator

Methods in dev.langchain4j.data.document.splitter with parameters of type TokenCountEstimator

Modifier and Type	Method	Description
static DocumentSplitter	DocumentSplitters.recursive(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)	This is a recommended DocumentSplitter for generic text.

Constructors in dev.langchain4j.data.document.splitter with parameters of type TokenCountEstimator

Modifier	Constructor	Description
	DocumentByCharacterSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)
	DocumentByCharacterSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)
	DocumentByLineSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)
	DocumentByLineSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)
	DocumentByParagraphSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)
	DocumentByParagraphSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)
	DocumentByRegexSplitter(String regex, String joinDelimiter, int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)
	DocumentByRegexSplitter(String regex, String joinDelimiter, int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)
	DocumentBySentenceSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)
	DocumentBySentenceSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)
	DocumentBySentenceSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter, opennlp.tools.sentdetect.SentenceModel sentenceModel)
	DocumentByWordSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)
	DocumentByWordSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)
protected	HierarchicalDocumentSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator)	Creates a new instance of HierarchicalDocumentSplitter.
protected	HierarchicalDocumentSplitter(int maxSegmentSizeInTokens, int maxOverlapSizeInTokens, TokenCountEstimator tokenCountEstimator, DocumentSplitter subSplitter)	Creates a new instance of HierarchicalDocumentSplitter.

Uses of TokenCountEstimator in dev.langchain4j.memory.chat

Methods in dev.langchain4j.memory.chat with parameters of type TokenCountEstimator

Modifier and Type	Method	Description
TokenWindowChatMemory.Builder	TokenWindowChatMemory.Builder.maxTokens(Integer maxTokens, TokenCountEstimator tokenCountEstimator)
static TokenWindowChatMemory	TokenWindowChatMemory.withMaxTokens(int maxTokens, TokenCountEstimator tokenCountEstimator)

Uses of TokenCountEstimator in dev.langchain4j.model.anthropic

Classes in dev.langchain4j.model.anthropic that implement TokenCountEstimator

Modifier and Type	Class	Description
class	AnthropicTokenCountEstimator

Uses of TokenCountEstimator in dev.langchain4j.model.azure

Classes in dev.langchain4j.model.azure that implement TokenCountEstimator

Modifier and Type	Class	Description
class	AzureOpenAiTokenCountEstimator	This class can be used to estimate the cost (in tokens) before calling OpenAI or when using streaming.

Uses of TokenCountEstimator in dev.langchain4j.model.googleai

Classes in dev.langchain4j.model.googleai that implement TokenCountEstimator

Modifier and Type	Class	Description
class	GoogleAiGeminiTokenCountEstimator

Uses of TokenCountEstimator in dev.langchain4j.model.openai

Classes in dev.langchain4j.model.openai that implement TokenCountEstimator

Modifier and Type	Class	Description
class	OpenAiTokenCountEstimator	This class can be used to estimate the cost (in tokens) before calling OpenAI.

Uses of TokenCountEstimator in dev.langchain4j.model.openaiofficial

Fields in dev.langchain4j.model.openaiofficial declared as TokenCountEstimator

Modifier and Type	Field	Description
protected TokenCountEstimator	OpenAiOfficialBaseChatModel.tokenCountEstimator
protected TokenCountEstimator	OpenAiOfficialBaseChatModel.tokenCountEstimator

Methods in dev.langchain4j.model.openaiofficial with parameters of type TokenCountEstimator

Modifier and Type	Method	Description
OpenAiOfficialChatModel.Builder	OpenAiOfficialChatModel.Builder.tokenCountEstimator(TokenCountEstimator tokenCountEstimator)
OpenAiOfficialStreamingChatModel.Builder	OpenAiOfficialStreamingChatModel.Builder.tokenCountEstimator(TokenCountEstimator tokenCountEstimator)

Uses of TokenCountEstimator in dev.langchain4j.model.watsonx

Classes in dev.langchain4j.model.watsonx that implement TokenCountEstimator

Modifier and Type	Class	Description
class	WatsonxTokenCountEstimator	A TokenCountEstimator implementation that integrates IBM watsonx.ai with LangChain4j.