Uses of Interface
dev.langchain4j.service.TokenStream
Packages that use TokenStream
-
Uses of TokenStream in dev.langchain4j.service
Classes in dev.langchain4j.service that implement TokenStreamMethods in dev.langchain4j.service that return TokenStreamModifier and TypeMethodDescriptionAiServiceTokenStream.beforeToolExecution
(Consumer<BeforeToolExecution> beforeToolExecutionHandler) default TokenStream
TokenStream.beforeToolExecution
(Consumer<BeforeToolExecution> beforeToolExecutionHandler) The provided consumer will be invoked right before a tool is executed.AiServiceTokenStream.ignoreErrors()
TokenStream.ignoreErrors()
All errors during streaming will be ignored (but will be logged with a WARN log level).AiServiceTokenStream.onCompleteResponse
(Consumer<ChatResponse> completionHandler) TokenStream.onCompleteResponse
(Consumer<ChatResponse> completeResponseHandler) The provided consumer will be invoked when a language model finishes streaming the final chat response, as opposed to the intermediate response (seeonIntermediateResponse(Consumer)
).The provided consumer will be invoked when an error occurs during streaming.AiServiceTokenStream.onIntermediateResponse
(Consumer<ChatResponse> intermediateResponseHandler) default TokenStream
TokenStream.onIntermediateResponse
(Consumer<ChatResponse> intermediateResponseHandler) The provided consumer will be invoked when a language model finishes streaming the intermediate chat response, as opposed to the final response (seeonCompleteResponse(Consumer)
).AiServiceTokenStream.onPartialResponse
(Consumer<String> partialResponseHandler) TokenStream.onPartialResponse
(Consumer<String> partialResponseHandler) The provided consumer will be invoked every time a new partial textual response (usually a single token) from a language model is available.AiServiceTokenStream.onPartialThinking
(Consumer<PartialThinking> partialThinkingHandler) default TokenStream
TokenStream.onPartialThinking
(Consumer<PartialThinking> partialThinkingHandler) The provided consumer will be invoked every time a new partial thinking/reasoning text (usually a single token) from a language model is available.AiServiceTokenStream.onRetrieved
(Consumer<List<Content>> contentsHandler) TokenStream.onRetrieved
(Consumer<List<Content>> contentHandler) The provided consumer will be invoked if anyContent
s are retrieved usingRetrievalAugmentor
.AiServiceTokenStream.onToolExecuted
(Consumer<ToolExecution> toolExecutionHandler) TokenStream.onToolExecuted
(Consumer<ToolExecution> toolExecuteHandler) The provided consumer will be invoked right after a tool is executed. -
Uses of TokenStream in dev.langchain4j.spi.services
Methods in dev.langchain4j.spi.services with parameters of type TokenStream