Uses of Interface
dev.langchain4j.service.TokenStream
Packages that use TokenStream
-
Uses of TokenStream in dev.langchain4j.service
Classes in dev.langchain4j.service that implement TokenStreamMethods in dev.langchain4j.service that return TokenStreamModifier and TypeMethodDescriptionAiServiceTokenStream.beforeToolExecution(Consumer<BeforeToolExecution> beforeToolExecutionHandler) default TokenStreamTokenStream.beforeToolExecution(Consumer<BeforeToolExecution> beforeToolExecutionHandler) The provided consumer will be invoked right before a tool is executed.AiServiceTokenStream.ignoreErrors()TokenStream.ignoreErrors()All errors during streaming will be ignored (but will be logged with a WARN log level).AiServiceTokenStream.onCompleteResponse(Consumer<ChatResponse> completionHandler) TokenStream.onCompleteResponse(Consumer<ChatResponse> completeResponseHandler) The provided consumer will be invoked when a language model finishes streaming the final chat response, as opposed to the intermediate response (seeTokenStream.onIntermediateResponse(Consumer)).The provided consumer will be invoked when an error occurs during streaming.AiServiceTokenStream.onIntermediateResponse(Consumer<ChatResponse> intermediateResponseHandler) default TokenStreamTokenStream.onIntermediateResponse(Consumer<ChatResponse> intermediateResponseHandler) The provided consumer will be invoked when a language model finishes streaming the intermediate chat response, as opposed to the final response (seeTokenStream.onCompleteResponse(Consumer)).AiServiceTokenStream.onPartialResponse(Consumer<String> partialResponseHandler) TokenStream.onPartialResponse(Consumer<String> partialResponseHandler) The provided consumer will be invoked every time a new partial textual response (usually a single token) from a language model is available.AiServiceTokenStream.onPartialResponseWithContext(BiConsumer<PartialResponse, PartialResponseContext> handler) default TokenStreamTokenStream.onPartialResponseWithContext(BiConsumer<PartialResponse, PartialResponseContext> handler) The provided consumer will be invoked every time a new partial textual response (usually a single token) from a language model is available.AiServiceTokenStream.onPartialThinking(Consumer<PartialThinking> partialThinkingHandler) default TokenStreamTokenStream.onPartialThinking(Consumer<PartialThinking> partialThinkingHandler) The provided consumer will be invoked every time a new partial thinking/reasoning text (usually a single token) from a language model is available.AiServiceTokenStream.onPartialThinkingWithContext(BiConsumer<PartialThinking, PartialThinkingContext> handler) default TokenStreamTokenStream.onPartialThinkingWithContext(BiConsumer<PartialThinking, PartialThinkingContext> handler) The provided consumer will be invoked every time a new partial thinking/reasoning text (usually a single token) from a language model is available.AiServiceTokenStream.onRetrieved(Consumer<List<Content>> contentsHandler) TokenStream.onRetrieved(Consumer<List<Content>> contentHandler) The provided consumer will be invoked if anyContents are retrieved usingRetrievalAugmentor.AiServiceTokenStream.onToolExecuted(Consumer<ToolExecution> toolExecutionHandler) TokenStream.onToolExecuted(Consumer<ToolExecution> toolExecuteHandler) The provided consumer will be invoked right after a tool is executed. -
Uses of TokenStream in dev.langchain4j.spi.services
Methods in dev.langchain4j.spi.services with parameters of type TokenStream