Package dev.langchain4j.model.jitllm

package dev.langchain4j.model.jitllm

Related Packages

Package	Description
dev.langchain4j.model

Classes

Class	Description
JitLLMChatModel	A ChatModel that runs a GGUF model inside the JVM with jitLLM, on a GPU through TornadoVM or on the CPU.
JitLLMChatModel.JitLLMChatModelBuilder	Builder for JitLLMChatModel.
JitLLMStreamingChatModel	A StreamingChatModel that runs a GGUF model inside the JVM with jitLLM, on a GPU through TornadoVM or on the CPU.
JitLLMStreamingChatModel.JitLLMStreamingChatModelBuilder	Builder for JitLLMStreamingChatModel.