Class JlamaChatModel

java.lang.Object

dev.langchain4j.model.jlama.JlamaChatModel

All Implemented Interfaces:

ChatModel

public class JlamaChatModel
extends Object
implements ChatModel

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	JlamaChatModel.JlamaChatModelBuilder

Constructor Summary

Constructors

Constructor	Description
JlamaChatModel(Path modelCachePath, String modelName, String authToken, Integer threadCount, Boolean quantizeModelAtRuntime, Path workingDirectory, com.github.tjake.jlama.safetensors.DType workingQuantizedType, Float temperature, Integer maxTokens)

Method Summary

Modifier and Type	Method	Description
static JlamaChatModel.JlamaChatModelBuilder	builder()
ChatResponse	chat(ChatRequest chatRequest)	This is the main API to interact with the chat model.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ChatModel

chat, chat, chat, chat, chatAsync, chatAsync, chatAsync, chatAsync, chatAsync, defaultRequestParameters, doChat, doChatAsync, listeners, provider, supportedCapabilities

Constructor Details

JlamaChatModel

public JlamaChatModel(Path modelCachePath,
 String modelName,
 String authToken,
 Integer threadCount,
 Boolean quantizeModelAtRuntime,
 Path workingDirectory,
 com.github.tjake.jlama.safetensors.DType workingQuantizedType,
 Float temperature,
 Integer maxTokens)

Method Details

builder

public static JlamaChatModel.JlamaChatModelBuilder builder()

chat

public ChatResponse chat(ChatRequest chatRequest)

Description copied from interface: ChatModel

This is the main API to interact with the chat model.

Specified by:

chat in interface ChatModel

Parameters:

chatRequest - a ChatRequest, containing all the inputs to the LLM

Returns:

a ChatResponse, containing all the outputs from the LLM