Package dev.langchain4j.model.jlama

Class JlamaLanguageModel

java.lang.Object

dev.langchain4j.model.jlama.JlamaLanguageModel

All Implemented Interfaces:

LanguageModel

public class JlamaLanguageModel
extends Object
implements LanguageModel

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	JlamaLanguageModel.JlamaLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
JlamaLanguageModel(Path modelCachePath, String modelName, String authToken, Integer threadCount, Boolean quantizeModelAtRuntime, Path workingDirectory, com.github.tjake.jlama.safetensors.DType workingQuantizedType, Float temperature, Integer maxTokens)

Method Summary

Modifier and Type	Method	Description
static JlamaLanguageModel.JlamaLanguageModelBuilder	builder()
Response<String>	generate(String prompt)	Generate a response to the given prompt.
static FinishReason	toFinishReason(com.github.tjake.jlama.model.functions.Generator.FinishReason reason)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.LanguageModel

generate

Constructor Details

JlamaLanguageModel

public JlamaLanguageModel(Path modelCachePath,
 String modelName,
 String authToken,
 Integer threadCount,
 Boolean quantizeModelAtRuntime,
 Path workingDirectory,
 com.github.tjake.jlama.safetensors.DType workingQuantizedType,
 Float temperature,
 Integer maxTokens)

Method Details

toFinishReason

public static FinishReason toFinishReason(com.github.tjake.jlama.model.functions.Generator.FinishReason reason)

builder

public static JlamaLanguageModel.JlamaLanguageModelBuilder builder()

generate

public Response<String> generate(String prompt)

Description copied from interface: LanguageModel

Generate a response to the given prompt.

Specified by:

generate in interface LanguageModel

Parameters:

prompt - the prompt.

Returns:

the response.