Package dev.langchain4j.model.jlama
Class JlamaStreamingChatModel.JlamaStreamingChatModelBuilder
java.lang.Object
dev.langchain4j.model.jlama.JlamaStreamingChatModel.JlamaStreamingChatModelBuilder
- Enclosing class:
JlamaStreamingChatModel
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbuild()
modelCachePath
(Path modelCachePath) quantizeModelAtRuntime
(Boolean quantizeModelAtRuntime) temperature
(Float temperature) threadCount
(Integer threadCount) toString()
workingDirectory
(Path workingDirectory) workingQuantizedType
(com.github.tjake.jlama.safetensors.DType workingQuantizedType)
-
Constructor Details
-
JlamaStreamingChatModelBuilder
public JlamaStreamingChatModelBuilder()
-
-
Method Details
-
modelCachePath
-
modelName
-
authToken
-
threadCount
-
quantizeModelAtRuntime
public JlamaStreamingChatModel.JlamaStreamingChatModelBuilder quantizeModelAtRuntime(Boolean quantizeModelAtRuntime) -
workingDirectory
public JlamaStreamingChatModel.JlamaStreamingChatModelBuilder workingDirectory(Path workingDirectory) -
workingQuantizedType
public JlamaStreamingChatModel.JlamaStreamingChatModelBuilder workingQuantizedType(com.github.tjake.jlama.safetensors.DType workingQuantizedType) -
temperature
-
maxTokens
-
build
-
toString
-