Class MariaDbEmbeddingStore
- All Implemented Interfaces:
EmbeddingStore<TextSegment>
Using cosine or Euclidean similarity
-
Nested Class Summary
Nested Classes -
Field Summary
Fields -
Method Summary
Modifier and TypeMethodDescriptionAdds a given embedding to the store.add(Embedding embedding, TextSegment textSegment) Adds a given embedding and the corresponding content that has been embedded to the store.voidAdds a given embedding to the store.Adds multiple embeddings to the store.addAll(List<Embedding> embeddings, List<TextSegment> embedded) Adds multiple embeddings and their corresponding contents that have been embedded to the store.voidAdds multiple embeddings and their corresponding contents that have been embedded to the store.builder()protected voidinitTable(boolean dropTableFirst, boolean createTable, int dimension) Initialize metadata table following configurationvoidRemoves all embeddings from the store.voidRemoves all embeddings that match the specifiedFilterfrom the store.voidremoveAll(Collection<String> ids) Removes all embeddings that match the specified IDs from the store.search(EmbeddingSearchRequest request) Searches for the most similar (closest in the embedding space)Embeddings.Methods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface EmbeddingStore
addListener, addListeners, generateIds, remove
-
Field Details
-
DEFAULT_TABLE_NAME
- See Also:
-
DEFAULT_COLUMN_EMBEDDING
- See Also:
-
DEFAULT_COLUMN_ID
- See Also:
-
DEFAULT_COLUMN_CONTENT
- See Also:
-
-
Method Details
-
initTable
protected void initTable(boolean dropTableFirst, boolean createTable, int dimension) Initialize metadata table following configuration- Parameters:
dropTableFirst- Should drop table first, usually for testingcreateTable- Should create table automaticallydimension- The vector dimension
-
add
Adds a given embedding to the store.- Specified by:
addin interfaceEmbeddingStore<TextSegment>- Parameters:
embedding- The embedding to be added to the store.- Returns:
- The auto-generated ID associated with the added embedding.
-
add
Adds a given embedding to the store.- Specified by:
addin interfaceEmbeddingStore<TextSegment>- Parameters:
id- The unique identifier for the embedding to be added.embedding- The embedding to be added to the store.
-
add
Adds a given embedding and the corresponding content that has been embedded to the store.- Specified by:
addin interfaceEmbeddingStore<TextSegment>- Parameters:
embedding- The embedding to be added to the store.textSegment- Original content that was embedded.- Returns:
- The auto-generated ID associated with the added embedding.
-
addAll
Adds multiple embeddings to the store.- Specified by:
addAllin interfaceEmbeddingStore<TextSegment>- Parameters:
embeddings- A list of embeddings to be added to the store.- Returns:
- A list of auto-generated IDs associated with the added embeddings.
-
addAll
Adds multiple embeddings and their corresponding contents that have been embedded to the store.- Specified by:
addAllin interfaceEmbeddingStore<TextSegment>- Parameters:
embeddings- A list of embeddings to be added to the store.embedded- A list of original contents that were embedded.- Returns:
- A list of auto-generated IDs associated with the added embeddings.
-
addAll
Description copied from interface:EmbeddingStoreAdds multiple embeddings and their corresponding contents that have been embedded to the store.The lists are positional: the i-th ID, the i-th embedding and the i-th embedded content belong together.
idsandembeddingsmust therefore have the same size, andembedded, when provided, must have that size as well. Anulllist of IDs or embeddings counts as an empty list, so passing embeddings without IDs (or the other way around) is a size mismatch, not an empty input.ValidationUtils.ensureConsistentSizes(List, List, List)implements these rules and should be used by implementations.Passing no embeddings at all (an empty or
nullembeddingstogether with an empty ornullids, and noembeddedcontents) is a no-op: nothing is stored and no exception is thrown.- Specified by:
addAllin interfaceEmbeddingStore<TextSegment>- Parameters:
ids- A list of IDs associated with the added embeddings.embeddings- A list of embeddings to be added to the store.embedded- A list of original contents that were embedded, ornullif they were not provided.
-
removeAll
Description copied from interface:EmbeddingStoreRemoves all embeddings that match the specified IDs from the store.Having nothing to remove is a no-op: an empty or
nullcollection of IDs leaves the store unchanged and throws nothing, in the same way that adding no embeddings stores nothing.- Specified by:
removeAllin interfaceEmbeddingStore<TextSegment>- Parameters:
ids- A collection of unique IDs of the embeddings to be removed.
-
removeAll
Description copied from interface:EmbeddingStoreRemoves all embeddings that match the specifiedFilterfrom the store.- Specified by:
removeAllin interfaceEmbeddingStore<TextSegment>- Parameters:
filter- The filter to be applied to theMetadataof theTextSegmentduring removal. Only embeddings whoseTextSegment'sMetadatamatch theFilterwill be removed.
-
removeAll
public void removeAll()Description copied from interface:EmbeddingStoreRemoves all embeddings from the store.- Specified by:
removeAllin interfaceEmbeddingStore<TextSegment>
-
search
Searches for the most similar (closest in the embedding space)Embeddings.
All search criteria are defined inside theEmbeddingSearchRequest.
EmbeddingSearchRequest.filter()is used to filter by meta dada.- Specified by:
searchin interfaceEmbeddingStore<TextSegment>- Parameters:
request- A request to search in anEmbeddingStore. Contains all search criteria.- Returns:
- An
EmbeddingSearchResultcontaining all foundEmbeddings.
-
builder
-