Options Reference (Generated)

This file is auto-generated. Do not edit manually.

Note on Configuring Lumina Global Index in paimon-cpp When enabling the Lumina global index in paimon-cpp, all configuration parameters specific to Lumina must be prefixed with lumina..

core / builder

KeyTypeRequiredValidatorDescription
build.log_thresholdFieldType::kIntfalseValidatePositiveIntThreshold of builder log.
distance.metricFieldType::kStringfalseValidateMetricDistance metric.
encoding.typeFieldType::kStringfalseValidateEncodingTypeEncoding type.
extension.build.ckpt.countFieldType::kIntfalseValidatePositiveIntNumber of checkpoints.
extension.build.ckpt.thresholdFieldType::kIntfalseValidatePositiveIntThreshold for triggering checkpoint.
index.dimensionFieldType::kInttrueValidatePositiveIntVector dimension.
index.typeFieldType::kStringtrueValidateIndexTypeIndex type.
pretrain.sample_ratioFieldType::kDoublefalseValidateRatio01Sample ratio for pretrain.

core / quantizer

KeyTypeRequiredValidatorDescription
distance.metricFieldType::kStringtrueValidateMetricDistance metric.
encoding.typeFieldType::kStringfalseValidateEncodingTypeEncoding type.
index.dimensionFieldType::kInttrueValidatePositiveIntVector dimension.

core / search

KeyTypeRequiredValidatorDescription
search.parallel_numberFieldType::kIntfalseValidatePositiveIntSearch parallel number.
search.thread_safe_filterFieldType::kBoolfalsenullptrThread safe filter.
search.topkFieldType::kInttrueValidatePositiveIntSearch-time topK override.

core / searcher

KeyTypeRequiredValidatorDescription
index.dimensionFieldType::kInttrueValidatePositiveIntIndex dimension.
index.typeFieldType::kStringtrueValidateIndexTypeIndex type.

diskann / builder

KeyTypeRequiredValidatorDescription
diskann.build.ef_constructionFieldType::kIntfalseValidatePositiveIntDiskANN build ef construction parameter.
diskann.build.neighbor_countFieldType::kIntfalseValidatePositiveIntDiskANN build neighbor count.
diskann.build.reorder_layoutFieldType::kBoolfalsenullptrDiskANN build reorder layout.
diskann.build.slack_pruning_factorFieldType::kDoublefalseValidatePositiveDoubleDiskANN build slack pruning factor.
diskann.build.thread_countFieldType::kIntfalseValidatePositiveIntDiskANN build thread count.
diskann.disk_encoding.encoding.pq.mFieldType::kIntfalseValidatePositiveIntPQ m, when DiskANN disk encoding type = PQ.
diskann.disk_encoding.encoding.pq.max_epochFieldType::kIntfalseValidatePositiveIntPQ max epoch, when DiskANN disk encoding type = PQ.
diskann.disk_encoding.encoding.pq.thread_countFieldType::kIntfalseValidatePositiveIntPQ thread count, when DiskANN disk encoding type = PQ.
diskann.disk_encoding.save_origin_embeddingFieldType::kBoolfalsenullptrDiskANN disk encoding save origin embedding.
diskann.disk_encoding.typeFieldType::kStringfalseValidateEncodingTypeDiskANN disk encoding type.

diskann / search

KeyTypeRequiredValidatorDescription
diskann.search.beam_widthFieldType::kIntfalseValidatePositiveIntDiskann search beam width.
diskann.search.io_limitFieldType::kIntfalseValidatePositiveIntDiskann search IO limit.
diskann.search.list_sizeFieldType::kInttrueValidatePositiveIntDiskann search list size.
diskann.search.use_reorder_dataFieldType::kBoolfalsenullptrDiskann search use reorder data flag.

diskann / searcher

KeyTypeRequiredValidatorDescription
diskann.search.num_nodes_to_cacheFieldType::kIntfalseValidateNonNegativeIntDiskANN nodes to cache.

io / io

Note: io.* options apply to built-in file reader/writer implementations only.

KeyTypeRequiredValidatorDescription
index.pathFieldType::kStringtruenullptrIndex path (built-in IO only).
io.reader.mmap.lock_modeFieldType::kStringfalseValidateMmapLockModemmap lock mode (none/mlock/populate, built-in IO only).
io.reader.typeFieldType::kStringfalseValidateReaderTypeReader type (local/mmap, built-in IO only).
io.verify_crcFieldType::kBoolfalsenullptrVerify section CRC on read (built-in IO only).

ivf / builder

KeyTypeRequiredValidatorDescription
ivf.build.max_epochFieldType::kIntfalseValidatePositiveIntIVF build max epoch.
ivf.build.num_listsFieldType::kInttrueValidatePositiveIntIVF num lists.
ivf.build.thread_countFieldType::kIntfalseValidatePositiveIntIVF build thread count.

ivf / search

KeyTypeRequiredValidatorDescription
search.nprobeFieldType::kIntfalseValidatePositiveIntIVF search nprobe.

quantizer / quantizer

KeyTypeRequiredValidatorDescription
encoding.pq.mFieldType::kIntfalseValidatePositiveIntPQ m.
encoding.pq.make_zero_meanFieldType::kBoolfalsenullptrPQ make zero mean.
encoding.pq.max_epochFieldType::kIntfalseValidatePositiveIntPQ max epoch.
encoding.pq.thread_countFieldType::kIntfalseValidatePositiveIntPQ thread count.
encoding.pq.use_opqFieldType::kBoolfalsenullptrUse OPQ.