Reference Performance

This page is the entry point and explanation for official performance numbers. For concrete figures, use the latest GitHub releases and reproduce with the performance evaluation tool in your target environment.

Reference Hardware

Official benchmarks typically run on hardware in the following class (concrete SKUs vary per release):

• CPU: mainstream x86_64 server CPUs (with AVX2 / AVX-512)
• Memory: enough DDR4/DDR5 to cover the index plus OS page cache
• Disk: NVMe SSD (for DiskANN scenarios)
• OS: Ubuntu 20.04 / 22.04 or CentOS 7 / 8
• Build: make release by default; MKL is off by default (VSAG_ENABLE_INTEL_MKL=OFF). To enable it explicitly, use VSAG_ENABLE_INTEL_MKL=ON make release (or -DENABLE_INTEL_MKL=ON when invoking CMake directly)

Reference Datasets

Official comparisons use HDF5 datasets compatible with ann-benchmarks:

Key Metrics

• QPS (single- and multi-threaded)
• Average recall (Recall@k)
• P50 / P95 / P99 latency
• Peak memory and index size
• Build time

Reproduction

make release
./build-release/tools/eval/eval_performance --config tools/eval/eval_template.yaml

Compare the resulting JSON / Markdown output against the official figures to catch performance regressions or quantization degradations.

Contributing Numbers

Pull requests that extend this page with “results on additional hardware” sections are welcome. Please include:

• Detailed CPU / memory / disk information.
• The VSAG version (git rev-parse HEAD).
• The eval_performance output (JSON and Markdown are both helpful).
• The exact build command and environment variables (e.g. VSAG_ENABLE_INTEL_MKL).