To make LLM faster we need faster retrieval system. Here comes Embedding Quantization. Embedding quantization is great technique to save cost on Vector DB, significantly faster retrieval while preserving retrieval performance.

⚡🧠 Vectro+ — High-Performance Embedding Engine in Rust 🦀💾 Compress, quantize, and accelerate vector search 🚀 Boost retrieval speed, cut memory, keep semantic precision 🎯🔥

Unofficial Implementation of Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval and Evaluation of RAG system using "SEMALEX" evaluation metric .

🗜️ Compress and search large embedding datasets with Vectro+, a high-performance Rust toolkit for efficient similarity search and streaming compression.