Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & C…

RAGChecker: A Fine-grained Framework For Diagnosing RAG

This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation

🗺️ Data Cleaning and Textual Data Visualization 🗺️

Empowering RAG with a memory-based data interface for all-purpose applications!

Qdrant integration with BEIR, simplifying quality checks on standard datasets

AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

A Comprehensive Benchmark for Code Information Retrieval.

AAAI-24 CFEVER: A Chinese Fact Extraction and VERification Dataset

StaRD: Statute Retrieval Dataset based on Real-World Legal Consultation

This is the official code for the EMNLP 2023 paper "GLEN: Generative Retrieval via Lexical Index Learning".

Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜

Rust bindings for the Python interpreter

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

Late Interaction Models Training & Retrieval

Code, datasets, and checkpoints for the paper "CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation"

A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.

An open-source RAG-based tool for chatting with your documents.

high performance in-memory cache

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, le…

Awesome utilities for performance profiling

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

AdalFlow: The “PyTorch” library to auto-optimize any LLM tasks.

vsag is a vector indexing library used for similarity search.

Up to 200x Faster Dot Products & Similarity Metrics — for Python, Rust, C, JS, and Swift, supporting f64, f32, f16 real & complex, i8, and bit vectors using SIMD for both AVX2, AVX-512, NEON, SVE, …

pytest plugin that allows tagging tests using arbitrary strings

A cloud native embedded storage engine built on object storage.