Description

RusBEIR is a comprehensive benchmark for zero-shot evaluation of information retrieval models in Russian, comprising 17 datasets from various domains that include adapted, translated, and newly created collections. It enables systematic comparison of lexical and neural models—highlighting the importance of preprocessing, BM25 as a strong baseline, and challenges such as long-document retrieval—within a unified open-source framework.