SuiteEval 0.1.7

• Hotfix for MSMARCO
• Improvements to caching
• Reduction of duplicate rows from intermediate dataframes

Full Changelog: v0.1.5...0.1.7

SuiteEval 0.1.5

Adds index_dir to allow persistent indices.

What's Changed

• Allow custom index folder by @Parry-Parry in #1
• chore: Update version to 0.1.5 by @Parry-Parry in #2

Full Changelog: v0.1.4...v0.1.5

SuiteEval 0.1.4

Hotfix: When save_dir is set, we need to make sub-directories for each pt.Experiment that runs. Previously, the function would pop kwargs and repeatedly join datasets to the same directory, leading to unexpected nesting. This is now resolved with tests in place.

Full Changelog: v0.1.3...v0.1.4

SuiteEval 0.1.3

• Improved Index Re-Use
• Bug Fixes

Full Changelog: v0.1.2...v0.1.3

v0.1.2

Updates to documentation

Full Changelog: 0.1.1...v0.1.2

SuiteEval 0.1.1

• Documentation

• Spurious reranking sub-module

Full Changelog: 0.1.0...0.1.1

SuiteEval 0.1.0

Contains all suites for a demonstration, allows registration of new suites from ir_datasets.

Full Changelog: https://github.com/Parry-Parry/suiteeval/commits/0.1.0