Skip to content

fix: cite the published versions of preprints that have been published - #5724

Merged
Samoed merged 5 commits into
mainfrom
update_citations
Oct 27, 2026
Merged

Samoed merged 5 commits into
mainfrom
update_citations

Conversation

@ayush1298

@ayush1298 ayush1298 commented Oct 20, 2026 •

Copy link
Copy Markdown
Collaborator

refs #5703. 1st part to update citations before #5722
Updates 202 citations that cited the arXiv preprint of a paper that has since been published.

  • BibTeX comes from the ACL Anthology, doi.org, OpenReview or a Crossref title match. Ten entries were filled in by hand from the proceedings pages: CLIP, Whisper and WebLINX (PMLR), two ICLR papers, three TREC overviews, AV-SpeakerBench and DaLAJ. Every citation keeps its key.
  • Entries without a DOI keep their arXiv eprint, so the citation check can verify them by id instead of by title search.
  • li2023making (Llama2Vec): Chaofan Li is listed first, as in Crossref and arXiv; the ACL Anthology lists Zheng Liu first.
  • citation_allowlist.json: adds BEIR-NL (the published version lists the authors in a different order from arXiv) and Flan-T5 (JMLR 2024, arXiv 2022). The pre-commit hook re-indented the file to 4 spaces.
  • citation_cache.json: updated by make citation-check, which passes.
  • tests/test_get_tasks.py: the duplicate-citation test ignores BibTeX case braces (e.g. {BEIR}-{NL}) when comparing titles, so the ACL Anthology entries are not reported as duplicates.
  • reference links that pointed to the arXiv version of an updated paper now point to the published version (ACL Anthology, PMLR, OpenReview, NeurIPS proceedings, or the DOI): 226 links in 109 files.

Not changed:

  • MS MARCO still cites the 2018 arXiv revision (Bajaj et al.). The 2016 CoCo@NIPS paper is an earlier version with different authors.
  • Jina Embeddings 2 stays on arXiv; as far as it was never published.

Copilot AI balanced review requested due to automatic review settings October 20, 2026 09:44

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

An organization owner can choose the repository organization as the billing source for reviews requested by members with a paid Copilot license. Learn about Copilot code review billing.

@ayush1298
ayush1298 requested review from KennethEnevoldsen and Samoed and removed request for KennethEnevoldsen October 20, 2026 09:44
@ayush1298 ayush1298 changed the title fix: cite the published versions of preprints that have since been published fix: cite the published versions of preprints that have been published Oct 20, 2026
Comment thread tests/test_get_tasks.py
Comment thread mteb/models/model_implementations/blip_models.py

@KennethEnevoldsen KennethEnevoldsen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

spot check of about 10 papers all I saw seems correct

Comment thread mteb/tasks/retrieval/nld/climate_fevernl_retrieval.py
Comment thread tests/test_validate_metadata/citation_allowlist.json
@ayush1298

ayush1298 commented Oct 24, 2026 •

Copy link
Copy Markdown
Collaborator Author

Should I merge this one? @Samoed

@Samoed
Samoed merged commit de720d5 into main Oct 27, 2026
17 checks passed
@Samoed
Samoed deleted the update_citations branch October 27, 2026 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants