Skip to content
 
 

Repository files navigation

Freshworks Master File FY2023: Public Evaluation Case

For transparency, we have open-sourced this case, co-created with AfterQuery. It mirrors the private cases inside BAR and shows exactly how we build and score a case.

What this package contains

  • prompt.md: the task given to the model under evaluation: draft a transfer pricing Master File for the Freshworks Group for FY2023 from the matter documents.
  • Rubric with citations.md: the 175 graded criteria, each anchored by verbatim citations to the matter documents.
  • Input Documents/: the matter folder provided to the model.

Composition: genuine public records and fictional documents

This case combines three kinds of material, and it is important to distinguish them:

  • Genuine public records: everything under Input Documents/02 Financial Statements/ is authentic and unmodified: SEC Form 10-K annual reports of Freshworks Inc. and statutory financial statements of group entities obtained from public company registries.
  • Drafting templates: the documents under Input Documents/07 Templates/ are Legora synthetically generated templates verified by legal engineers.
  • Fictional documents: all other input documents (group structure charts, intercompany transaction ledger, functional analysis interview notes, benchmark studies, IP register, and working documents) were created by Legora solely for this evaluation. They are illustrative fabrications designed to make the drafting task realistic.

Releases

Packages

Contributors

Languages