From 9111f34f907baf544d4bf0c750f8616d46225bda Mon Sep 17 00:00:00 2001 From: Neel Guha Date: Mon, 27 Feb 2023 21:32:01 -0800 Subject: [PATCH] Adding data for example task --- README.md | 2 ++ tasks/README.md | 3 ++- tasks/example_task/README.md | 15 +++++++++++++++ tasks/example_task/base_prompt.txt | 1 + tasks/example_task/test.tsv | 1 + tasks/example_task/train.tsv | 1 + 6 files changed, 22 insertions(+), 1 deletion(-) create mode 100644 tasks/example_task/README.md create mode 100644 tasks/example_task/base_prompt.txt create mode 100644 tasks/example_task/test.tsv create mode 100644 tasks/example_task/train.tsv diff --git a/README.md b/README.md index 410f551..5aec8bd 100644 --- a/README.md +++ b/README.md @@ -14,6 +14,7 @@ We are currently soliciting submissions. Tasks will be reviewed and merged into - [Submission via Google Forms](#submission-via-google-forms) - [Misc](#misc) - [Contributors](#contributors) +- [Licenses](#licenses) - [Citing this work](#citing-this-work) - [Contact](#contact) @@ -127,6 +128,7 @@ The following individuals have contributed to LegalBench: - Julian Nyarko - Daniel E. Ho - Christopher Ré +- [Add your name as a contributor here] ## Licenses LegalBench is a mix of created and transformed datasets. We ask that you follow the license of the dataset creator. diff --git a/tasks/README.md b/tasks/README.md index 38ef492..5891ae4 100644 --- a/tasks/README.md +++ b/tasks/README.md @@ -50,4 +50,5 @@ personal_jurisdiction | Determine if a court has personal jurisdiction over an i proa | Determine if a clause contains a private right of action | CC by 4.0 rule_qa | Question-Answering over different legal rules | CC by 4.0 statutory_reasoning_assessment | Perform reasoning over IRS statutes | -unfair_tos | Classify if clauses in terms-of-service agreements are unfair | CC by 4.0 \ No newline at end of file +unfair_tos | Classify if clauses in terms-of-service agreements are unfair | CC by 4.0 +example_task | [Put a short description of your task here so others can quickly reference it] | [Put the license here] \ No newline at end of file diff --git a/tasks/example_task/README.md b/tasks/example_task/README.md new file mode 100644 index 0000000..e4a3b9d --- /dev/null +++ b/tasks/example_task/README.md @@ -0,0 +1,15 @@ +# Example Task + +**Contributor**: [Your name and email] + +**Source**: [If you created the dataset, put your name here. Otherwise put a link to the original publisher.] + +**License**: [Put the license for the dataset here] + +## Task Description + +Put a description of what your task evaluates here! + +## Task Construction + +Put a description of how to construct your task here! \ No newline at end of file diff --git a/tasks/example_task/base_prompt.txt b/tasks/example_task/base_prompt.txt new file mode 100644 index 0000000..e9d2ee5 --- /dev/null +++ b/tasks/example_task/base_prompt.txt @@ -0,0 +1 @@ +[This file should contain a prompt template that you can use for the model] \ No newline at end of file diff --git a/tasks/example_task/test.tsv b/tasks/example_task/test.tsv new file mode 100644 index 0000000..a86f4d1 --- /dev/null +++ b/tasks/example_task/test.tsv @@ -0,0 +1 @@ +[This should be a TSV file containing test samples. The first row should be headers] \ No newline at end of file diff --git a/tasks/example_task/train.tsv b/tasks/example_task/train.tsv new file mode 100644 index 0000000..0b1a628 --- /dev/null +++ b/tasks/example_task/train.tsv @@ -0,0 +1 @@ +[This should be a TSV file containing training samples. The first row should be headers.] \ No newline at end of file