Skip to content

Commit 262e291

Browse files
romanlutzCopilot
andauthored
MAINT: Attribute in-the-wild jailbreak templates to paper author affiliations (#2276)
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: dd1ad5b0-f48b-4a55-b75e-0b875d438047 Copilot-Session: b04dd4fc-cf78-464d-91d8-351ca08d90c5 Copilot-Session: 70908627-68c3-42d6-b117-1f619250dcc5
1 parent 944a551 commit 262e291

490 files changed

Lines changed: 987 additions & 493 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

doc/references.bib

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -484,12 +484,15 @@ @article{ji2023beavertails
484484
url = {https://arxiv.org/abs/2307.04657},
485485
}
486486

487-
@article{shen2023donotanything,
487+
@inproceedings{shen2023donotanything,
488488
title = {``Do Anything Now'': Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models},
489489
author = {Xinyue Shen and Zeyuan Chen and Michael Backes and Yun Shen and Yang Zhang},
490-
journal = {arXiv preprint arXiv:2308.03825},
491-
year = {2023},
492-
url = {https://arxiv.org/abs/2308.03825},
490+
booktitle = {Proceedings of the 2024 ACM SIGSAC Conference on Computer and Communications Security},
491+
pages = {1671--1685},
492+
year = {2024},
493+
url = {https://doi.org/10.1145/3658644.3670388},
494+
doi = {10.1145/3658644.3670388},
495+
note = {Official dataset: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts},
493496
}
494497

495498
@article{aakanksha2024multilingual,

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_00118a609b9a9e63.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_00118a609b9a9e63
33
description: 'Community-posted jailbreak prompt collected in the wild from the discord source ''ChatGPT'' by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: the embedded sample request at its natural final user-request position was replaced with a Jinja {{ prompt }} slot. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_00f76622c8593aff.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_00f76622c8593aff
33
description: 'Community-posted jailbreak prompt collected in the wild from the website source ''jailbreak_chat'' by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: the original user-request placeholder was replaced with a Jinja {{ prompt }} slot. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_010edc598ca578db.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_010edc598ca578db
33
description: 'Community-posted jailbreak prompt collected in the wild from the reddit source ''ChatGPTPromptGenius'' (paper community: Basic) by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: a Jinja {{ prompt }} slot was appended at its natural final user-request position so a fresh user request can be inserted. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_025f8aaf6d855285.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_025f8aaf6d855285
33
description: 'Community-posted jailbreak prompt collected in the wild from the reddit source ''ChatGPTJailbreak'' by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: a Jinja {{ prompt }} slot was appended at its natural final user-request position so a fresh user request can be inserted. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_0268a88a13d5d082.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_0268a88a13d5d082
33
description: 'Community-posted jailbreak prompt collected in the wild from the website source ''jailbreak_chat'' (paper community: Start Prompt) by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: the original user-request placeholder was replaced with a Jinja {{ prompt }} slot. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_03278e7112d79d1b.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_03278e7112d79d1b
33
description: 'Community-posted jailbreak prompt collected in the wild from the reddit source ''ChatGPT'' (paper community: Basic) by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: a Jinja {{ prompt }} slot was appended at its natural final user-request position so a fresh user request can be inserted. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_033586ced7abc818.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_033586ced7abc818
33
description: 'Community-posted jailbreak prompt collected in the wild from the reddit source ''ChatGPTJailbreak'' by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: the embedded sample request at its natural final user-request position was replaced with a Jinja {{ prompt }} slot. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_03d9ca68e3e61f7b.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_03d9ca68e3e61f7b
33
description: 'Community-posted jailbreak prompt collected in the wild from the discord source ''Spreadsheet Warriors'' by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: a Jinja {{ prompt }} slot was appended at its natural final user-request position so a fresh user request can be inserted. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

pyrit/datasets/jailbreak/templates/in_the_wild/trustairlab_04a21012c7852cb0.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,8 @@ name: trustairlab_04a21012c7852cb0
33
description: 'Community-posted jailbreak prompt collected in the wild from the website source ''flowgpt'' by the TrustAIRLab ''In-The-Wild Jailbreak Prompts'' study (Shen et al., 2024) and curated by that dataset''s authors. It has been converted into a reusable single-slot jailbreak wrapper: a Jinja {{ prompt }} slot was appended at its natural final user-request position so a fresh user request can be inserted. Original user identities and handles are not included.'
44
authors: []
55
groups:
6-
- TrustAIRLab
6+
- CISPA Helmholtz Center for Information Security
7+
- NetApp
78
source: https://huggingface.co/datasets/TrustAIRLab/in-the-wild-jailbreak-prompts
89
dataset_name: trustairlab_in_the_wild_jailbreak_2023_12_25
910
parameters:

0 commit comments

Comments
 (0)