More examples

[babybirdprd]

Would you be able to make some more examples, for training from other sources than Wikipedia? Or is this project designed primarily for wikipedia article synthetic data?

[severian42]

Right now it's set up using just the Wikipedia-based dataset, but technically you could alter it to any dataset on the HF hub. I tap into that to keep everything compact, so if you find a dataset on HuggingFace that matches your needs, you should be able to drop it in as a replacement without too much editing

I'll work on providing some alternate scripts down the line when I get some free time