Example transformer language model fine-tuning code for AI field-testing

Only a small sample data are included. More training data are needed for proper fine-tuning. I recommend looking at /src/Separate_.py in particular, as it was the best performing modeling approach (see paper).

APA Citation

Maeda, H. (2025). Field-Testing Multiple-Choice Questions With AI Examinees: English Grammar Items. Educational and Psychological Measurement, 85(2), 221-244. https://doi.org/10.1177/00131644241281053

BibTex Citation

@article{maeda2024field,
author = {Hotaka Maeda},
title ={Field-Testing Multiple-Choice Questions With AI Examinees: English Grammar Items},
journal = {Educational and Psychological Measurement},
volume = {85},
number = {2},
pages = {221-244},
year = {2025},
doi = {10.1177/00131644241281053},
URL = {https://doi.org/10.1177/00131644241281053},
eprint = {https://doi.org/10.1177/00131644241281053}
}