Official code for the paper "AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning ".
Currently, it is in the rough draft version and the code is still being refined.
@misc{lin2026agzoactivationguidedzerothorderoptimization,
title={AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning},
author={Wei Lin and Yining Jiang and Qingyu Song and Qiao Xiang and Hong Xu},
year={2026},
eprint={2601.17261},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2601.17261},
}