AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning

[Paper]

Official code for the paper "AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning ".

Currently, it is in the rough draft version and the code is still being refined.

@misc{lin2026agzoactivationguidedzerothorderoptimization,
      title={AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning}, 
      author={Wei Lin and Yining Jiang and Qingyu Song and Qiao Xiang and Hong Xu},
      year={2026},
      eprint={2601.17261},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2601.17261}, 
}