Add ARO (Adaptively Rotated Optimization) optimizer#36

Open

JohnLangford wants to merge 18 commits intomicrosoft:mainfrom

JohnLangford:dev/aro

Commits on Mar 29, 2026

Commits on Mar 30, 2026

Move empty_cache inside _shifted_cholesky_qr, right before cholesky_ex
JohnLangford
committed
Add synchronize before empty_cache in cusolver path
JohnLangford
committed
Move Cholesky QR to CPU to avoid cusolver corruption
JohnLangford
committed
Revert to CPU QR — solve_triangular also uses cusolver
JohnLangford
committed

Commits on Mar 31, 2026

Disable autocast in aro_ortho_fn and ensure R_my is float32
JohnLangford
committed