Awesome LLM4AAD

Large language models for automatic algorithm design.

Website · Papers · Contribution guide

Scope

This repository curates papers in which large language models participate in the design, search, evaluation, or improvement of executable algorithms and heuristics. Peer-reviewed papers, arXiv preprints, and public technical reports are included; software without an accompanying paper is not listed as a paper entry.

Papers

Each entry links to the paper, a structured reading note, and code when available. Dates use the accepted publication month when available and the first arXiv month for preprints. Problems use compact labels here while full names remain in the searchable paper metadata.

Month	Paper	Venue	Problems	Focus	Resources
2023.11	AEL — Algorithm Evolution Using Large Language Model	arXiv 2023	TSP	Design object	Note
2023.12	FunSearch — Mathematical discoveries from program search with large language models	Nature 2023	Cap Set, OBP	Design object	Note · Code
2024.05	LLM-Opt Survey — When Large Language Model Meets Optimization	Swarm and Evolutionary Computation 2024	AAD	Design object	Note
2024.07	EoH — Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model	ICML 2024	TSP, BPP, FSSP	Design object	Note · Code
2024.09	EPS Benchmark — Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Models	PPSN 2024	AHD Bench	Feedback	Note · Code
2024.10	Survey-AHD — A Systematic Survey on Large Language Models for Algorithm Design	arXiv (Cornell University) 2024	AAD	Design object	Note
2024.12	ReEvo — ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution	NeurIPS 2024	TSP, VRP, OP, +2	Feedback	Note · Code
2024.12	LLM4AD Platform — LLM4AD: A Platform for Algorithm Design with Large Language Model	arXiv 2024	AAD	Scope	Note · Code
2025.02	LLMRule — An Interpretable Automated Mechanism Design Framework with Large Language Models	arXiv.org 2025	AAD	Design object	Note
2025.02	PoH — Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimization	arXiv 2025	TSP, FSSP	Feedback	Note
2025.02	ARS — ARS: Automatic Routing Solver with Large Language Models	arXiv 2025	VRP	Design object	Note · Code
2025.03	CEoH — Leveraging Large Language Models to Develop Heuristics for Emerging Optimization Problems	arXiv 2025	UPMP	Feedback	Note
2025.04	HSEvo — HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMs	AAAI 2025	TSP, BPP, OP	Search	Note · Code
2025.04	MEoH — Multi-Objective Evolution of Heuristic Using Large Language Model	AAAI 2025	OBP, TSP	Scope	Note · Code
2025.04	LLaMEA-HPO — In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristics	ACM TELO 2025	OBP, BBO, TSP	Search	Note · Code
2025.04	LLM-SR — LLM-SR: Scientific Equation Discovery via Programming with Large Language Models	ICLR 2025	Equation Discovery, SR	Design object	Note · Code
2025.04	LLMOPT — LLMOPT: Learning to Define and Solve General Optimization Problems from Scratch	ICLR 2025	General Opt. Modeling	Design object	Note · Code
2025.04	OptiBench — OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization Modeling	ICLR 2025	Opt. Modeling	Feedback	Note · Code
2025.05	ORLM — ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling	Operations Research 2025	Opt. Modeling	Design object	Note · Code
2025.05	CALM — CALM: Co-evolution of Algorithms and Language Model for Automatic Heuristic Design	arXiv 2025	CO	Feedback	Note · Code
2025.05	RedAHD — RedAHD: Reduction-Based End-to-End Automatic Heuristic Design with Large Language Models	arXiv 2025	TSP, CVRP, BPP, +3	Scope	Note
2025.05	LLaMEA-BO — LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithms	arXiv 2025	Bayesian Optimization Algorithm Design	Design object	Note · Code
2025.05	InstSpecHH — LLM-Driven Instance-Specific Heuristic Generation and Selection	arXiv 2025	OBP, CVRP	Scope	Note
2025.06	AlphaEvolve — AlphaEvolve: A coding agent for scientific and algorithmic discovery	arXiv white paper 2025	Discovery, DCS, MM, +1	Scope	Note
2025.06	HeurAgenix — HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challenges	arXiv 2025	CO	Scope	Note · Code
2025.07	AAD Fine-tuning — Fine-tuning Large Language Model for Automated Algorithm Design	arXiv 2025	AAD	Feedback	Note · Code
2025.07	EquivaMap — EquivaMap: Leveraging LLMs for Automatic Equivalence Checking of Optimization Formulations	ICML 2025	Formulation Equivalence	Feedback	Note · Code
2025.07	MCTS-AHD — Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Design	ICML 2025	TSP, CVRP, KP, +2	Search	Note · Code
2025.08	Hercules — Efficient Heuristics Generation for Solving Combinatorial Optimization Problems Using Large Language Models	KDD 2025	CO	Feedback	Note · Code
2025.09	AutoPBO — AutoPBO: LLM-powered Optimization for Local Search PBO Solvers	arXiv.org 2025	AAD	Design object	Note
2025.09	Exp-CoEvo — Experience-Guided Reflective Co-Evolution of Prompts and Heuristics for Automatic Algorithm Design	arXiv.org 2025	AAD	Design object	Note
2025.09	ShinkaEvolve — ShinkaEvolve: Towards Open-Ended and Sample-Efficient Program Evolution	arXiv 2025	Program Evolution, Discovery	Search	Note · Code
2025.10	Code Generators — Man-Made Heuristics Are Dead. Long Live Code Generators!	ACM Workshop on Hot Topics in Networks 2025	AAD	Design object	Note
2025.10	VRPAgent — VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problems	ArXiv.org 2025	AAD	Design object	Note
2025.10	CodeEvolve — CodeEvolve: An Open-Source Evolutionary Coding Agent for Algorithmic Discovery and Optimization	arXiv 2025	Algorithmic Discovery, Optimization	Search	Note · Code
2025.12	PartEvo — Partition to Evolve: Niching-enhanced Evolution with LLMs for Automated Algorithm Discovery	NeurIPS 2025	Unimodal Optimization, Multimodal Optimization, Mobile Edge Task Offloading, +2	Search	Note · Code
2025.12	CogMCTS — CogMCTS: A Novel Cognitive-Guided Monte Carlo Tree Search Framework for Iterative Heuristic Evolution with Large Language Models	arXiv 2025	CO	Search	Note
2025.12	Beyond Algo Evo — Beyond Algorithm Evolution: An LLM-Driven Framework for the Co-Evolution of Swarm Intelligence Optimization Algorithms and Prompts	arXiv 2025	CO	Feedback	Note
2026.01	GenePlan — GenePlan: Evolving Better Generalized PDDL Plans Using Large Language Models	Proceedings of the International Conference on Automated Planning and Scheduling 2026	AAD	Design object	Note
2026.01	Magellan — Magellan: Autonomous Discovery of Novel Compiler Optimization Heuristics with AlphaEvolve	arXiv.org 2026	AAD	Design object	Note
2026.01	Pareto-Grid — Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimization	Proceedings of the AAAI Conference on Artificial Intelligence 2026	AAD	Design object	Note
2026.01	DASH — Rethinking LLM-Driven Heuristic Design: Generating Efficient and Specialized Solvers via Dynamics-Aware Optimization	arXiv 2026	CO	Feedback	Note
2026.01	E2OC — Evolving Interdependent Operators with Large Language Models for Multi-Objective Combinatorial Optimization	arXiv 2026	MOCO	Design object	Note
2026.01	TIDE — TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic Design	arXiv 2026	CO	Design object	Note
2026.02	LLM-PB — Large Language Models for Designing Participatory Budgeting Rules	arXiv (Cornell University) 2026	AAD	Design object	Note
2026.02	OR-Agent — OR-Agent: Bridging Evolutionary Search and Structured Research for Automated Algorithm Discovery	arXiv.org 2026	AAD	Design object	Note
2026.02	G-LNS — G-LNS: Generative Large Neighborhood Search for LLM-Based Automatic Heuristic Design	arXiv 2026	TSP, CVRP	Design object	Note · Code
2026.02	AILS-AHD — Enhancing CVRP Solver through LLM-driven Automatic Heuristic Design	arXiv 2026	CVRP	Design object	Note
2026.03	PathPlan — Constraint-aware Path Planning from Natural Language Instructions Using Large Language Models	ArXiv.org 2026	AAD	Design object	Note
2026.03	Strong Priors — From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors	arXiv 2026	PBO, BBO	Feedback	Note
2026.03	DyACE — DyACE: Dynamic Algorithm Co-evolution for Online Automated Heuristic Design with Large Language Model	arXiv 2026	Online Combinatorial Optimization	Design object	Note
2026.03	Evolved-ALNS — Large Language Model-Driven Full-Component Evolution of Adaptive Large Neighborhood Search	arXiv 2026	TSP, CVRP	Design object	Note
2026.03	CDEoH — CDEoH: Category-Driven Automatic Algorithm Design With Large Language Models	arXiv 2026	CO	Feedback	Note
2026.03	DGM — Darwin Godel Machine: Open-ended evolution of self-improving agents	ICLR 2026	AAD	Design object	Note · Code
2026.03	EoH-S — EoH-S: Evolution of Heuristic Set using LLMs for Automated Heuristic Design	AAAI 2026	OBP, TSP, CVRP	Scope	Note
2026.03	TrajEvo — TrajEvo: Trajectory Prediction Heuristics Design via LLM-driven Evolution	Proceedings of the AAAI Conference on Artificial Intelligence 2026	AAD	Design object	Note
2026.04	CliffSearch — CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery	arXiv 2026	Discovery	Design object	Note
2026.04	ReVEL — ReVEL: Multi-Turn Reflective LLM-Guided Heuristic Evolution via Structured Performance Feedback	ArXiv.org 2026	AAD	Design object	Note
2026.04	A-CEoH — Algorithmic Prompt-Augmentation for Efficient LLM-Based Heuristic Design for A* Search	EvoStar 2026	A* Search, UPMP, SPP	Feedback	Note · Code
2026.04	BEAM — BEAM: Bi-level Memory-adaptive Algorithmic Evolution for LLM-Powered Heuristic Design	arXiv 2026	CO	Design object	Note
2026.04	AFL — AFL: An Agentic Framework with LLMs for Solving Complex Vehicle Routing Problems	ICLR 2026	Complex VRP	Design object	Note · Code
2026.04	BehaveSim — Rethinking Code Similarity for Automated Algorithm Design with LLMs	ICLR 2026	Similarity Evaluation	Feedback	Note · Code
2026.04	HeuriGym — HeuriGym: An Agentic Benchmark for LLM-Crafted Heuristics in Combinatorial Optimization	ICLR 2026	CO Bench	Feedback	Note · Code
2026.04	MLES — Multimodal LLM-assisted Evolutionary Search for Programmatic Control Policies	ICLR 2026	LunarLander, CarRacing	Feedback	Note · Code
2026.04	A2DEPT — A2DEPT: Large Language Model-Driven Automated Algorithm Design via Evolutionary Program Trees	arXiv 2026	AAD	Design object	Note
2026.05	CUDA Feedback — Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation	ArXiv.org 2026	AAD	Design object	Note
2026.05	DHFSP-Evo — Automatic generation of heuristic dispatching rules for dynamic hybrid flow shop scheduling via personalized multi-island reflective evolution	Tsinghua Science & Technology 2026	AAD	Design object	Note
2026.05	Domain Heuristics — LLM-Evolved Domain-Independent Heuristics for Symbolic AI Planning	ArXiv.org 2026	AAD	Design object	Note
2026.05	FrontierOR — FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization	ArXiv.org 2026	AAD	Design object	Note
2026.05	MEMOIR — Memory-Guided Tree Search with Cross-Branch Knowledge Transfer for LLM Solver Synthesis	ArXiv.org 2026	AAD	Design object	Note
2026.05	OR Survey — Large Language Models for Operations Research: A Comprehensive Survey	ArXiv.org 2026	AAD	Design object	Note
2026.05	LaF-MCTS — Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS	arXiv 2026	Large-scale CVRP	Design object	Note
2026.05	Knowledge-first — Back to the Beginning of Heuristic Design: Bridging Code and Knowledge with LLMs	arXiv 2026	CO	Design object	Note
2026.05	HMACE — HMACE: Heterogeneous Multi-Agent Collaborative Evolution for Combinatorial Optimization	arXiv 2026	TSP, OBP, MKP, +1	Feedback	Note
2026.05	AHD Agent — AHD Agent: Agentic Reinforcement Learning for Automatic Heuristic Design	arXiv 2026	CO	Feedback	Note · Code
2026.05	Code Graph — Budget-Efficient Automatic Algorithm Design via Code Graph	arXiv 2026	AAD Bench	Design object	Note
2026.05	Teacher-Aware — Teacher-Aware Evolution of Heuristic Programs from Learned Optimization Policies	arXiv 2026	Scheduling, Routing, Graph Optimization	Feedback	Note
2026.05	Vesper — Effective Harness Engineering for Algorithm Discovery with Coding Agents	arXiv 2026	Algorithm Discovery	Feedback	Note
2026.05	AutoPort — LLM-Enabled Automated Algorithm Design for Multiuser Fluid Antenna Communications	IEEE TWC 2026	FAS Port Selection, Beamforming	Design object	Note
2026.05	AutoSG — AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization	arXiv 2026	Expensive Optimization	Feedback	Note
2026.05	PyVRP+ — PyVRP+: LLM-Driven Metacognitive Heuristic Evolution for Hybrid Genetic Search in Vehicle Routing Problems	AAMAS 2026	VRP	Feedback	Note · Code
2026.05	AHD-Network — Automated Heuristic Design for Network Operations	arXiv 2026	Low-Density Parity-Check Decoding	Scope	Note
2026.05	CoEvo — LLM-Driven Co-Evolutionary Automated Heuristic Design for Bi-Component Coupled Combinatorial Optimization	arXiv 2026	Traveling Thief Problem, Traveling Purchaser Problem	Design object	Note
2026.06	EPB — Interpreting Neural Combinatorial Optimization via Evolving Programmatic Bottlenecks	ArXiv.org 2026	AAD	Design object	Note
2026.06	EvoOptiGraph — EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling	ArXiv.org 2026	AAD	Design object	Note
2026.06	Macro Order — Order Matters: Unveiling the Hidden Impact of Macro Placement Sequences via Proxy-Guided LLM Evolution	arXiv (Cornell University) 2026	AAD	Design object	Note
2026.06	OpenEvolve — Algorithmic algorithm development with LLMs: A Case Study on LLM-Usage for Contraction Order Optimization in Tensor Networks	ArXiv.org 2026	AAD	Design object	Note
2026.06	PatternGen — LLM-Evolved Pattern Generators for Optimal Classical Planning	ArXiv.org 2026	AAD	Design object	Note
2026.06	SCOE — Large Language Model-Driven Cooperative Operator Ensemble Evolution for Permutation Flow Shop Scheduling	ArXiv.org 2026	AAD	Design object	Note
2026.06	UH-NAS — LLM-Guided Neural Architecture Search for Robust Co-Design of Physical Neural Networks	arXiv (Cornell University) 2026	AAD	Design object	Note
2026.06	VVenC-QP — LLM-Driven Heuristic Frame-Level Quantization Parameter Adaptation for VVenC	ArXiv.org 2026	AAD	Design object	Note
2026.06	Successor-Gen — Successor-Generator Planning with LLM-generated Heuristics	Proceedings of the International Conference on Automated Planning and Scheduling 2026	AAD	Design object	Note
2026.06	MeEvo — MeEvo: Metacognitive Evolution Combined with Natural Evolution for Automatic Heuristic Design	arXiv 2026	CO	Feedback	Note · Code
2026.06	LHS — Latent Heuristic Search: Continuous Optimization for Automated Algorithm Design	LION 2026	TSP, CVRP, KP, +1	Design object	Note · Code
2026.06	REFLEX — REFLEX: Reflective Evolution from LLM Experience	arXiv 2026	Programmatic Policy Evolution	Feedback	Note
2026.06	Feynman-FS — Explainable AI-assisted optimization for Feynman integral reduction	Journal of High Energy Physics 2026	AAD	Design object	Note
2026.06	STABLE — Semantics-Aware Bilevel Co-Evolution: Towards Automated Multicomponent Algorithm Design	arXiv 2026	Multicomponent Algorithm Design	Design object	Note
2026.06	RAISE — RAISE: LLM-based Automated Heuristic Design with Robust Adversary Instance Search	arXiv 2026	OBP, Online Job Shop Scheduling, Online Vehicle Routing	Scope	Note
2026.07	MTHS — Hierarchical Representations for Cross-task Automated Heuristic Design using LLMs	ICML 2026	Cross-task AHD	Design object	Note
2026.07	PathWise — PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMs	ICML 2026	TSP, KP, CVRP, +3	Search	Note · Code
2026.07	AST Operator — Breaking Validity-Induced Boundaries to Expand Algorithm Search Space: A Two-Stage AST-Based Operator for LLM-Driven Automated Heuristic Evolution	GECCO 2026	CO	Design object	Note
2026.07	CoupleEvo — CoupleEvo: Evolving Heuristics for Coupled Optimization Problems Using Large Language Models	GECCO Companion 2026	Coupled Optimization	Design object	Note · Code
2026.07	Mutation Dynamics — Mutation Without Variation: Convergence Dynamics in LLM-Driven Program Evolution	GECCO Workshop 2026	Program Evolution Dynamics	Feedback	Note · Code
2026.08	PACE — PACE: Primitive-Aware Code Evolution for Automated Algorithm Design	arXiv 2026	AAD	Design object	Note

Interactive atlas

The website connects the collection through a compact paper timeline, a curated relation map, and paper-level research notes.

Contributing

No local setup is required. Add or edit Markdown directly in GitHub; automated checks validate the content, update the paper table, and rebuild the website after merge.

• Add a paper
• Add a relation
• Choose relation types and dimensions
• Contribution rules

Citation

If this collection supports your research, cite the repository URL. Please cite original papers for paper-specific claims and results.

License

Repository code and original notes are available under the Apache License 2.0. Paper figures remain the property of their original authors and publishers and are included with source attribution for scholarly navigation.