📖 LLM_related_paper_and_github

Survey or conclusion

• Augmented Language Models: a Survey (Feb 2023) [code]
• Towards Reasoning in Large Language Models: A Survey.
• Reasoning with Language Model Prompting: A Survey
• A Survey of Large Language Models (April 2023)
• Tool Learning with Foundation Models (June 2023)

Foundation Models

• LLaMA: Open and Efficient Foundation Language Models
• Llama 2: Open Foundation and Fine-Tuned Chat Models
• GLM: General Language Model Pretraining with Autoregressive Blank Infilling
• GLM-130B: An Open Bilingual Pre-trained Model
• Github ChatGLM2-6B
• Github ChatRWKV
• Github ChatLaw(中文法律大模型)
• Github Llama2-Chinese

Chain-of-thoughts

plan

• LLM+P: Empowering Large Language Models with Optimal Planning Proficiency
• Self-planning Code Generation with Large Language Model
• Embodied Task Planning with Large Language Models

---

• Reflexion: an autonomous agent with dynamic memory and self-reflection
• Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (May 2023)
• ReAct: Synergizing Reasoning and Acting in Language Models
• [self-COT]Self-consistency improves chain of thought reasoning in language models code
• Universality and Limitations of Prompt Tuning (May 2023)
• Self-Critique Prompting with Large Language Models for Inductive Instructions (May 2023, 自我批评)
• Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs (May 2023)
• Tree of Thoughts: Deliberate Problem Solving with Large Language Models (May 2023)
• Chain-of-Symbol Prompting Elicits Planning in Large Langauge Models (May 2023)
• Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling (May 2023) [采样算法更新]
• Boosted Prompt Ensembles for Large Language Models (April 2023)
• REFINER: Reasoning Feedback on Intermediate Representations (April 2023)
• Self-Refine: Iterative Refinement with Self-Feedback (Mar 2023)
• Fairness-guided Few-shot Prompting for Large Language Models (Mar 2023)
• Tab-CoT: Zero-shot Tabular Chain of Thought (May 2023)
• Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance (May 2023)
• SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks (May 2023) [快慢思维]
• Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings (May 2023)
• Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction (May 2023)
• The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning (May 2023)
• Active Learning Principles for In-Context Learning with Large Language Models (May 2023)
• Two Failures of Self-Consistency in the Multi-Step Reasoning of LLMs (May 2023)
• Improving Factuality and Reasoning in Language Models through Multiagent Debate (May 2023)
• ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on\ Chat-based Large Language Models (May 2023)

Prompt

• awesome-chatgpt-prompts
• awesome-chatgpt-prompts-zh

Model finetune

base

• LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
• LoRA: Low-Rank Adaptation of Large Language Models
• SQL-PaLM: Improved Large Language ModelAdaptation for Text-to-SQL
• Focused Prefix Tuning for Controllable Text Generation (June 2023)

model

• FinGPT: Open-Source Financial Large Language Models

✨ some principle

• Meta-in-context learning in large language models (May 2023)
• Post Hoc Explanations of Language Models Can Improve Language Models (May 2023)
• What In-Context Learning "Learns" In-Context: Disentangling Task Recognition and Task Learning (May 2023)
• Heterogeneous Value Evaluation for Large Language Models (May 2023)
• Large Language Models as Tool Makers (May 2023)
• NPPrompt: Pre-trained Language Models Can be Fully Zero-Shot Learners (Zero-Shot)

Agent

• Toolformer: Language Models Can Teach Themselves to Use Tools [code]
• Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models [code]
• HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face [code]
• Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow (June 2023，数据分析agent)
• Voyager: An Open-Ended Embodied Agent with Large Language Models （May 2023，游戏agent）
• CooK: Empowering General-Purpose Language Models with Modular and Collaborative Knowledge (May 2023)
• Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents
• FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance (May 2023)[成本与性能]
• AgentGPT code
• AutoGPT [code]

agent交互

• Generative Agents: Interactive Simulacra of Human Behavior (Apr 2023)
• CAMEL: Communicative Agents for "Mind" Exploration of Large Scale Language Model Society (Mar 2023)

Application

• ChatPaper
• ChatPaper
• document: langchain-ChatGLM
• ChatALL: multi-llm
• 微信个人号接口、微信机器人及命令行微信，三十行即可自定义个人号机器人
• wechat-chatgpt
• chatgpt-on-wechat
• ChatGPT-Midjourney
• chat集成到浏览器-chatGPTBox
• Chat2DB

multimodal

• Minigpt-4: Enhancing vision-language understanding with advanced large language models

code generation

SQL

• SQL-PaLM: Improved Large Language ModelAdaptation for Text-to-SQL (June 2023)
• Exploring Chain-of-Thought Style Prompting for Text-to-SQL (May 2023)
• (DAIL-SQL) Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
• (2023-nips-DIN-SQL) DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
• C3: Zero-shot Text-to-SQL with ChatGPT

writing

• ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing

📖 document

• PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents (May 2023)
• Github gpt4-pdf-chatbot-langchain

reason

• Interpretable Math Word Problem Solution Generation Via Step-by-step Planning (June 2023)
• Let's Verify Step by Step (May 2023)
• Reasoning with Language Model is Planning with World Model (May 2023)
• Why think step-by-step? Reasoning emerges from the locality of experience (April 2023)
• MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning (May 2023)

struct-data

• StructGPT: A General Framework for Large Language Model to Reason over Structured Data
• DiffuD2T: Empowering Data-to-Text Generation with Diffusion(看起来是表格数据)
• PRODIGY: Enabling In-context Learning Over Graphs (May 2023)

classification

• TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks (May 2023)
• PromptClass: Weakly-Supervised Text Classification with Prompting Enhanced Noise-Robust Self-Training (May 2023)
• Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation (May 2023)
• Text Classification via Large Language Models

recommendation

• Large language models are zero-shot rankers for recommender systems
• BookGPT: A General Framework for Book Recommendation Empowered by Large Language Model