SYNC: add rs_inventory_q.md from lecture-python.myst - #20
Merged
Merged
Conversation
Mirrors lectures/rs_inventory_q.md from QuantEcon/lecture-python.myst at upstream commit 78030a3a2 (latest commit touching this file, via PR QuantEcon/lecture-python.myst#859). File contains 10 {doc} references to inventory_q (added in #19) and no {cite} keys. Not yet wired into _toc.yml; activated by the TOC PR for #4. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
This PR adds a new lecture, rs_inventory_q.md, introducing a risk-sensitive variant of the inventory management model and showing how to solve it via value function iteration and a risk-sensitive adaptation of Q-learning (mirrored from lecture-python.myst).
Changes:
- Add a new MyST/Jupytext lecture file on risk-sensitive inventory control with a risk-sensitive Bellman operator (log-sum-exp) and greedy policy extraction.
- Implement and demonstrate a risk-sensitive Q-factor formulation and corresponding Q-learning update rule (argmin policy).
- Include plotting, simulation, and learning-trajectory visualization cells for comparing VFI vs Q-learning outcomes.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
5 tasks
This was referenced Jun 3, 2026
mmcky
added a commit
that referenced
this pull request
Jun 21, 2026
Implements the lecture reorder agreed in #4: - Removes discrete_dp from Introduction (Introduction now contains only short_path). - Removes mccall_q from Job Search (now 8 lectures). - Adds a new "Markov Decision Processes" section between Income Fluctuation Problems and LQ Control, containing discrete_dp, inventory_q, rs_inventory_q, mccall_q. discrete_dp is the theoretical foundation (MDP setup) that the Q-learning lectures build on, so they sit together; this also fixes the difficulty curve in Introduction (per @jstac's note that discrete_dp was much more advanced than the lectures that followed). Files inventory_q.md and rs_inventory_q.md were added to the repo in #19 and #20 respectively but were not yet wired into the build (only_build_toc_files: true); this commit activates them. Closes #4 Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
lectures/rs_inventory_q.md, mirrored fromQuantEcon/lecture-python.mystat upstream commit 78030a3a2 (latest commit touching this file, via PR Add lectures on Kihlstrom's paper, Ross Recovery Theorem and update lectures in probability theory lecture-python.myst#859; originally introduced in Add risk-sensitive inventory management lecture lecture-python.myst#827).inventory_q.md(this file{doc}-references it 10 times)._toc.yml—only_build_toc_files: truekeeps it out of the build until the TOC PR lands.{cite}references; no intersphinx-prefix localizations needed.Follow-ups
lecture-python.mystmapping from 25 → 27 files.Test plan
{doc}references toinventory_qresolve against a real file inmain.🤖 Generated with Claude Code