Skip to content

notes: Vercel design.md 方法论卡 - #137

Open
joyehuang wants to merge 2 commits into
mainfrom
0926-vercel-design-md
Open

notes: Vercel design.md 方法论卡#137
joyehuang wants to merge 2 commits into
mainfrom
0926-vercel-design-md

Conversation

@joyehuang

@joyehuang joyehuang commented Sep 1, 2026

Copy link
Copy Markdown
Owner

三层系统(判断/机制/机械) / 冻结 scenario eval loop -57% / 给反模式命名 / 抱怨频率度量 + handdrawn-ui 对照。

止步 PR 不合并。bun run check 0 errors。


Summary by cubic

Adds a deep-dive note on Vercel's eval-driven design.md system, covering the three-layer split (judgment/mechanism/mechanical), named antipatterns, the 7 frozen scenarios, the @design-agent maintenance loop, and an eval loop that cut mechanical failures by 57%. Also applies a type assertion in SiteStats.astro so branches cut from main pass type checks without runtime changes.

Written for commit 7ea5467. Summary will update on new commits.

Review in cubic

includes SiteStats.astro neon type fix (same as #118) for clean check on
branches cut from main
@vercel

vercel Bot commented Sep 1, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
blog Ready Ready Preview Sep 3, 2026 3:10am UTC

Request Review

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 2 files

Re-trigger cubic

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 1 file (changes from recent commits).

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="src/content/notes/0926-vercel-design-md.md">

<violation number="1" location="src/content/notes/0926-vercel-design-md.md:3">
P3: Description 把 91→39/-57% 度量归进了「7 个冻结 scenario 的 eval loop」,但正文明确该数字来自单独的控制实验,只用了 3 个 desktop scenario(3×2=6 页),caveat ② 也写「6 页样本太小」。这个括号会让人误读为 -57% 出自 7 页全量 loop。建议把度量的描述和 7-scenario 构建 loop 分开,例如「200+ runs 的构建 loop」与「3 个 scenario 的配对度量(91→39 -57%)」分别表述,以符合正文强调的诚实度量。</violation>
</file>

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

@@ -0,0 +1,117 @@
---
title: Vercel design.md:把设计规范做成 eval 驱动的三层系统
description: Vercel《How our agents build on-brand pages with design.md》完整深读——第一次尝试失败的原因(描述性语言没约束力、公开 prompt 丢了环境上下文)、7 个冻结 scenario 的 eval loop(200+ runs、91→39 失败 -57% 的诚实度量)、三层形态(design.md 判断力层/公开 stylesheet 机制层/deterministic check 机械层)、修正归置原则、给反模式命名的技巧、@design-agent 长期维护机制,以及 5 步自建配方。

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P3: Description 把 91→39/-57% 度量归进了「7 个冻结 scenario 的 eval loop」,但正文明确该数字来自单独的控制实验,只用了 3 个 desktop scenario(3×2=6 页),caveat ② 也写「6 页样本太小」。这个括号会让人误读为 -57% 出自 7 页全量 loop。建议把度量的描述和 7-scenario 构建 loop 分开,例如「200+ runs 的构建 loop」与「3 个 scenario 的配对度量(91→39 -57%)」分别表述,以符合正文强调的诚实度量。

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/content/notes/0926-vercel-design-md.md, line 3:

<comment>Description 把 91→39/-57% 度量归进了「7 个冻结 scenario 的 eval loop」,但正文明确该数字来自单独的控制实验,只用了 3 个 desktop scenario(3×2=6 页),caveat ② 也写「6 页样本太小」。这个括号会让人误读为 -57% 出自 7 页全量 loop。建议把度量的描述和 7-scenario 构建 loop 分开,例如「200+ runs 的构建 loop」与「3 个 scenario 的配对度量(91→39 -57%)」分别表述,以符合正文强调的诚实度量。</comment>

<file context>
@@ -1,8 +1,8 @@
 ---
 title: Vercel design.md:把设计规范做成 eval 驱动的三层系统
-description: Vercel《How our agents build on-brand pages with design.md》深读——第一次尝试失败的原因(描述性语言没约束力)、最终三层形态(design.md 判断力层/公开 stylesheet 机制层/deterministic check)、冻结 scenario 的 eval loop(91→39 失败,-57%)、给反模式命名的技巧与长期维护机制。
+description: Vercel《How our agents build on-brand pages with design.md》完整深读——第一次尝试失败的原因(描述性语言没约束力、公开 prompt 丢了环境上下文)、7 个冻结 scenario 的 eval loop(200+ runs、91→39 失败 -57% 的诚实度量)、三层形态(design.md 判断力层/公开 stylesheet 机制层/deterministic check 机械层)、修正归置原则、给反模式命名的技巧、@design-agent 长期维护机制,以及 5 步自建配方。
 date: 2026-09-02
-updatedDate: 2026-09-02
</file context>
Suggested change
description: Vercel《How our agents build on-brand pages with design.md》完整深读——第一次尝试失败的原因(描述性语言没约束力、公开 prompt 丢了环境上下文)、7 个冻结 scenario 的 eval loop(200+ runs91→39 失败 -57% 的诚实度量)、三层形态(design.md 判断力层/公开 stylesheet 机制层/deterministic check 机械层)、修正归置原则、给反模式命名的技巧、@design-agent 长期维护机制,以及 5 步自建配方。
description: Vercel《How our agents build on-brand pages with design.md》完整深读——第一次尝试失败的原因(描述性语言没约束力、公开 prompt 丢了环境上下文)、7 个冻结 scenario 的 eval 构建 loop(200+ runs)、3 个 scenario 的配对度量(91→39 失败 -57% 的诚实度量)、三层形态(design.md 判断力层/公开 stylesheet 机制层/deterministic check 机械层)、修正归置原则、给反模式命名的技巧、@design-agent 长期维护机制,以及 5 步自建配方。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant