fix(postprocess): 逐帧补偿一段动作内的单调尺度漂移 - #308
Open
johnnyzhang-eng wants to merge 2 commits into
Open
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub. |
Codecov Report❌ Patch coverage is
📢 Thoughts on this report? Let us know! |
![fennoai[bot]](https://avatars.githubusercontent.com/in/1924301?s=60&v=4){kind=small}
守卫用 len(spans) == len(frames) 判齐,而 spans 已滤掉空帧,于是序列里只要有一帧 量不到本体,整段补偿就被跳过,其余帧静默留着 i2v 的推镜漂移。 空帧只是缺一个观测:改为把 None 一并传给 scale_drift,它按真实帧号拟合、空位系数 取 1.0,其余帧照常补偿。
Contributor
Author
|
P1 成立，已修（2d791f8）。序列里有一帧空的，spans 被滤短，守卫为假，整段补偿被跳过——其余帧静默保留原有漂移。改成对非空帧计算并应用补偿，空帧原样透明输出，补了含空帧序列的用例与变异验证。 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Refs #307
角色在一段动作内单调变大。线上真实产出实测：walk 本体高 137→165（+20.3%），custom 70→158（+126.6%），几乎无回落，是趋势不是噪声。
align_bottom_center按设计整段共用一个缩放系数，而 i2v 会引入推镜／角色走向镜头。统一缩放对整段乘同一个数，趋势原样保留。#280 修的是定标基准被延展物撑大（跨动作口径），与本条不重叠。改法不是逐帧归一——那会把走路自然的身高起伏（约 4%）一起压平，蹲下的帧被放大、伸展的帧被缩小，正是本模块最初拒绝它的原因。新增
scale_drift：对逐帧本体高做一次线性拟合，只除掉趋势项、保留残差；补偿系数以 1.0 为中心，故整段平均尺寸不变，跨动作口径不受影响。首尾变化低于 8% 时不动，免得把真实起伏当漂移消掉。拿线上那两段真实数据验证：walk 修后首尾 −0.1%、残差 1.5%；custom 修后 −3.7%、残差 6.7%。
测试用的是线上产物的真实逐帧数值。变异验证三个方向都被杀死：补偿没接上（这条第一版没覆盖，是变异测试逮出来的，已补端到端用例）、退化成逐帧归一、门槛设为 0 导致过度矫正。