Skip to content

Relight 0.1.0: the live picture lit again by colored lamps that sweep over it, its depth map the shapes they light and shadow, as real-time renderers light a scene - #29

Merged
kevinraymond merged 1 commit into
mainfrom
relight-0.1.0
Oct 29, 2026
Merged

kevinraymond merged 1 commit into
mainfrom
relight-0.1.0

Conversation

@kevinraymond

Copy link
Copy Markdown
Owner

Relight lights the live picture again with colored lamps that sweep
over it, its shape from a depth map on input 3 (board #4677).

  • The shape: the depth as a height field at half size, Relief high,
    rounded inward by Roundness (a triangle average) and held to the
    depth at its edges, so a figure is a cliff over its backdrop. A
    slope of a few pixels down to a wall meters behind shadowed itself
    into a black outline. Normals take each slope toward the neighbor
    nearer in height, so the backdrop beside a figure keeps its own
    sheen. Without input 3 the picture's brighter parts bulge against
    their broad average, never sinking (that dug a moat).
  • The light: four looks (Stage, Studio, Sun with a blue sky, Two
    Tone), lamps on slow Lissajous paths hung above the relief's top,
    Lambert diffuse with falloff, GGX highlights, shadows marched over
    the height field at a quarter size, ambient occlusion after Luft et
    al. with a range check (without it every figure wore a black halo),
    light scattered under the surface (one Gaussian a color, red widest,
    after Jimenez et al.) and glowing through thin parts.
  • The picture's own light: Flatten divides its bright parts toward
    its average by the lower of its blurred and its own brightness, and
    never lifts the darks (lifting turned smoke and compression blocks
    into contours).
  • Music: each beat flares the lights through the flash gate, fading
    over 0.6 s (over 0.35 s, Up to 3 per second measured 3.5);
    loudness brightens them.
  • Flashing: Off adds nothing to any clip's own (seven clips, every
    look, the corners), Calm at most a flash a second, Up to 3 per
    second reaches WCAG's 3 on the dancer at 140 BPM and no further;
    red 0 everywhere through the red guard.
  • 4.6 ms GPU (95th percentile 5.6) and 0.5 ms CPU a frame at
    1280 x 720 on the M2 Pro, the shadows' march the largest part;
    nothing cooks while unused (0 of 259).
  • Patents: clear by design, three changes made after the search.
    Canon's US 11,948,282 and 11,106,938 claim shading a region found
    in the picture by its normals: nothing is found or set apart, so
    skin isn't found by color and light scatters and glows everywhere.
    Adobe's US 8,379,021 claims shadows by the point of maximum
    elevation: a shadow multiplies its samples' light let through.
    NVIDIA's US 8,064,726 claims rendering with a sum of Gaussians:
    the broad smoothings are triangle filters
    (private/patents/relight.md; board #4805 asks whether other
    effects need checking against the last one).

Also: Showreel 0.1.27 with twenty-six effects (idle 0 of 7553, Cycle
3.9 ms GPU, flash within each setting), the README row, status
(Caustics and Temporal Resonator listed as 0.1.1, which PR #28
missed) and hero (2, eight rows of three, two), and BUILDING.md
gains two TouchDesigner findings: a TOP's GPU time can carry another
operator's, and the Blur TOP's filter types.

… over it, its depth map the shapes they light and shadow, as real-time renderers light a scene

Relight lights the live picture again with colored lamps that sweep
over it, its shape from a depth map on input 3 (board #4677).

- The shape: the depth as a height field at half size, Relief high,
  rounded inward by Roundness (a triangle average) and held to the
  depth at its edges, so a figure is a cliff over its backdrop. A
  slope of a few pixels down to a wall meters behind shadowed itself
  into a black outline. Normals take each slope toward the neighbor
  nearer in height, so the backdrop beside a figure keeps its own
  sheen. Without input 3 the picture's brighter parts bulge against
  their broad average, never sinking (that dug a moat).
- The light: four looks (Stage, Studio, Sun with a blue sky, Two
  Tone), lamps on slow Lissajous paths hung above the relief's top,
  Lambert diffuse with falloff, GGX highlights, shadows marched over
  the height field at a quarter size, ambient occlusion after Luft et
  al. with a range check (without it every figure wore a black halo),
  light scattered under the surface (one Gaussian a color, red widest,
  after Jimenez et al.) and glowing through thin parts.
- The picture's own light: Flatten divides its bright parts toward
  its average by the lower of its blurred and its own brightness, and
  never lifts the darks (lifting turned smoke and compression blocks
  into contours).
- Music: each beat flares the lights through the flash gate, fading
  over 0.6 s (over 0.35 s, Up to 3 per second measured 3.5);
  loudness brightens them.
- Flashing: Off adds nothing to any clip's own (seven clips, every
  look, the corners), Calm at most a flash a second, Up to 3 per
  second reaches WCAG's 3 on the dancer at 140 BPM and no further;
  red 0 everywhere through the red guard.
- 4.6 ms GPU (95th percentile 5.6) and 0.5 ms CPU a frame at
  1280 x 720 on the M2 Pro, the shadows' march the largest part;
  nothing cooks while unused (0 of 259).
- Patents: clear by design, three changes made after the search.
  Canon's US 11,948,282 and 11,106,938 claim shading a region found
  in the picture by its normals: nothing is found or set apart, so
  skin isn't found by color and light scatters and glows everywhere.
  Adobe's US 8,379,021 claims shadows by the point of maximum
  elevation: a shadow multiplies its samples' light let through.
  NVIDIA's US 8,064,726 claims rendering with a sum of Gaussians:
  the broad smoothings are triangle filters
  (private/patents/relight.md; board #4805 asks whether other
  effects need checking against the last one).

Also: Showreel 0.1.27 with twenty-six effects (idle 0 of 7553, Cycle
3.9 ms GPU, flash within each setting), the README row, status
(Caustics and Temporal Resonator listed as 0.1.1, which PR #28
missed) and hero (2, eight rows of three, two), and BUILDING.md
gains two TouchDesigner findings: a TOP's GPU time can carry another
operator's, and the Blur TOP's filter types.
@kevinraymond
kevinraymond merged commit 8d90af6 into main Oct 29, 2026
1 check passed
@kevinraymond
kevinraymond deleted the relight-0.1.0 branch October 29, 2026 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant