Skip to content

Temporal Resonator 0.1.0: every pixel of the live picture a plucked string tuned to the beat, so whatever moves comes round again on the next beats, fainter and softer each time - #25

Merged
kevinraymond merged 1 commit into
mainfrom
temporal-resonator-0.1.0
Oct 29, 2026
Merged

kevinraymond merged 1 commit into
mainfrom
temporal-resonator-0.1.0

Conversation

@kevinraymond

Copy link
Copy Markdown
Owner

Temporal Resonator gives every pixel a plucked string one beat long,
after Karplus and Strong (1983) with Jaffe and Smith's extensions
(board #4717). Whatever moves plucks the strings it crosses, and a beat
later the movement comes round again, then again, each echo fainter and
softer than the last. A dancer's arms fan out in echoes a beat apart,
and walkers on a plaza leave dotted chains of footsteps.

  • The strings carry what differs from the background, a running
    approximate median (McFarlane and Schofield), so someone walking
    through leaves no trace. A running average kept the subject in it and
    her echoes came back as dark copies (dev/protos/temporal_resonator).
  • The loop averages three moments around a beat back (1, 2, 1) and a
    few pixels around each, so each trip round softens the echo, as a
    string loses its highs first. Sustain sets the gain (a tenth after
    that many beats); Alternating makes it negative, so every other echo
    comes back as a shadow.
  • The echoes go behind whatever stands out now. A depth map or mask on
    input 3 (lib depth_find at an eighth size) keeps a subject that
    dances in place in front, where the median had absorbed her and her
    own echoes smudged her clothes.
  • The delay line: the strings' state goes into a Texture 3D ring a cook
    late through a Feedback TOP, with a stamped ring beside it; taps finds
    the slots a beat back by their times, so a dropped frame or a pause
    never replays the wrong moment.
  • Music: Plucks On Beats rise over a tenth of a beat and fall to half
    by the next; Always plucks evenly. The strings are a beat long from
    the new beat_period, gliding when the tempo changes.
  • Flashing: no setting, held to Off's rule. Each echo softens faster
    than the first draft's, plucks never fall to nothing (the flowers
    pulsed whole at the beat), Always plucks at On Beats' average, and
    every pixel goes through the red guard (guarding only where echoes
    showed flipped reds more). Every clip and common setting measures its
    clip's own count; the far corners reach 2.0 to 2.5.
  • 1.6 ms GPU (95th percentile 1.75) and 0.44 ms CPU a frame at
    1280 x 720 on the M2 Pro; 161 MB of GPU memory at 1 Beat (100 at 1/2,
    285 at 2); nothing cooks while unused (0 of 233).
  • Patents clear: Karplus and Strong's US 4,649,783 expired; GoPro's
    active US 11,190,726 and 11,689,692 claim looping a video highlight to
    music, which this never does (private/patents/temporal_resonator.md).

Also: lib audio_in() gains beat_period (Fosfora's bpm, raw audio's beat
clock, else the gaps between beats; a self-test case per input), so
every effect is rebuilt with no version bump and structure_diff shows
only its audio callbacks changed. The self-test's flash gate check now
times its window by the clock: 360 frames took 6.25 s and Calm rightly
passed 7. Showreel 0.1.24 with twenty-four effects (idle 0 of 7067,
Cycle 4.4 ms GPU, flash within each setting), the README row, status
and hero (2, then eight rows of three, quality 100), and BUILDING.md
gains the effect's flash traps and the ring-of-own-outputs pattern.

…tring tuned to the beat, so whatever moves comes round again on the next beats, fainter and softer each time

Karplus and Strong's plucked string per pixel, one beat long, plucked by
what differs from a running-median background, its echoes shown behind
the live subject. lib audio_in() gains beat_period (every effect rebuilt,
only its audio callbacks changed); Showreel 0.1.24 with twenty-four
effects; the self-test's flash gate check times its window by the clock.
@kevinraymond
kevinraymond merged commit be4507c into main Oct 29, 2026
1 check passed
@kevinraymond
kevinraymond deleted the temporal-resonator-0.1.0 branch October 29, 2026 08:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant