[roadmap] RL-Insight Q2 Roadmap

[tardis-key]

Online Monitor

RL-Insight Online Monitoring System #46

• experimental feature @mengchengTang [pipeline] feat: rl insight support online monitor #53
  • fix: distinguish inference metrics by rank
  • develop guidance
• high concurrency testing
• application in verl
  • Basic migration & key function records
  • rollout trace records Support more fine-grained state monitoring on Rollout phase #45
  • time consumption and performance records on ckpt engine & tq support time-consuming monitoring on cpkt engine and tq. #44
  • hardware metric monitor
  • valuable training metric in verl
  • gateway adaptation
• Different collector backend support
  • BaseCollector abstration
  • Other high-concurrency backend supports @FightingZhen
• Different Visualization Service-Oriented Platform support
  • mlflow

Offline Feature

Expert Load Visualization Based on Dump/Profiling Data #25

[RFC] Memory Analysis Feature #42

• Parse memory trace data collected by MSTX/torch
  • Add memory data checker
  • Add memory parser [parser] feat: add memory parser #54
  • Refactor memory parser and msxt parser
• Support memory visualization (generate a html file)
  • Supports plotting memory histograms (line charts)
  • Supports plotting memory Gantt charts
  • Supports displaying memory detail information

[mengchengTang]

hardware metric monitor
verl trainer metric
infer engine metric relation to replica rank
develop guidance

[tardis-key]

hardware metric monitor verl trainer metric infer engine metric relation to replica rank develop guidance

updated

[tifning]

gateway adaptation