StreamMDX
HomeDocsPerf Quality Changelog
Browse docs

StreamMDX Perf Quality Changelog

This log tracks perf harness snapshots used to make scheduling decisions. Values are p95 unless noted. Paths point to local tmp/ outputs.

2026-01-16 Baseline refresh (naive-bayes + table-large)

Baselines compared:

  • Base:
  • tmp/perf-baselines/naive-bayes-S1_slow_small-2026-01-16T01-23-40-289Z
  • tmp/perf-baselines/naive-bayes-S2_typical-2026-01-16T01-31-45-659Z
  • tmp/perf-baselines/naive-bayes-S4_chunky_network-2026-01-16T01-33-19-667Z
  • tmp/perf-baselines/table-large-S2_typical-2026-01-16T01-34-13-489Z
  • tmp/perf-baselines/table-large-S6_extreme-2026-01-16T01-34-28-484Z
  • Candidate:
  • tmp/perf-baselines/naive-bayes-S1_slow_small-2026-01-16T06-11-35-608Z
  • tmp/perf-baselines/naive-bayes-S2_typical-2026-01-16T06-19-37-644Z
  • tmp/perf-baselines/naive-bayes-S4_chunky_network-2026-01-16T06-21-10-866Z
  • tmp/perf-baselines/table-large-S2_typical-2026-01-16T06-22-16-932Z
  • tmp/perf-baselines/table-large-S6_extreme-2026-01-16T06-22-29-600Z

Summary (p95, base -> candidate):

  • S1_slow_small: duration 113694.70 -> 113677.80 (-0.0%), first flush 373.20 -> 376.10 (+0.8%), longtask 74.00 -> 97.00 (+31.1%), raf delta 16.80 -> 16.80, memory peak 87.45 -> 110.63 (+26.5%).
  • S2_typical: duration 18982.50 -> 18982.60 (0.0%), first flush 258.40 -> 300.20 (+16.2%), longtask n/a -> 64.00, raf delta 16.80 -> 16.80, memory peak 87.45 -> 110.63 (+26.5%).
  • S4_chunky_network: duration 4750.10 -> 4766.30 (+0.3%), first flush 293.00 -> 222.40 (-24.1%), longtask 58.00 -> 75.00 (+29.3%), raf delta 16.80 -> 16.80, memory peak 87.45 -> 110.63 (+26.5%).
  • table-large S2_typical: duration 633.10 -> 633.20 (0.0%), first flush 217.20 -> 225.50 (+3.8%), raf delta 16.80 -> 16.80, memory peak 87.45 -> 110.63 (+26.5%).
  • table-large S6_extreme: duration 66.60 -> 66.50 (-0.2%), raf delta 16.70 -> 16.80 (+0.6%).

Notes:

  • All guardrails were within bounds; S2 first flush regressed +16.2% but stayed below thresholds.
  • Longtask p95 is newly reported for S2 (base was n/a); treat as new visibility rather than a regression.
  • Profiler run (LOCAL_BENCHMARKS): naive-bayes/S2_typical 2026-01-16T06-23-05-474Z actual p95 8.70 ms, base p95 128.40 ms.

2026-01-13 Long-task filtering to stream window

Change:

  • Long-task stats now only consider tasks occurring between runStart and runEnd.
  • This removes page-load noise from perf results and makes stutter attribution more accurate.

Baselines refreshed from:

  • tmp/perf-runs/naive-bayes-S2_typical-2026-01-13T02-40-09-035Z
  • tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-13T02-39-22-647Z

2026-01-09 Aggressive default scheduling

Baseline:

  • tmp/perf-baselines/S2_typical
  • tmp/perf-baselines/S3_fast_reasonable

Candidate (aggressive default):

  • tmp/perf-runs/naive-bayes-S2_typical-2026-01-09T20-33-31-324Z
  • tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-09T20-35-43-534Z

S2_typical vs baseline:

  • duration p95: 19065.10 ms -> 18982.60 ms (-0.4%)
  • first flush p95: 422.30 ms -> 239.30 ms (-43.3%)
  • longtask p95 (run p95s): 597.00 ms -> 404.00 ms (-32.3%)
  • raf delta p95 (run p95s): 16.80 ms -> 16.80 ms (0.0%)
  • memory peak p95: 87.45 MB -> 87.45 MB (0.0%)

S3_fast_reasonable vs baseline:

  • duration p95: 7632.10 ms -> 7627.60 ms (-0.1%)
  • first flush p95: 276.60 ms -> 268.50 ms (-2.9%)
  • longtask p95 (run p95s): 420.00 ms -> 422.00 ms (+0.5%)
  • raf delta p95 (run p95s): 16.80 ms -> 16.80 ms (0.0%)
  • memory peak p95: 87.45 MB -> 87.45 MB (0.0%)

Smooth vs aggressive comparison (3 runs + warmup):

  • smooth S2: tmp/perf-runs/naive-bayes-S2_typical-2026-01-09T20-36-48-998Z
  • smooth S3: tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-09T20-38-18-288Z

S2_typical smooth -> aggressive:

  • first flush p95: 276.20 ms -> 239.30 ms (-13.4%)
  • longtask p95 (run p95s): 433.00 ms -> 404.00 ms (-6.7%)

S3_fast_reasonable smooth -> aggressive:

  • first flush p95: 262.50 ms -> 268.50 ms (+2.3%)
  • longtask p95 (run p95s): 434.00 ms -> 422.00 ms (-2.8%)

2026-01-09 Baseline refresh (aggressive defaults in @stream-mdx/react)

Baselines updated from:

  • tmp/perf-runs/naive-bayes-S2_typical-2026-01-09T23-26-15-474Z
  • tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-09T23-28-41-343Z

Smooth vs aggressive (new baseline) comparison:

  • smooth S2: tmp/perf-runs/naive-bayes-S2_typical-2026-01-09T23-45-11-719Z
  • smooth S3: tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-09T23-46-49-380Z

S2_typical smooth -> aggressive:

  • first flush p95: 541.10 ms -> 335.20 ms (-38.1%)
  • longtask p95 (run p95s): 519.00 ms -> 601.00 ms (+15.8%)
  • raf delta p95 (run p95s): 16.80 ms -> 33.30 ms (+98.2%)

S3_fast_reasonable smooth -> aggressive:

  • first flush p95: 278.30 ms -> 417.40 ms (+50.0%)
  • longtask p95 (run p95s): 477.00 ms -> 525.00 ms (+10.1%)

2026-01-10 Adaptive switch (aggressive -> smooth after first flush)

Candidate runs:

  • tmp/perf-runs/naive-bayes-S2_typical-2026-01-10T00-23-35-054Z
  • tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-10T00-25-49-205Z

S2_typical vs previous baseline:

  • first flush p95: 335.20 ms -> 302.00 ms (-9.9%)
  • longtask p95 (run p95s): 601.00 ms -> 485.00 ms (-19.3%)
  • raf delta p95 (run p95s): 33.30 ms -> 16.80 ms (-49.5%)

S3_fast_reasonable vs previous baseline:

  • first flush p95: 417.40 ms -> 281.50 ms (-32.6%)
  • longtask p95 (run p95s): 525.00 ms -> 454.00 ms (-13.5%)
  • raf delta p95 (run p95s): 33.30 ms -> 16.80 ms (-49.5%)

Baselines refreshed from the candidate runs above.

2026-01-10 Baseline refresh (adaptive switch, 7 runs + warmup)

Baselines updated from:

  • tmp/perf-runs/naive-bayes-S2_typical-2026-01-10T04-19-04-852Z
  • tmp/perf-runs/naive-bayes-S3_fast_reasonable-2026-01-10T04-21-56-247Z
PreviousPerf harnessNextStatus / architecture