[Git][ghc/ghc][wip/junit-diffs] perf notes: include stat deviation and acceptance window in notes so they show up in gitlab
Zubin pushed to branch wip/junit-diffs at Glasgow Haskell Compiler / GHC Commits: b555b20b by Zubin Duggal at 2026-07-08T12:09:23+05:30 perf notes: include stat deviation and acceptance window in notes so they show up in gitlab - - - - - 1 changed file: - testsuite/driver/perf_notes.py Changes: ===================================== testsuite/driver/perf_notes.py ===================================== @@ -653,7 +653,11 @@ def check_stats_change(actual: PerfStat, error = str(change) + ' from ' + baseline.perfStat.test_env + \ ' baseline @ %s' % baseline.commit print(actual.metric, error + ':') - result = failBecause('stat ' + error, tag='stat') + dev = 100.0 if expected_val == 0 else round(((float(actual.value) * 100) / int(expected_val)) - 100, 1) + change_line = (f'{actual.metric} {change.value} from {baseline.perfStat.test_env} ' + f'baseline @ {baseline.commit[:7]}: {expected_val} -> {actual.value} ' + f'({dev:+g}%, allowed {acceptance_window.describe()})') + result = failBecause('stat ' + change_line, tag='stat') if not change_allowed or force_print: length = max(len(str(x)) for x in [expected_val, lowerBound, upperBound, actual.value]) View it on GitLab: https://gitlab.haskell.org/ghc/ghc/-/commit/b555b20bb89ad38e8831810896bd3f74... -- View it on GitLab: https://gitlab.haskell.org/ghc/ghc/-/commit/b555b20bb89ad38e8831810896bd3f74... You're receiving this email because of your account on gitlab.haskell.org.
participants (1)
-
Zubin (@wz1000)