One-click benchmarking

[ramakrishnap-nv]

Single-command benchmarking system.

• Design in 26.08, implement ~26.10
• May partner with other teams

Prior work: none (benchmark plumbing only, e.g. #1399 is skill evals, not the system).

Owner: — · Size: L · Priority: P1

[github-actions]

🔔 Hi @anandhkb @akifcorduk, this issue has had no activity for 21 days. Please update or let us know if it can be closed. Thank you!

If this is an "epic" issue, then please add the "epic" label to this issue.
If it is a PR and not ready for review, then please convert this to draft.
If you just want to switch off this notification, then use the "skip inactivity reminder" label.

[github-actions]

🔔 Hi @anandhkb @akifcorduk, this issue has had no activity for 21 days. Please update or let us know if it can be closed. Thank you!

If this is an "epic" issue, then please add the "epic" label to this issue.
If it is a PR and not ready for review, then please convert this to draft.
If you just want to switch off this notification, then use the "skip inactivity reminder" label.