Able to see all the nightly run benchmarks

[harshit-gangal]

Currently only the last run is seen on the Macro page.
Need an option to compare with all the benchmark run properly tagged
can be show as
main..

if there is a performance regression we would be able to know when that happened.

[Gmin2]

Hey @harshit-gangal is this issue still valid ?

[frouioui]

It is still valid. Let me extend a bit more on this issue. Generally speaking, what is missing right now in arewefastyet is the ability to see what benchmarks ran. We can see all the different execution thanks to the status page, but that only tell us what was executed. If instead, we had a page that shows all the available benchmarks. We could have a filter per "source" (main, v19.0.3, release-19.0, v17.0.1, etc the list is long) and see a table sorted by execution time that shows all the commits that were benchmark. We could click on a commit and then it would show the workloads that were benchmarked (OLTP, TPCC, TPCC_FK, ...) and show the number of execution for this benchmark. Per commit we should have a link that allows us to see the results for that specific commit too.