Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide "meta" statistics #56

Open
PragTob opened this issue Dec 18, 2016 · 5 comments
Open

Provide "meta" statistics #56

PragTob opened this issue Dec 18, 2016 · 5 comments

Comments

@PragTob
Copy link
Member

PragTob commented Dec 18, 2016

For different use cases, like bencheeorg/benchee_html#10 it'd be great to have statistics about statistics - what I'd call "meta statistics" - although there's probably some better real statistics name for this :)

What should be in there (that I know of so far):

  • job size (how many jobs are in there)
  • minimum of run times over all jobs
  • maximum of run times over all jobs

This should be added as a new key to the benchmarking suite (:meta_statistics) - it could be added within the statistics module but might be better off as a separate MetaStatistics step that is computed after general statistics have been computed.

@elpikel
Copy link
Contributor

elpikel commented Aug 21, 2017

Can i take this one?

@PragTob
Copy link
Member Author

PragTob commented Aug 21, 2017

Hmm probably :) I fell like I might need to clarify some things before that, also because they are not completely clear in my head (as in, some of them should be scoped by input I believe). Will get back to that later, please ping me if I don't :)

@elpikel
Copy link
Contributor

elpikel commented Aug 21, 2017

Is there anything else that i can help you with?

@PragTob
Copy link
Member Author

PragTob commented Aug 21, 2017

@elpikel lots of stuff :D I don't have the mind to fully refine this one atm but here's a couple that I think are good points:

@elpikel
Copy link
Contributor

elpikel commented Aug 22, 2017

Great, I will pick one issue form this list then. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants