Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

show the cost of dataset building, in dollars #265

Open
yegor256 opened this issue Apr 2, 2024 · 6 comments
Open

show the cost of dataset building, in dollars #265

yegor256 opened this issue Apr 2, 2024 · 6 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@yegor256
Copy link
Owner

yegor256 commented Apr 2, 2024

In report.tex, let's show the cost of dataset building, in dollars. We can use the time and the number of CPUs, and the amount of memory.

@yegor256 yegor256 added enhancement New feature or request help wanted Extra attention is needed labels Apr 2, 2024
@RoukayaZaki
Copy link

I will work on this issue. @yegor256

@timur-harin
Copy link
Contributor

@RoukayaZaki
Could I continue?

@timur-harin
Copy link
Contributor

@yegor256
Please clarify which rate of the cost of capacities can I take? Can it be from AWS or Yandex.Cloud?

@yegor256
Copy link
Owner Author

@timur-harin use AWS, please. Also, please mention it in the text (in the .tex file)

@timur-harin
Copy link
Contributor

@yegor256
Where I can get the amount of memory during build?
I can see only CPU number in report.tex

The dataset was built by
\iexec{nproc}\unskip{}
CPUs\iexec{"${LOCAL}/help/tdiff.sh" "$(cat "${TARGET}/start.txt")"}\unskip{}.

@yegor256
Copy link
Owner Author

@timur-harin maybe you can measure the maximum available RAM when Makefile starts and save this number to some file. Then, later, the TeX document will pick this file up and use it. https://stackoverflow.com/questions/20348007/how-can-i-find-out-the-total-physical-memory-ram-of-my-linux-box-suitable-to-b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants