Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance: CosId vs Leaf #22

Open
Ahoo-Wang opened this issue Jan 15, 2022 · 1 comment · Fixed by #23
Open

Performance: CosId vs Leaf #22

Ahoo-Wang opened this issue Jan 15, 2022 · 1 comment · Fixed by #23
Assignees
Labels
benchmark documentation Improvements or additions to documentation

Comments

@Ahoo-Wang
Copy link
Owner

Ahoo-Wang commented Jan 15, 2022

CosId-VS-Leaf

https://cosid.ahoo.me/guide/Performance-CosId-Leaf.html

Describe the solution you'd like

Add benchmark comparison between cosid and leaf. and add to workflows.

https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#supported-runners-and-hardware-resources


Due to the resource constraints of GitHub runner, the benchmark running in GitHub runner is very different from the benchmark in the real environment (nearly twice),
However, it is still valuable to compare the benchmark before and after commit and the third-party library when running in the same environment and configuring resources (both running in GitHub runner).


因受到 GitHub Runner 资源限制,运行在 GitHub Runner 中的基准测试与真实环境基准测试对比有非常大的差距(近2倍),
但是对于运行在同一环境配置资源情况下(都运行在 GitHub Runner),进行 commit 前后的基准对比、以及第三方库的对比依然是有价值的。

@Ahoo-Wang
Copy link
Owner Author

Ahoo-Wang commented Jan 15, 2022

因受到 GitHub Runner 资源限制,运行在 GitHub Runner 中的基准测试与真实环境基准测试对比有非常大的差距(近2倍),
但是对于运行在同一环境配置资源情况下(都运行在 GitHub Runner),进行 commit 前后的基准对比、以及第三方库的对比依然是有价值的。

https://github.com/Ahoo-Wang/CosId/actions/workflows/benchmark-vs-test.yml

https://github.com/Ahoo-Wang/CosId/runs/4824055595?check_suite_focus=true

image

@Ahoo-Wang Ahoo-Wang pinned this issue May 25, 2022
@Ahoo-Wang Ahoo-Wang changed the title Add benchmark comparison between cosid and leaf Performance: CosId vs Leaf Aug 16, 2022
@Ahoo-Wang Ahoo-Wang added the documentation Improvements or additions to documentation label Aug 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmark documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant