Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/perf testing #728

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Conversation

GAlexIHU
Copy link
Contributor

@GAlexIHU GAlexIHU commented Mar 24, 2024

Overview

Adds comparative performance tests for using projections versus materialized views & for baselining raw query execution compared to OpenMeter performance.

Based on the results projections have around 2-3x worse performance compared to using materialized views. The sample tests were run on 1M events with the default configuration in perf/configs.
Sample screenshots of the test runs:
Screenshot 2024-03-24 at 22 11 35
(see MATERIALISED & PROJECTION lines)
Screenshot 2024-03-24 at 22 16 46
(see CLICKHOUSE & OPENMETER lines)

For running the tests for yourself check docs/perftest.md and perf/k6/README.md

Fixes #700

Notes for reviewer

Still in draft as the dagger automation for perf tests currently hangs.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes

@sagikazarmark sagikazarmark added the release-note/ignore Ignore this change when generating release notes label Mar 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-note/ignore Ignore this change when generating release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Benchmark ClickHouse queries
2 participants