This repository has been archived by the owner on Dec 21, 2023. It is now read-only.
test: PoC to reduce CI pipeline timings #8465
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: RealAnna <anna.reale@dynatrace.com>
RealAnna
added
the
CI:trigger-build-everything
RealAnna
force-pushed
the
poc/fasten_ci_build
branch
from
da91818
to
5f70798
Compare
Codecov Report
@@ Coverage Diff @@
## master #8465 +/- ##
=======================================
Coverage 66.43% 66.43%
=======================================
Files 612 612
Lines 32362 32362
Branches 1667 1667
=======================================
Hits 21499 21499
Misses 9566 9566
Partials 1297 1297
Flags with carried forward coverage won't be shown. Click here to find out more. |
Signed-off-by: RealAnna <anna.reale@dynatrace.com>
Signed-off-by: RealAnna <anna.reale@dynatrace.com>
RealAnna
force-pushed
the
poc/fasten_ci_build
branch
3 times, most recently
from
b0c8a6b
to
cf08b36
Compare
3 tasks
RealAnna
force-pushed
the
poc/fasten_ci_build
branch
from
cf08b36
to
fb72383
Compare
RealAnna
changed the title
Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try to run test directly Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try to run test directly Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try to run test directly Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try to run test directly Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try to run test directly Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: add back docker container for bridge Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: try Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: document all failing test Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: making build dependant Signed-off-by: RealAnna <anna.reale@dynatrace.com> poc: making build dependant Signed-off-by: RealAnna <anna.reale@dynatrace.com>
RealAnna
force-pushed
the
poc/fasten_ci_build
branch
from
66e0d02
to
6a6ed2b
Compare
|
Kudos, SonarCloud Quality Gate passed!
|
|
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Signed-off-by: RealAnna anna.reale@dynatrace.com
This PR
Attempt to reintroduce docker caching
-uses docker/build-push-action#252 (comment)
Caching in between test and prod builds
Research other projects' workflows to see if there are better approaches to docker builds:
dynatrace-operator does test directly on the runner, not in a container...
They also use helm unit testing!
Try to move together builds and unit test runs to decrease wait time in between each step and decrease job count
Related Issues
Closes #8371
Notes
running test outside docker containers using --race showed multiple errors (mostly data races but one of jmeter test needs jmeter installed and thus fails, we should remove it):
https://github.com/keptn/keptn/runs/7428255474?check_suite_focus=true
Follow-up Tasks
Discuss with the team and make a ticket to merge chosen changes
How to test
Here are CI runs with the 3 setups:
reference CI build everything ~ 24m
adding cache to production images ~ 21m (bridge test took 19m test image build 5m 28s)
merging test and build ~19m
adding cache to test images ~17m (bridge test took 15m test image build 4m 36s )
running test directly on the runner (shippy our bottleneck after bridge took ~1m less)
running also bridge tests as git actions ~ 15m 25s (bridge server now 41 s against ~2m while bridge test 12m 47s against 15m !)