Skip to content

Commit

Permalink
chore(ci): Fix benchmark action (#6596)
Browse files Browse the repository at this point in the history
**Description:**

It's broken due to the 6-hour time limit of GitHub actions. To fix it, this PR changes the machine type to `ubuntu-large`.
  • Loading branch information
kdy1 committed Dec 8, 2022
1 parent 96f9858 commit 154c315
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions .github/workflows/bench.yml
Expand Up @@ -2,7 +2,7 @@ name: Benchmark

on:
pull_request:
types: ['opened', 'reopened', 'synchronize']
types: ["opened", "reopened", "synchronize"]
push:
branches:
- main
Expand Down Expand Up @@ -43,8 +43,8 @@ jobs:
benchmark:
name: Performance regression check
if: >-
${{ !contains(github.event.head_commit.message, 'chore: ') && github.repository_owner == 'swc-project' }}
runs-on: macos-latest
${{ !contains(github.event.head_commit.message, 'chore: ') && github.repository_owner == 'swc-project' && github.ref == 'refs/heads/main' }}
runs-on: ubuntu-large
steps:
- uses: actions/checkout@v3

Expand Down Expand Up @@ -77,7 +77,7 @@ jobs:
yarn
- name: Run benchmark
run: cargo bench --workspace --exclude swc_plugin --features plugin_transform_schema_vtest --features rkyv-impl -- --output-format bencher | tee output.txt
run: cargo bench --workspace --exclude swc_plugin --features plugin_transform_schema_vtest --features rkyv-impl -- --output-format bencher --sample-size 10 | tee output.txt

- name: Download previous benchmark results
run: mkdir raw-data && curl -o raw-data/benchmark-data.json https://raw.githubusercontent.com/swc-project/raw-data/gh-pages/benchmark-data.json
Expand Down

1 comment on commit 154c315

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark

Benchmark suite Current: 154c315 Previous: 4171ee7 Ratio
es/full/bugs-1 286022 ns/iter (± 10667) 336798 ns/iter (± 20258) 0.85
es/full/minify/libraries/antd 1641000858 ns/iter (± 51331238) 1979244445 ns/iter (± 32731422) 0.83
es/full/minify/libraries/d3 316833511 ns/iter (± 8944142) 441050852 ns/iter (± 36751316) 0.72
es/full/minify/libraries/echarts 1313882269 ns/iter (± 35108595) 1691244150 ns/iter (± 21566726) 0.78
es/full/minify/libraries/jquery 97267549 ns/iter (± 1936003) 110625467 ns/iter (± 6192093) 0.88
es/full/minify/libraries/lodash 110739346 ns/iter (± 4393294) 148604464 ns/iter (± 6984087) 0.75
es/full/minify/libraries/moment 54846242 ns/iter (± 1110226) 68967045 ns/iter (± 2838852) 0.80
es/full/minify/libraries/react 20307733 ns/iter (± 292829) 24909023 ns/iter (± 1416138) 0.82
es/full/minify/libraries/terser 248341339 ns/iter (± 4492197) 334644360 ns/iter (± 15112694) 0.74
es/full/minify/libraries/three 422954956 ns/iter (± 7831722) 590625615 ns/iter (± 48439705) 0.72
es/full/minify/libraries/typescript 3118985789 ns/iter (± 42237942) 3647470583 ns/iter (± 107938311) 0.86
es/full/minify/libraries/victory 644756074 ns/iter (± 19071288) 884222184 ns/iter (± 7439259) 0.73
es/full/minify/libraries/vue 130663694 ns/iter (± 1666169) 169079020 ns/iter (± 1972068) 0.77
es/full/codegen/es3 26456 ns/iter (± 445) 33561 ns/iter (± 798) 0.79
es/full/codegen/es5 26740 ns/iter (± 249) 33586 ns/iter (± 359) 0.80
es/full/codegen/es2015 26890 ns/iter (± 259) 33446 ns/iter (± 834) 0.80
es/full/codegen/es2016 26606 ns/iter (± 289) 32530 ns/iter (± 1056) 0.82
es/full/codegen/es2017 26700 ns/iter (± 186) 32541 ns/iter (± 1350) 0.82
es/full/codegen/es2018 26766 ns/iter (± 306) 32608 ns/iter (± 2256) 0.82
es/full/codegen/es2019 26300 ns/iter (± 360) 33829 ns/iter (± 1863) 0.78
es/full/codegen/es2020 26805 ns/iter (± 346) 33585 ns/iter (± 380) 0.80
es/full/all/es3 173335145 ns/iter (± 2672460) 190864663 ns/iter (± 13137513) 0.91
es/full/all/es5 164247488 ns/iter (± 1038343) 200431005 ns/iter (± 14443854) 0.82
es/full/all/es2015 119697702 ns/iter (± 3868801) 143161982 ns/iter (± 7932913) 0.84
es/full/all/es2016 119195849 ns/iter (± 959577) 144154002 ns/iter (± 8232965) 0.83
es/full/all/es2017 119054832 ns/iter (± 3906539) 142668171 ns/iter (± 9852198) 0.83
es/full/all/es2018 115906100 ns/iter (± 2353957) 142171950 ns/iter (± 8384596) 0.82
es/full/all/es2019 116392271 ns/iter (± 2899475) 141841723 ns/iter (± 5095403) 0.82
es/full/all/es2020 112670016 ns/iter (± 981171) 133997793 ns/iter (± 5680926) 0.84
es/full/parser 504150 ns/iter (± 10016) 695141 ns/iter (± 18698) 0.73
es/full/base/fixer 21661 ns/iter (± 351) 25090 ns/iter (± 791) 0.86
es/full/base/resolver_and_hygiene 76487 ns/iter (± 939) 88326 ns/iter (± 3486) 0.87
serialization of ast node 137 ns/iter (± 1) 215 ns/iter (± 9) 0.64
serialization of serde 119 ns/iter (± 1) 222 ns/iter (± 9) 0.54
css/minify/libraries/bootstrap 26841146 ns/iter (± 211507)
css/visitor/compare/clone 2251915 ns/iter (± 17993)
css/visitor/compare/visit_mut_span 2415305 ns/iter (± 22205)
css/visitor/compare/visit_mut_span_panic 2477081 ns/iter (± 19021)
css/visitor/compare/fold_span 3434990 ns/iter (± 12753)
css/visitor/compare/fold_span_panic 3500685 ns/iter (± 41096)
css/lexer/bootstrap_5_1_3 5205945 ns/iter (± 55805)
css/lexer/foundation_6_7_4 4332995 ns/iter (± 52724)
css/lexer/tailwind_3_1_1 818347 ns/iter (± 7134)
css/parser/bootstrap_5_1_3 20384409 ns/iter (± 287686)
css/parser/foundation_6_7_4 16251342 ns/iter (± 166645)
css/parser/tailwind_3_1_1 3112249 ns/iter (± 26323)
es/codegen/colors 322484 ns/iter (± 179164)
es/codegen/large 1191636 ns/iter (± 617614)
es/codegen/with-parser/colors 44244 ns/iter (± 882)
es/codegen/with-parser/large 502515 ns/iter (± 5914)
es/minify/libraries/antd 1396287371 ns/iter (± 25580378)
es/minify/libraries/d3 258944238 ns/iter (± 6034841)
es/minify/libraries/echarts 1098626026 ns/iter (± 23484016)
es/minify/libraries/jquery 83850928 ns/iter (± 1304391)
es/minify/libraries/lodash 96998183 ns/iter (± 2320672)
es/minify/libraries/moment 46543412 ns/iter (± 847869)
es/minify/libraries/react 17906176 ns/iter (± 487025)
es/minify/libraries/terser 204776458 ns/iter (± 6139509)
es/minify/libraries/three 344443197 ns/iter (± 4670482)
es/minify/libraries/typescript 2651342497 ns/iter (± 20147659)
es/minify/libraries/victory 540044090 ns/iter (± 14224036)
es/minify/libraries/vue 114909949 ns/iter (± 1587006)
es/visitor/compare/clone 2325175 ns/iter (± 24594)
es/visitor/compare/visit_mut_span 2762762 ns/iter (± 22967)
es/visitor/compare/visit_mut_span_panic 2769392 ns/iter (± 25765)
es/visitor/compare/fold_span 3840016 ns/iter (± 39545)
es/visitor/compare/fold_span_panic 3992121 ns/iter (± 52630)
es/lexer/colors 17014 ns/iter (± 271)
es/lexer/angular 8037290 ns/iter (± 55735)
es/lexer/backbone 1051194 ns/iter (± 13619)
es/lexer/jquery 5910156 ns/iter (± 16895)
es/lexer/jquery mobile 8995402 ns/iter (± 106633)
es/lexer/mootools 4571413 ns/iter (± 49442)
es/lexer/underscore 871636 ns/iter (± 10606)
es/lexer/three 27161791 ns/iter (± 212666)
es/lexer/yui 4974095 ns/iter (± 40599)
es/parser/colors 29837 ns/iter (± 480)
es/parser/angular 15553596 ns/iter (± 200717)
es/parser/backbone 2270784 ns/iter (± 19960)
es/parser/jquery 11911068 ns/iter (± 161700)
es/parser/jquery mobile 18832317 ns/iter (± 162068)
es/parser/mootools 9216664 ns/iter (± 98723)
es/parser/underscore 1895236 ns/iter (± 40567)
es/parser/three 54767212 ns/iter (± 1214289)
es/parser/yui 9448172 ns/iter (± 168556)
es/preset-env/usage/builtin_type 141372 ns/iter (± 30987)
es/preset-env/usage/property 21331 ns/iter (± 177)
es/resolver/typescript 114929408 ns/iter (± 2462984)
es/fixer/typescript 96439115 ns/iter (± 3231729)
es/hygiene/typescript 191892567 ns/iter (± 2792233)
es/resolver_with_hygiene/typescript 320824488 ns/iter (± 4212143)
es/visitor/base-perf/module_clone 74219 ns/iter (± 1601)
es/visitor/base-perf/fold_empty 84749 ns/iter (± 579)
es/visitor/base-perf/fold_noop_impl_all 85020 ns/iter (± 1344)
es/visitor/base-perf/fold_noop_impl_vec 84461 ns/iter (± 1616)
es/visitor/base-perf/boxing_boxed_clone 53 ns/iter (± 0)
es/visitor/base-perf/boxing_unboxed_clone 57 ns/iter (± 0)
es/visitor/base-perf/boxing_boxed 97 ns/iter (± 1)
es/visitor/base-perf/boxing_unboxed 100 ns/iter (± 0)
es/visitor/base-perf/visit_contains_this 3414 ns/iter (± 90)
es/base/parallel/resolver/typescript 9652601927 ns/iter (± 279210005)
es/base/parallel/hygiene/typescript 1275392704 ns/iter (± 26681323)
misc/visitors/time-complexity/time 5 95 ns/iter (± 1)
misc/visitors/time-complexity/time 10 333 ns/iter (± 4)
misc/visitors/time-complexity/time 15 649 ns/iter (± 10)
misc/visitors/time-complexity/time 20 1199 ns/iter (± 8)
misc/visitors/time-complexity/time 40 6038 ns/iter (± 92)
misc/visitors/time-complexity/time 60 15091 ns/iter (± 110)
es/full-target/es2016 183114 ns/iter (± 1663)
es/full-target/es2017 178637 ns/iter (± 1233)
es/full-target/es2018 167913 ns/iter (± 2339)
es2020_nullish_coalescing 65244 ns/iter (± 811)
es2020_optional_chaining 92611 ns/iter (± 869)
es2022_class_properties 90783 ns/iter (± 1065)
es2018_object_rest_spread 68813 ns/iter (± 819)
es2019_optional_catch_binding 58614 ns/iter (± 1036)
es2017_async_to_generator 59793 ns/iter (± 688)
es2016_exponentiation 63692 ns/iter (± 478)
es2015_arrow 69135 ns/iter (± 581)
es2015_block_scoped_fn 64387 ns/iter (± 701)
es2015_block_scoping 151386 ns/iter (± 7590)
es2015_classes 112806 ns/iter (± 518)
es2015_computed_props 58157 ns/iter (± 246)
es2015_destructuring 113887 ns/iter (± 1983)
es2015_duplicate_keys 61901 ns/iter (± 693)
es2015_parameters 77804 ns/iter (± 833)
es2015_fn_name 63905 ns/iter (± 649)
es2015_for_of 61534 ns/iter (± 660)
es2015_instanceof 60047 ns/iter (± 1147)
es2015_shorthand_property 58702 ns/iter (± 694)
es2015_spread 58260 ns/iter (± 383)
es2015_sticky_regex 59834 ns/iter (± 685)
es2015_typeof_symbol 60227 ns/iter (± 618)
es/transform/baseline/base 49404 ns/iter (± 426)
es/transform/baseline/common_reserved_word 59073 ns/iter (± 231)
es/transform/baseline/common_typescript 161842 ns/iter (± 1562)
es/target/es3 161492 ns/iter (± 1843)
es/target/es2015 607099 ns/iter (± 6809)
es/target/es2016 61861 ns/iter (± 486)
es/target/es2017 58832 ns/iter (± 768)
es/target/es2018 77622 ns/iter (± 656)
es/target/es2020 127909 ns/iter (± 1387)
babelify-only 653981 ns/iter (± 5416)
parse_and_babelify_angular 37029063 ns/iter (± 1100647)
parse_and_babelify_backbone 5452927 ns/iter (± 90354)
parse_and_babelify_jquery 29961998 ns/iter (± 317443)
parse_and_babelify_jquery_mobile 50682430 ns/iter (± 1097564)
parse_and_babelify_mootools 33096317 ns/iter (± 929290)
parse_and_babelify_underscore 4416501 ns/iter (± 32702)
parse_and_babelify_yui 31965340 ns/iter (± 1747127)
html/minify/document/css_spec 41807403 ns/iter (± 413851)
html/minify/document/github 18072645 ns/iter (± 265652)
html/minify/document/stackoverflow 15891569 ns/iter (± 161944)
html/minify/document_fragment/css_spec 39418922 ns/iter (± 525231)
html/minify/document_fragment/github 17243361 ns/iter (± 125515)
html/minify/document_fragment/stackoverflow 15499757 ns/iter (± 259034)
html/document/visitor/compare/clone 333339 ns/iter (± 3260)
html/document/visitor/compare/visit_mut_span 363311 ns/iter (± 5147)
html/document/visitor/compare/visit_mut_span_panic 369189 ns/iter (± 4648)
html/document/visitor/compare/fold_span 399452 ns/iter (± 3971)
html/document/visitor/compare/fold_span_panic 453910 ns/iter (± 4578)
html/document_fragment/visitor/compare/clone 334992 ns/iter (± 4943)
html/document_fragment/visitor/compare/visit_mut_span 361635 ns/iter (± 3695)
html/document_fragment/visitor/compare/visit_mut_span_panic 366226 ns/iter (± 3610)
html/document_fragment/visitor/compare/fold_span 390833 ns/iter (± 4105)
html/document_fragment/visitor/compare/fold_span_panic 451898 ns/iter (± 5979)
html/lexer/css_2021_spec 14907315 ns/iter (± 154477)
html/lexer/github_com_17_05_2022 5833484 ns/iter (± 58956)
html/lexer/stackoverflow_com_17_05_2022 5433251 ns/iter (± 56163)
html/parser/parser_document/css_2021_spec 24595013 ns/iter (± 251322)
html/parser/parser_document/github_com_17_05_2022 8610122 ns/iter (± 130877)
html/parser/parser_document/stackoverflow_com_17_05_2022 7620787 ns/iter (± 90767)
html/parser/parser_document_fragment/css_2021_spec 24489265 ns/iter (± 200037)
html/parser/parser_document_fragment/github_com_17_05_2022 8441024 ns/iter (± 56844)
html/parser/parser_document_fragment/stackoverflow_com_17_05_2022 7593462 ns/iter (± 106942)

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.