Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add event for swc load failure and attempt patching lockfile #36527

Merged
merged 6 commits into from Apr 28, 2022

Conversation

ijjk
Copy link
Member

@ijjk ijjk commented Apr 27, 2022

This adds an event when we fail to load swc so we can track this better and this also adds an automatic patch for one case that can cause swc to fail to be installed correctly with npm.

When the package-lock.json file is removed and then npm i is run with node_modules present npm will attempt building the lockfile from node_modules which doesn't include all the necessary optionalDependencies so when the same lockfile is used on a different platform it will fail to download the correct swc binary.

In a follow-up PR falling back to the wasm swc binary will be investigated.

x-ref: slack thread
x-ref: slack thread

@ijjk ijjk added created-by: Next.js team PRs by the Next.js team type: next labels Apr 27, 2022
@ijjk
Copy link
Member Author

ijjk commented Apr 27, 2022

Stats from current PR

Default Build (Decrease detected ✓)
General Overall increase ⚠️
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
buildDuration 15.3s 15.2s -101ms
buildDurationCached 6.1s 6s -48ms
nodeModulesSize 481 MB 481 MB ⚠️ +12.8 kB
Page Load Tests Overall decrease ⚠️
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
/ failed reqs 0 0
/ total time (seconds) 3.046 3.065 ⚠️ +0.02
/ avg req/sec 820.73 815.78 ⚠️ -4.95
/error-in-render failed reqs 0 0
/error-in-render total time (seconds) 1.169 1.205 ⚠️ +0.04
/error-in-render avg req/sec 2138.01 2074.11 ⚠️ -63.9
Client Bundles (main, webpack)
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
925.HASH.js gzip 179 B 179 B
framework-HASH.js gzip 42 kB 42 kB
main-HASH.js gzip 28.6 kB 28.6 kB
webpack-HASH.js gzip 1.44 kB 1.44 kB
Overall change 72.3 kB 72.3 kB
Legacy Client Bundles (polyfills)
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
polyfills-HASH.js gzip 31 kB 31 kB
Overall change 31 kB 31 kB
Client Pages
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
_app-HASH.js gzip 1.36 kB 1.36 kB
_error-HASH.js gzip 193 B 193 B
amp-HASH.js gzip 308 B 308 B
css-HASH.js gzip 327 B 327 B
dynamic-HASH.js gzip 3.08 kB 3.08 kB
head-HASH.js gzip 359 B 359 B
hooks-HASH.js gzip 920 B 920 B
image-HASH.js gzip 5.71 kB 5.71 kB
index-HASH.js gzip 263 B 263 B
link-HASH.js gzip 2.63 kB 2.63 kB
routerDirect..HASH.js gzip 320 B 320 B
script-HASH.js gzip 391 B 391 B
withRouter-HASH.js gzip 318 B 318 B
85e02e95b279..7e3.css gzip 107 B 107 B
Overall change 16.3 kB 16.3 kB
Client Build Manifests
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
_buildManifest.js gzip 459 B 459 B
Overall change 459 B 459 B
Rendered Page Sizes
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
index.html gzip 531 B 531 B
link.html gzip 545 B 545 B
withRouter.html gzip 526 B 526 B
Overall change 1.6 kB 1.6 kB

Default Build with SWC (Increase detected ⚠️)
General Overall increase ⚠️
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
buildDuration 17.4s 17.3s -43ms
buildDurationCached 6s 6s -56ms
nodeModulesSize 481 MB 481 MB ⚠️ +12.8 kB
Page Load Tests Overall increase ✓
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
/ failed reqs 0 0
/ total time (seconds) 3.114 3.057 -0.06
/ avg req/sec 802.87 817.82 +14.95
/error-in-render failed reqs 0 0
/error-in-render total time (seconds) 1.212 1.172 -0.04
/error-in-render avg req/sec 2062.4 2132.66 +70.26
Client Bundles (main, webpack)
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
925.HASH.js gzip 178 B 178 B
framework-HASH.js gzip 42.2 kB 42.2 kB
main-HASH.js gzip 29.1 kB 29.1 kB
webpack-HASH.js gzip 1.45 kB 1.45 kB
Overall change 72.9 kB 72.9 kB
Legacy Client Bundles (polyfills)
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
polyfills-HASH.js gzip 31 kB 31 kB
Overall change 31 kB 31 kB
Client Pages
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
_app-HASH.js gzip 1.35 kB 1.35 kB
_error-HASH.js gzip 179 B 179 B
amp-HASH.js gzip 312 B 312 B
css-HASH.js gzip 324 B 324 B
dynamic-HASH.js gzip 3.08 kB 3.08 kB
head-HASH.js gzip 357 B 357 B
hooks-HASH.js gzip 921 B 921 B
image-HASH.js gzip 5.76 kB 5.76 kB
index-HASH.js gzip 261 B 261 B
link-HASH.js gzip 2.74 kB 2.74 kB
routerDirect..HASH.js gzip 322 B 322 B
script-HASH.js gzip 392 B 392 B
withRouter-HASH.js gzip 317 B 317 B
85e02e95b279..7e3.css gzip 107 B 107 B
Overall change 16.4 kB 16.4 kB
Client Build Manifests
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
_buildManifest.js gzip 457 B 457 B
Overall change 457 B 457 B
Rendered Page Sizes
vercel/next.js canary ijjk/next.js update/swc-load-failure Change
index.html gzip 527 B 527 B
link.html gzip 541 B 541 B
withRouter.html gzip 525 B 525 B
Overall change 1.59 kB 1.59 kB
Commit: 6521d98

@ijjk ijjk marked this pull request as ready for review April 28, 2022 00:47
@timneutkens timneutkens merged commit 917a736 into vercel:canary Apr 28, 2022
@timneutkens timneutkens deleted the update/swc-load-failure branch April 28, 2022 09:31
kodiakhq bot pushed a commit that referenced this pull request Apr 28, 2022
This is a follow-up to #36527 to make sure we eagerly patch the lockfile as the correct swc dependency will be present if the platform matches so the load failure isn't hit which is where we were previously patching the lockfile. This is done in the background so does not block compilation. This also removes some extra logs that aren't necessary. 

<details>

<summary>before lockfile patch</summary>

![before](https://user-images.githubusercontent.com/22380829/165780507-09e5aee6-3253-483f-9e3f-e24bea6df377.png)

</details>


<details>

<summary>after lockfile patch</summary>

![after](https://user-images.githubusercontent.com/22380829/165780545-829665aa-05ec-431d-aa2f-42c4ce3badd7.png)

</details>

This also fixes a case I noticed where we weren't flushing events before exiting when builds fail
kodiakhq bot pushed a commit that referenced this pull request May 2, 2022
Follow-up to #36527 this adds falling back to the wasm swc build when loading the native bindings fails so that we don't block the build on the native dependency being available.  

This continues off of #33496 but does not add a postinstall script yet and only downloads the fallback when the native dependency fails to load.
@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 28, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants