Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI Reliability 2022-07-20 #326

Open
16 tasks
github-actions bot opened this issue Jul 20, 2022 · 0 comments
Open
16 tasks

CI Reliability 2022-07-20 #326

github-actions bot opened this issue Jul 20, 2022 · 0 comments

Comments

@github-actions
Copy link

Failures in node-test-pull-request/45464 to node-test-pull-request/45561 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-07-20 00:15 1 5 26 2 66 5.15%

JSTest Failure

Reason pummel/test-http-upload-timeout
Type JS_TEST_FAILURE
Failed PR 21 (nodejs/node#43850, nodejs/node#43514, nodejs/node#43554, nodejs/node#43877, nodejs/node#43010, nodejs/node#43870, nodejs/node#43880, nodejs/node#43881, nodejs/node#43714, nodejs/node#43747, nodejs/node#43886, nodejs/node#43806, nodejs/node#43883, nodejs/node#43891, nodejs/node#43889, nodejs/node#38905, nodejs/node#43885, nodejs/node#43896, nodejs/node#43826, nodejs/node#43802, nodejs/node#43858)
Appeared test-equinix-ubuntu1804_container-arm64-2, test-nearform-macos11.0-arm64-1, test-orka-macos10.15-x64-2, test-softlayer-ubi81_container-x64-1, test-digitalocean-alpine311_container-x64-1, test-rackspace-debian10-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-4, test-macstadium-macos11.0-arm64-3, test-softlayer-alpine311_container-x64-1, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-ibm-rhel8-s390x-4, test-equinix-rhel8_container-arm64-1, test-rackspace-fedora32-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-5, test-rackspace-win2012r2_vs2015-x64-2, test-orka-macos11-x64-2, test-equinix-debian10_container-armv7l-2, test-digitalocean-fedora32-x64-1, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45466/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45559/
Example
not ok 3327 pummel/test-http-upload-timeout
  ---
  duration_ms: 5.828
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-commit-arm/test/pummel/test-http-upload-timeout.js:34
        throw new Error('Unexpected timeout');
        ^
    
    Error: Unexpected timeout
        at Socket.<anonymous> (/home/iojs/build/workspace/node-test-commit-arm/test/pummel/test-http-upload-timeout.js:34:11)
        at Socket.emit (node:events:525:35)
        at Socket._onTimeout (node:net:522:8)
        at listOnTimeout (node:internal/timers:564:17)
        at process.processTimers (node:internal/timers:507:7)
    
    Node.js v19.0.0-pre
  ...


Reason sequential/test-gc-http-client
Type JS_TEST_FAILURE
Failed PR 10 (nodejs/node#43178, nodejs/node#43863, nodejs/node#43763, nodejs/node#43010, nodejs/node#43880, nodejs/node#43879, nodejs/node#43890, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45472/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45559/
Example
not ok 3425 sequential/test-gc-http-client
  ---
  duration_ms: 1.415
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 480/256/640
    done/collected/total: 631/320/640
    done/collected/total: 640/480/640
    done/collected/total: 640/631/640
    done/collected/total: 640/640/640
    node:_http_server:493
        connections[i].socket.destroy();
                              ^
    
    TypeError: Cannot read properties of null (reading 'destroy')
        at Server.closeIdleConnections (node:_http_server:493:27)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-binary-armv7l/test/sequential/test-gc-http-client.js:60:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...


Reason sequential/test-gc-http-client-onerror
Type JS_TEST_FAILURE
Failed PR 6 (nodejs/node#43873, nodejs/node#43870, nodejs/node#43883, nodejs/node#43881, nodejs/node#43891, nodejs/node#43858)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu1804_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45490/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45559/
Example
not ok 3426 sequential/test-gc-http-client-onerror
  ---
  duration_ms: 1.516
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 480/256/640
    done/collected/total: 629/320/640
    done/collected/total: 640/480/640
    done/collected/total: 640/629/640
    done/collected/total: 640/640/640
    node:_http_server:493
        connections[i].socket.destroy();
                              ^
    
    TypeError: Cannot read properties of null (reading 'destroy')
        at Server.closeIdleConnections (node:_http_server:493:27)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-binary-armv7l/test/sequential/test-gc-http-client-onerror.js:65:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...


Reason parallel/test-worker-heap-snapshot
Type JS_TEST_FAILURE
Failed PR 5 (nodejs/node#43178, nodejs/node#43783, nodejs/node#43892, nodejs/node#43889, nodejs/node#43890)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-rackspace-win2012r2_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45472/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45543/
Example
not ok 3018 parallel/test-worker-heap-snapshot
  ---
  duration_ms: 0.815
  severity: crashed
  exitcode: -11
  stack: |-
  ...


Reason parallel/test-heapsnapshot-near-heap-limit-worker
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43863, nodejs/node#43824, nodejs/node#43826)
Appeared test-equinix-debian10_container-armv7l-2, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45549/
Example
not ok 1292 parallel/test-heapsnapshot-near-heap-limit-worker
  ---
  duration_ms: 2.960
  severity: fail
  exitcode: 1
  stack: |-
    
    Invoked NearHeapLimitCallback, processing=false, current_limit=52428800, initial_limit=52428800
    max_young_gen_size=25165824, young_gen_size=0, old_gen_size=51635480, total_size=51635480
    Estimated available memory=4200747008, estimated overhead=25165824
    Start generating Heap.20220719.111439.2085224.1.001.heapsnapshot...
    Wrote snapshot to /home/iojs/tmp/.tmp.1137/Heap.20220719.111439.2085224.1.001.heapsnapshot
    
    <--- Last few GCs --->
    
    [2085224:0xf47006c8]     1610 ms: Mark-sweep (reduce) 49.1 (52.8) -> 49.1 (52.8) MB, 7.9 / 0.0 ms  (average mu = 0.292, current mu = -0.158) heap profiler; GC in old space requested
    
    
    <--- JS stacktrace --->
    
    FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
    
    node:assert:400
        throw err;
        ^
    
    AssertionError [E...

Reason parallel/test-http-client-response-timeout
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43806, nodejs/node#43010, nodejs/node#43863)
Appeared test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45470/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Example
not ok 1045 parallel/test-http-client-response-timeout
  ---
  duration_ms: 0.70
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-linuxone/test/common/index.js:396:10)
        at ClientRequest.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-http-client-response-timeout.js:10:32)
        at ClientRequest.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/common/index.js:438:15)
        at Object.onceWrapper (node:events:628:26)
        at ClientRequest.emit (node:events:513:28)
        at HTTPParser.parserOnIncomingClient [as onIncoming] (node:_http_client:674:27)
        at HTTPParser.parserOnHeadersComplete (node:_http_common:117:17)
        at Socket.socketOnData (node:_http_client:521:22)
        at Socket.emit (node:events:513:28)
  ...


Reason parallel/test-fs-write-stream-file-handle
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43822, nodejs/node#43802)
Appeared test-rackspace-win2012r2_vs2017-x64-4, test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45533/
Example
not ok 290 parallel/test-fs-write-stream-file-handle
  ---
  duration_ms: 0.869
  severity: fail
  exitcode: 1
  stack: |-
    Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.282
    Files blocking: [ 'write_stream_filehandle_test.txt' ]
    
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + ''
    - 'hello world'
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-fs-write-stream-file-handle.js:19:12)
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:438:15)
        at WriteStream.emit (node:events:513:28)
        at emitCloseNT (node:internal/streams/destroy:132:10)
        at process.processTicksAndRejections (node:internal/process/task_queues:81:21) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '',
   ...

Reason parallel/test-vm-break-on-sigint
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43891, nodejs/node#43890)
Appeared test-softlayer-ubi81_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-9, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/45524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45543/
Example
not ok 3119 parallel/test-vm-break-on-sigint
  ---
  duration_ms: 120.72
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-worker-fshandles-open-close-on-termination
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-4, test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45508/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45545/
Example
not ok 2986 parallel/test-worker-fshandles-open-close-on-termination
  ---
  duration_ms: 1.490
  severity: crashed
  exitcode: -5
  stack: |-
    
    #
    # Fatal process OOM in NewArray
    #
    
  ...


Reason sequential/test-gc-http-client-timeout
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43822, nodejs/node#43863)
Appeared test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45522/
Example
not ok 3612 sequential/test-gc-http-client-timeout
  ---
  duration_ms: 0.448
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 48/0/503
    done/collected/total: 97/48/503
    done/collected/total: 166/97/503
    node:events:491
          throw er; // Unhandled 'error' event
          ^
    
    Error: connect ECONNRESET ::1:64397
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1241:16)
    Emitted 'error' event on ClientRequest instance at:
        at Socket.socketErrorListener (node:_http_client:475:9)
        at Socket.emit (node:events:513:28)
        at emitErrorNT (node:internal/streams/destroy:151:8)
        at emitErrorCloseNT (node:internal/streams/destroy:116:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      errno: -54,
      code: 'ECONNRESET',
      syscall: 'connect',
      address: '::1',
      port: 64397
    }
    
    Node.js v19.0.0-pre
  ...


Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 10 (nodejs/node#43863, nodejs/node#43880, nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43806, nodejs/node#43881, nodejs/node#43892, nodejs/node#43824, nodejs/node#43885)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-digitalocean-freebsd12-x64-2, test-nearform-macos11.0-arm64-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45546/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 145.40.99.31/145.40.99.31:58098' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)

Reason Build timed out (after 15 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (nodejs/node#38905, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45531/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45549/
Example
Build timed out (after 15 minutes). Marking the build as failed.

Build Failure

Reason ERROR: Build step failed with exception
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43010, nodejs/node#43747, nodejs/node#43870, nodejs/node#43886)
Appeared test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45479/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45516/
Example
ERROR: Build step failed with exception
java.lang.NullPointerException: no workspace from node hudson.slaves.DumbSlave[test-equinix-ubuntu2004_container-armv7l-2] which is computer hudson.slaves.SlaveComputer@2ad6001 and has channel null
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:113)
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:91)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processBuildSteps(Processor.java:180)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processScripts(Processor.java:91)

Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43010, nodejs/node#43884, nodejs/node#43886, nodejs/node#43802)
Appeared test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45533/
Example
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-arm/nodes=ubuntu2004-armv7l #42818
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43892)
Appeared test-osuosl-rhel8-ppc64_le-2, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45479/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45536/
Example
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for node-test-commit-plinux/nodes=rhel8-ppc64le #43996
Sending e-mails to: michael_dawson@ca.ibm.com vieuxtech@gmail.com
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

undefined

Reason Unknown
Type undefined
Failed PR 24 (nodejs/node#43850, nodejs/node#43178, nodejs/node#43763, nodejs/node#43863, nodejs/node#43741, nodejs/node#43880, nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43879, nodejs/node#43747, nodejs/node#43886, nodejs/node#43806, nodejs/node#43881, nodejs/node#43890, nodejs/node#43875, nodejs/node#43802, nodejs/node#43892, nodejs/node#43889, nodejs/node#43824, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858, nodejs/node#42256)
Appeared test-nearform_arm-win10_vs2019-arm64-1, test-equinix-debian10_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45466/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45561/
Example
Unknown

Progress

  • pummel/test-http-upload-timeout (21)
  • sequential/test-gc-http-client (10)
  • sequential/test-gc-http-client-onerror (6)
  • parallel/test-worker-heap-snapshot (5)
  • parallel/test-heapsnapshot-near-heap-limit-worker (3)
  • parallel/test-http-client-response-timeout (3)
  • parallel/test-fs-write-stream-file-handle (2)
  • parallel/test-vm-break-on-sigint (2)
  • parallel/test-worker-fshandles-open-close-on-termination (2)
  • sequential/test-gc-http-client-timeout (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (10)
  • Build timed out (after 15 minutes). Marking the build as failed. (2)
  • ERROR: Build step failed with exception (4)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (4)
  • ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ... (2)
  • Unknown (24)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

0 participants