Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: reporting wrong number of tests in Dart #426

Merged
merged 3 commits into from May 8, 2024
Merged

Conversation

dominicmh
Copy link
Contributor

@dominicmh dominicmh commented Apr 12, 2024

Fixes #319

According to the documentation of the TestDoneEvent, the hidden "tests" should be ignored:

The hidden attribute indicates that the test's result should be hidden and not
counted towards the total number of tests run for the suite. This is true for
virtual tests created for loading test suites, setUpAll(), and
tearDownAll(). Only successful tests will be hidden.

  • updated __tests__ to fail if hidden tests are counted toward total number of tests
  • filter out any "tests" if their TestDoneEvent has hidden flag set to true
  • cross-checked on a repo with ~2,500 tests

@dominicmh
Copy link
Contributor Author

Is there any chance this gets reviewed anytime soon, @jozefizso?

@jozefizso jozefizso self-assigned this May 8, 2024
@jozefizso
Copy link
Collaborator

Hi @dominicmh, thanks for notifying me. I reviewed the code and it looks good!

@jozefizso jozefizso added bug Something isn't working dart Pull requests that update Dart code labels May 8, 2024
@jozefizso jozefizso merged commit 477942d into dorny:main May 8, 2024
3 checks passed
@jozefizso jozefizso added this to the v1.9.1 milestone May 8, 2024
artemrys pushed a commit to splunk/addonfactory-workflow-addon-release that referenced this pull request May 17, 2024
[![Mend
Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Type | Update | Change |
|---|---|---|---|
| [actions/cache](https://togithub.com/actions/cache) | action | major |
`v3` -> `v4` |
| [actions/checkout](https://togithub.com/actions/checkout) | action |
major | `v3` -> `v4` |
|
[actions/download-artifact](https://togithub.com/actions/download-artifact)
| action | major | `v3` -> `v4` |
|
[actions/upload-artifact](https://togithub.com/actions/upload-artifact)
| action | major | `v3` -> `v4` |
|
[amannn/action-semantic-pull-request](https://togithub.com/amannn/action-semantic-pull-request)
| action | minor | `v5.4.0` -> `v5.5.2` |
|
[aws-actions/configure-aws-credentials](https://togithub.com/aws-actions/configure-aws-credentials)
| action | major | `v3` -> `v4` |
| [dorny/test-reporter](https://togithub.com/dorny/test-reporter) |
action | minor | `v1.7.0` -> `v1.9.1` |
| ghcr.io/splunk/workflow-engine-base | container | major | `2.0.12` ->
`3.0.0` |

---

### Release Notes

<details>
<summary>actions/cache (actions/cache)</summary>

### [`v4`](https://togithub.com/actions/cache/compare/v3...v4)

[Compare Source](https://togithub.com/actions/cache/compare/v3...v4)

</details>

<details>
<summary>actions/checkout (actions/checkout)</summary>

###
[`v4`](https://togithub.com/actions/checkout/blob/HEAD/CHANGELOG.md#v400)

[Compare Source](https://togithub.com/actions/checkout/compare/v3...v4)

- [Support fetching without the --progress
option](https://togithub.com/actions/checkout/pull/1067)
-   [Update to node20](https://togithub.com/actions/checkout/pull/1436)

</details>

<details>
<summary>actions/download-artifact (actions/download-artifact)</summary>

###
[`v4`](https://togithub.com/actions/download-artifact/compare/v3...v4)

[Compare
Source](https://togithub.com/actions/download-artifact/compare/v3...v4)

</details>

<details>
<summary>actions/upload-artifact (actions/upload-artifact)</summary>

### [`v4`](https://togithub.com/actions/upload-artifact/compare/v3...v4)

[Compare
Source](https://togithub.com/actions/upload-artifact/compare/v3...v4)

</details>

<details>
<summary>amannn/action-semantic-pull-request
(amannn/action-semantic-pull-request)</summary>

###
[`v5.5.2`](https://togithub.com/amannn/action-semantic-pull-request/releases/tag/v5.5.2)

[Compare
Source](https://togithub.com/amannn/action-semantic-pull-request/compare/v5.5.1...v5.5.2)

##### Bug Fixes

- Bump tar from 6.1.11 to 6.2.1
([#&#8203;262](https://togithub.com/amannn/action-semantic-pull-request/issues/262)
by [@&#8203;EelcoLos](https://togithub.com/EelcoLos))
([9a90d5a](https://togithub.com/amannn/action-semantic-pull-request/commit/9a90d5a5ac979326e3bb9272750cdd4f192ce24a))

###
[`v5.5.1`](https://togithub.com/amannn/action-semantic-pull-request/releases/tag/v5.5.1)

[Compare
Source](https://togithub.com/amannn/action-semantic-pull-request/compare/v5.5.0...v5.5.1)

##### Bug Fixes

- Bump ip from 2.0.0 to 2.0.1
([#&#8203;263](https://togithub.com/amannn/action-semantic-pull-request/issues/263)
by [@&#8203;EelcoLos](https://togithub.com/EelcoLos))
([5e7e9ac](https://togithub.com/amannn/action-semantic-pull-request/commit/5e7e9acca3ddc6a9d7b640fe1f905c4fff131f4a))

###
[`v5.5.0`](https://togithub.com/amannn/action-semantic-pull-request/releases/tag/v5.5.0)

[Compare
Source](https://togithub.com/amannn/action-semantic-pull-request/compare/v5.4.0...v5.5.0)

##### Features

- Add outputs for `type`, `scope` and `subject`
([#&#8203;261](https://togithub.com/amannn/action-semantic-pull-request/issues/261)
by [@&#8203;bcaurel](https://togithub.com/bcaurel))
([b05f5f6](https://togithub.com/amannn/action-semantic-pull-request/commit/b05f5f6423ef5cdfc7fdff00c4c10dd9a4f54aff))

</details>

<details>
<summary>aws-actions/configure-aws-credentials
(aws-actions/configure-aws-credentials)</summary>

###
[`v4`](https://togithub.com/aws-actions/configure-aws-credentials/releases/tag/v4)

[Compare
Source](https://togithub.com/aws-actions/configure-aws-credentials/compare/v3...v4)

This tag tracks the latest v4.x.x release

</details>

<details>
<summary>dorny/test-reporter (dorny/test-reporter)</summary>

###
[`v1.9.1`](https://togithub.com/dorny/test-reporter/releases/tag/v1.9.1)

[Compare
Source](https://togithub.com/dorny/test-reporter/compare/v1.9.0...v1.9.1)

#### What's Changed

- fix: reporting wrong number of tests in Dart by
[@&#8203;dominicmh](https://togithub.com/dominicmh) in
[dorny/test-reporter#426
- Fix problematic retransmission of authentication token (alternative
solution) by [@&#8203;JojOatXGME](https://togithub.com/JojOatXGME) in
[dorny/test-reporter#438
- Update development dependencies by
[@&#8203;jozefizso](https://togithub.com/jozefizso) in
[dorny/test-reporter#442

#### New Contributors

- [@&#8203;dominicmh](https://togithub.com/dominicmh) made their first
contribution in
[dorny/test-reporter#426
- [@&#8203;JojOatXGME](https://togithub.com/JojOatXGME) made their first
contribution in
[dorny/test-reporter#438

**Full Changelog**:
dorny/test-reporter@v1.9.0...v1.9.1

###
[`v1.9.0`](https://togithub.com/dorny/test-reporter/releases/tag/v1.9.0)

[Compare
Source](https://togithub.com/dorny/test-reporter/compare/v1.8.0...v1.9.0)

#### What's Changed

##### Features

- Add support for the `rspec-json` format
[#&#8203;398](https://togithub.com/dorny/test-reporter/issues/398)
- Updated packages
[#&#8203;405](https://togithub.com/dorny/test-reporter/issues/405)

#### Contributors

- [@&#8203;oscarmampel](https://togithub.com/oscarmampel) made their
contribution in
[#&#8203;398](https://togithub.com/dorny/test-reporter/issues/398)

**Full Changelog**:
dorny/test-reporter@v1.8.0...v1.9.0

###
[`v1.8.0`](https://togithub.com/dorny/test-reporter/releases/tag/v1.8.0)

[Compare
Source](https://togithub.com/dorny/test-reporter/compare/v1.7.0...v1.8.0)

##### What's Changed

- CHANGELOG.md by [@&#8203;j-catania](https://togithub.com/j-catania) in
[dorny/test-reporter#297
- Bump [@&#8203;babel/traverse](https://togithub.com/babel/traverse)
from 7.12.1 to 7.23.2 in /reports/jest by
[@&#8203;dependabot](https://togithub.com/dependabot) in
[dorny/test-reporter#303
- Bump [@&#8203;babel/traverse](https://togithub.com/babel/traverse)
from 7.22.20 to 7.23.2 by
[@&#8203;dependabot](https://togithub.com/dependabot) in
[dorny/test-reporter#304
- Add `SwiftXunitParser` class based on `JavaJunitParser` for
`swift-xunit` reporter by
[@&#8203;jozefizso](https://togithub.com/jozefizso) in
[dorny/test-reporter#317
- Update to Node20 by
[@&#8203;j-catania](https://togithub.com/j-catania) in
[dorny/test-reporter#315
- Fix build error by [@&#8203;dorny](https://togithub.com/dorny) in
[dorny/test-reporter#331
- Use NodeJS 18 LTS as default runtime by
[@&#8203;jozefizso](https://togithub.com/jozefizso) in
[dorny/test-reporter#332
- Update all packages by
[@&#8203;jozefizso](https://togithub.com/jozefizso) in
[dorny/test-reporter#333
- Escape <> characters in suite name by
[@&#8203;wingyplus](https://togithub.com/wingyplus) in
[dorny/test-reporter#236
- Adding feature and bug template by
[@&#8203;j-catania](https://togithub.com/j-catania) in
[dorny/test-reporter#341
- Update check title and remove icon by
[@&#8203;ldaneliukas](https://togithub.com/ldaneliukas) in
[dorny/test-reporter#144
- `test-reporter` release v1.8.0 by
[@&#8203;jozefizso](https://togithub.com/jozefizso) in
[dorny/test-reporter#370

##### New Contributors

- [@&#8203;jozefizso](https://togithub.com/jozefizso) made their first
contribution in
[dorny/test-reporter#317
- [@&#8203;wingyplus](https://togithub.com/wingyplus) made their first
contribution in
[dorny/test-reporter#236
- [@&#8203;ldaneliukas](https://togithub.com/ldaneliukas) made their
first contribution in
[dorny/test-reporter#144

**Full Changelog**:
dorny/test-reporter@v1.7.0...v1.8.0

</details>

---

### Configuration

📅 **Schedule**: Branch creation - "before 4am on Monday" (UTC),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

👻 **Immortal**: This PR will be recreated if closed unmerged. Get
[config help](https://togithub.com/renovatebot/renovate/discussions) if
that's undesired.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Mend
Renovate](https://www.mend.io/free-developer-tools/renovate/). View
repository job log
[here](https://developer.mend.io/github/splunk/addonfactory-workflow-addon-release).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4zMTMuMSIsInVwZGF0ZWRJblZlciI6IjM3LjM2My41IiwidGFyZ2V0QnJhbmNoIjoiZGV2ZWxvcCIsImxhYmVscyI6W119-->

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dart Pull requests that update Dart code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Number of completed tests mismatches passed/failed
2 participants