Specified URL not called if the newman process returns a non-zero code

[thiniulian]

Hello!

We want to use the newman-reporter-remote reporter to extract the reports from our api testing to a centralised platform. We run our collection using the CLI inside Docker.

We found out that if the collection run fails due to a test failing the remote url that is specified in the command is not called. Basically we can't register the failed runs.

Adding the -x argument to the newman command bypasses the non-zero response code and calls the specified url with the expected data, but we are relying on the non-zero response code in Jenkins to mark the build as failed.

I think it's important to mention that the cli reporter is working correctly, publishing the report even if the newman process returns a non-zero code.

Thank you!