feat(stepfunctions-tasks): add 'Emr on Eks' tasks

[sanava2010]

This CDK feature adds support for Emr on Eks by implementing API service integrations for the following three APIs.

This PR adds three tasks which support Emr on Eks:

1. Create Virtual Cluster
2. Start a job run
3. Delete virtual cluster

Continuation of #15262 by @matthewsvu and @BenChaimberg:

Closes #15234.

---

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

[gitpod-io]

[kaizencc]

Hi @sanava2010! Looks good so far. I have only looked at start-job-run so far. I'm realizing that this is a gargantuan PR and it is tough for me to get context on all 3 tasks at the same time. It's still nearly 3k lines of code outside of the expected.json files. Can you please separate this into a PR for each task? It doesn't look like the tasks really rely on each other and this would help me focus on reviewing one section at a time. We can then merge after we've approved all 3 PRs so we support all 3 tasks together. (I know I told you to go about this PR in this manner, sorry for changing it up...)

If you haven't done the above, I think I can just power through this PR as is. I'll just try to look at things separately.

I also want to see if we can migrate the unit tests to the new Assertions library. This will help us slim the tests down to exactly what we are testing for -- lots of helper functions like Match.objectLike(), Match.arrayWith(), etc. But I will let you know if we can do this.

Great work!

Pull request has been modified.

[kaizencc]

Took a look at a few more files today. Mostly comments on documentation and refactoring some checks into validation functions.

Pull request has been modified.

[kaizencc]

Just a few lines of code that should have been deleted, and I want you to confirm that you have integ tested the job execution role policy update and that the custom resource is successful. Aim to approve this PR tomorrow. Great work!

[matthewsvu]

Thanks for going through the PR guys, I've been observing the progress on the PR and you guys fixed a lot of the issues that were plaguing the original PR and refactored them out.

Awesome work!

Pull request has been modified.

[mergify]

Thank you for contributing! Your pull request will be updated from master and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

[sanava2010]

The build is failing because expected json of some stacks has changed, running yarn integ is not working and is throwing an issue while creating an EKS cluster and is throwing a CloudFormation did not receive a response from your Custom Resource exception. Working on debugging it.

Pull request has been modified.

[mergify]

Thank you for contributing! Your pull request will be updated from master and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

[aws-cdk-automation]

AWS CodeBuild CI Report

• CodeBuild project: AutoBuildProject89A8053A-LhjRyN9kxr8o
• Commit ID: 075a812
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[mergify]

Thank you for contributing! Your pull request will be updated from master and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).