Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Improvement] Add a integration test case for Spark with MiniYarnCluster #138

Open
Tracked by #1092
, #2
...
jerqi opened this issue Aug 6, 2022 · 6 comments · May be fixed by #1395
Open
Tracked by #1092
, #2
...

[Improvement] Add a integration test case for Spark with MiniYarnCluster #138

jerqi opened this issue Aug 6, 2022 · 6 comments · May be fixed by #1395
Labels
good first issue Good for newcomers

Comments

@jerqi
Copy link
Contributor

jerqi commented Aug 6, 2022

We use Spark local mode to write integration test, but we can't cover some cases, such as Tencent/Firestorm#187, so we should add a integration test case for Spark with MiniYarnCluster
@jerqi jerqi added the good first issue Good for newcomers label Aug 6, 2022
@zuston
Copy link
Member

zuston commented Aug 7, 2022

Oh, the bug of Tencent/Firestorm#187 is caused by me.

Maybe I can take this ticket, could u help assign this to me?

@jerqi
Copy link
Contributor Author

jerqi commented Aug 7, 2022

Thanks.

@zuston zuston removed their assignment Oct 9, 2022
@selectbook
Copy link
Contributor

Hello, can I have a try on this issue?

@zuston
Copy link
Member

zuston commented Oct 22, 2022

Feel free to take it. Assign to you.

@jerqi
Copy link
Contributor Author

jerqi commented Oct 27, 2022

@selectbook You can imitate https://github.com/apache/incubator-uniffle/blob/master/integration-test/mr/src/test/java/org/apache/uniffle/test/MRIntegrationTestBase.java, it's enough to run a WordCount test.

@selectbook
Copy link
Contributor

thanks, I will try to finish it in these days

@jerqi jerqi mentioned this issue Aug 5, 2023
Open
17 tasks
@gdrbacca gdrbacca mentioned this issue Oct 27, 2023
Open
17 tasks
@lifeSo lifeSo linked a pull request Dec 24, 2023 that will close this issue
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
3 participants
@jerqi @selectbook @zuston