Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Development plan and contribution #10

Open
yxue-kabam opened this issue Feb 28, 2020 · 3 comments
Open

Development plan and contribution #10

yxue-kabam opened this issue Feb 28, 2020 · 3 comments
Labels
question Further information is requested

Comments

@yxue-kabam
Copy link

Description
I have built our ML infrastructure with airflow and kubernetes. As a centralized scheduler, airflow has a few scenarios where airflow does not work well. For the next iteration of our ML workflow and scheduler, I'd like to invest in cloud-native workflow engine (basically argo). I'm actively exploring with this library and am wondering about the longer term development plan?

Do you take external contribution at the moment? (I suspect not at the moment, but would like to know when you would call it a V1 and go from there?)

Additional context

@yxue-kabam yxue-kabam added the question Further information is requested label Feb 28, 2020
@brtasavpatel
Copy link

@yxue-kabam I am also looking to do the same, I tried making airflow work with k8s executor but it was real pain to get it working and managing it so now have moved to argo. I would be happy to contribute as well.

Also, sorry for shameless plugin to my question #12 here. do you have any insights into this one?

@CermakM
Copy link
Owner

CermakM commented Mar 4, 2020

Thank you for the interest, guys! Appreciated.

I've been working closely with the Argoproj and we're in the process of migration of https://github.com/CermakM/argo-client-python under Argoproj Labs to give it a more official status and attract more contributors. I suspect this repository will become part of that organization, too so that we could boost the development, but it is yet to be discussed.

I intend to release v0.1 soon once I get some of the current issues fixed, but I have been quite short on time recently, so my plans have gotten a bit delayed, unfortunately. Contributions are and always will be welcome! :) so are the ideas for further improvements and proposals for enhancements.

@hadim
Copy link

hadim commented Jun 3, 2020

@yxue-kabam do you have feedbacks about using Argo and this library to build an ML cluster?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants