Skip to content
/ maiev Public

The world of warcraft heroine, a part of the Watchers

Notifications You must be signed in to change notification settings

leletan/maiev

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Maiev

To run it locally, do the following:

  1. Install and set up minikube v0.22.3 (google for more details)
  2. run minikube start --kubernetes-version v1.7.5 --cpus 7 --memory 12360 --disk-size 100g
  3. run make sidecars (to set up dependencies)
  4. run make publish (to build and publish all the docker images needed)
  5. run make submit JOB=<job_name> (to submit the spark job twitter_follower_jdbc_logging or reliable_s3_parquet_logging to local minikube cluster)
  6. run kubectl get pods to find the spark driver pod
  7. run kubectl logs -f <driver-pod-name> to check the driver log
  8. run kubectl exec -it cockroachdb-0 bash to log into cockroachdb
  9. run ./cockroach sql --insecure --host=cockroachdb-public -e '<any_sql_query>' query cockroachDB
  10. have fun
  11. run kubectl delete pod <driver-pod-name> to stop the spark job
  12. try re-installing vm and minikube if running into weird kubernetes related issues