Skip to content

Trigger spark-submit in Golang. A Go implementation of famous SparkLauncher.java.

License

Notifications You must be signed in to change notification settings

datumbrain/gossub

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

gossub (Go spark-submit wrapper)

Trigger spark-submit in Golang. A Go implementation of org.apache.spark.launcher.SparkLauncher.

Usage

package main

import (
	"os"

	"github.com/datumbrain/gossub"
)

func main() {
	sl := gossub.SparkLauncher{
		AppName:     "my-new-app",
		AppResource: "test",
		MainClass:   "org.apache.spark.examples.SparkPi",
		SparkHome:   "/usr/local/spark",
		Jar:         "original-spark-examples_2.12-3.1.0-SNAPSHOT.jar",
	}

	sl.Init()
	sl.RedirectError(os.Stderr)
	sl.RedirectOutput(os.Stdout)
	sl.Launch()
}

Author

Fahad Siddiqui

License

MIT

About

Trigger spark-submit in Golang. A Go implementation of famous SparkLauncher.java.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages