sparklyr_start

Materials to start using Spark in R (sparklyr package).

• My slides for the sparklyr workshop - updated July 2019.
  • In Spanish: sparklyr workshop
• Examples for local usage (in RStudio): sparklyr_start.Rmd.
  • Rendered in HTML sparklyr_start.html
• Examples for cluster usage (in Jupyter): sparklyr_test.ipynb.
  • Rendered in nbviewer.jupyter.org

Clone this repo

$ git clone https://github.com/aurora-mareviv/sparklyr_start

References

Sparklyr

• sparklyr workshop
• sparklyr presentation by RStudio
• sparklyr tutorial.
• sparklyr cheatsheet.
• sparklyr: creating extensions.
• Differences between sparkr and sparklyr.
• Hive Operators and UDFs.
• String Functions in Hive.
• POSIX regular expressions.

PySpark

• PySpark course
• Material for Machine Learning Workshop Galicia 2016.
• PySpark Programming Guide.
• PySpark cheatsheet.

Jupyter

• Jupyter shortcuts