Connect to SQL Server using Apache Spark

Hadoop,MachineLearningAlgos,Spark,Pig,Hive

Source code for the work "dSpark: Deadline-Based Resource Allocation for Big Data Applications in Apache Spark" published in IEEE e-Science 2017

Apache Spark with Kafka via JDBC !!!

A published paper in PEARC18: Combining HPC and Big Data Infrastructures in Large-Scale Post-Processing of SimulaBon Data: A Case Study

Examples usages for cleanframes library

type-class based data cleansing library for Apache Spark SQL

Implementation of GraphFrames using PySpark in Eclipse IDE

Link Prediction is about predicting the future connections in a graph. In this project, Link Prediction is about predicting whether two authors will be collaborating for their future paper or not given the graph of authors who collaborated for atleast one paper together.

As a coursera certified specialization completer you will have a proven deep understanding on massive parallel data processing, data exploration and visualization, and advanced machine learning & deep learning. You'll understand the mathematical foundations behind all machine learning & deep learning algorithms. You can apply knowledge in practi…

The rapid pace of innovation in Artificial Intelligence (AI) is creating enormous opportunity for transforming entire industries and our very existence. After competing this comprehensive 6 course Professional Certificate, you will get a practical understanding of Machine Learning and Deep Learning. You will master fundamental concepts of Machin…

Delta Lake Examples

This is a Jupyter Notebook to practice Apache Spark in Google Colab, especially for the exam CCA Spark and Hadoop Developer Exam (CCA175).

Working with Apache Spark, Creating some small tutorials and at last implemeting a small project

This work on Python notebook .It shows how to calculate covariance and correlations using pyspark

This repository contains all the projects and labs I worked on while pursuing professional certificate programs, specializations, and bootcamp. [Areas: Deep Learning, Machine Learning, Applied Data Science].

Trigger spark-submit in Golang. A Go implementation of famous SparkLauncher.java.

Apache Spark project for Advanced Topics on Databases course

Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.