Sample projects to explore various Google Cloud service-offerings and architecture approaches

Black Friday, the biggest shopping day of the year, presents a unique opportunity for retailers like Walmart to boost sales, attract new customers, and clear inventory. Managing the surge in transaction volumes, understanding customer preferences, and optimizing inventory in real time are critical challenges that require sophisticated data solution

GCP Space Shepherd - service for monitoring Google DataFlow executions

GCP Dataflow pipeline in python

GCP Streaming Data Pipeline for Building Energy Consumption

Leveraged GitHub Actions to automate the deployment of a GCP pipeline for Snowflake to BigQuery data migration. Utilized 'sensex-data-analysis' as the data source and Snowflake storage integration feature to load data to GCS. Implemented workflow management and transformation using Composer (Airflow) and Dataflow

This repo is dedicated for GCP data engineering concepts: BigTable, BigQuery, DataFlow, PubSub, DataProc Spark on GCP. Apache Beam, Apache AirFlow

GCP Dataflow pipeline with mapreduce in python

Boilerplate for batch-processing scenarios' orchestration. Apache Airflow w/ realistic product analytics use case

Apache beam sandbox w/ Dataflow for 10+ use cases

Big Data ETL Pipeline for ASL-to-Text (Computer Vision), using Apache Beam on GCP Dataflow

Github action to create dataflow templates

GCP Dataflow pipeline with BigQuery as source and side input

A data pipeline to ingest, process, store storm events datasets so we can access them through different means.

Export Dialogflow conversation logs to BigQuery with masking PII using DLP API

Trigger a Dataflow job when a file is uploaded to Cloud Storage using a Cloud Function

ETL pipeline on GCP