This Repo Contains Azure Data Engineering Projects
-
Updated
Feb 8, 2024 - Python
This Repo Contains Azure Data Engineering Projects
This is my Azure DP-203 Project Submitted to NTT Data Services, contains Problems Questions with Solutions.
Data pipeline project (ELT using Microsoft Azure)
This repository documents my personal journey into the world of Azure, where I've taken my first steps into this platform. With no prior experience in Azure, I embarked on a project to understand and leverage various services including Azure Data Factory, Databricks, and Synapse Analytics.
Azure Logic App to Pause, Resume, Dial-Up and Dial-Down a Azure Synapse Dedicated SQL Pool
O objetivo deste projeto foi aplicar os conhecimentos nas ferramentas de extração e tratamento de dados da plataforma Azure.
End-to-End data engineering project with Azure Databricks as cloud service and Tokyo olympic data
A GitHub Actions/Azure DevOps implementation of a CI/CD workflow for Azure Synapse or Azure SQL Database
Data Integration Pipelines for NYC Payroll Data Analytics
Azure Synapse Analytics configuration, settings and playground
Learn Azure services.
DP-203 extra SQL, PySpark and ADF code samples
The data is extracted in batches using Azure Data Factory. and transformed using Spark in Azure Databricks. The transformed data is stored in Synapse Analytics in columnar format. Finally, a dashboard is created using Looker Studio or Power BI to display sales data, customer analysis, and other information
Data Integration Pipelines for NYC Payroll Data Analytics
Infrastructure as Code (IaC) for synapse-dataplatform repo
This hands-on-tutorial how to set up an Azure data lake in a few clicks and run queries on it.
Short tutorials on how to use Azure services
Add a description, image, and links to the synapse-analytics topic page so that developers can more easily learn about it.
To associate your repository with the synapse-analytics topic, visit your repo's landing page and select "manage topics."