Azure Data Engineering

About Course

Learn Azure Data Engineering through a practical, industry-oriented program focused on building modern cloud-based data solutions. This course covers Azure data engineering fundamentals, data ingestion, data transformation, data storage, ETL/ELT pipelines, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, SQL, and data processing concepts. You’ll learn how to design and implement scalable data pipelines that can collect, transform, and organize data from multiple sources.

Duration: 16 Weeks

Category: Coding/Development

Skill Level: Beginner – Intermediate

Modules: 16

Subjects & Expertise

With expertise in Microsoft Azure and cloud data engineering, the training focuses on data ingestion, transformation, orchestration, storage, analytics, and pipeline development. Learners will understand how different Azure data services work together to build modern, scalable, and secure data platforms for enterprise applications.

The course combines instructor-led sessions with hands-on labs, real-world datasets, practical assignments, and end-to-end data engineering projects. Students gain experience working with Azure Data Factory, Data Lake Storage, Synapse Analytics, SQL, data pipelines, data transformations, monitoring, and performance optimization.

Weeks

Week 1

Data Engineering Fundamentals
OLTP vs OLAP
ETL vs ELT
Data Lake vs Data Warehouse
Medallion Architecture

Week 2

Azure Fundamentals
Resource Groups
Storage Accounts
Azure Portal
Monitoring Basics

Week 3

ADLS Gen2
Containers
Access Control
Lifecycle Management
Storage Best Practices

Week 4

Data Warehouse Modeling
Star Schema
Snowflake Schema
Fact & Dimension Tables
SCD Concepts

Week 5

ADF Architecture
Linked Services
Datasets
Pipelines
Triggers

Week 6

Copy Activity
SQL to ADLS
File Ingestion
Performance Optimization

Week 7

ADF Parameters
Variables
Lookup Activity
ForEach Activity
Dynamic Pipelines

Week 8

Incremental Load
CDC Concepts
Watermark Logic
Error Handling
Audit Framework

Week 9

Azure Databricks
Clusters
Notebooks
Workspace Management

Week 10

PySpark DataFrames
Transformations
Actions
File Processing

Week 11

Joins
Aggregations
Window Functions
Partitioning
Caching

Week 12

Delta Lake
MERGE
Time Travel
Bronze-Silver-Gold Architecture

Week 13

Azure Synapse
Dedicated SQL Pool
Serverless SQL Pool
Reporting Layer

Week 14

RBAC
Managed Identity
Azure Key Vault
Data Security
Governance

Week 15

Azure DevOps
Git Integration
CI/CD
Release Pipelines

Week 16

Capstone Project
ADF
Databricks
ADLS
Synapse
Interview Preparation