What you'll learn

1. You will learn how to Architect, Design and build a real-world enterprise level data platform solution including multiple services.
2. You will learn design solution using ADF, Azure Function, Databricks, pyspark, Azure Data lake storage Gen 2 (ADLS), Azure SQL Server
3. You will learn how to build a real-world data pipeline in Azure Data Factory (ADF). This course has been taught using 2 real world use case scenarios.
4. You will learn how to transform data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
5. You will learn how to build production ready pipelines and good practices and naming standards.
6. You will learn how to integrate Databricks with ADF and send the response back from Databricks to ADF
7. You will learn how to develop the triggered based Azure Function to validate files.
8. You will learn how to create Azure Key vault and use it to store secret credentials and SAS token
9. You will learn how to connect the Azure SQL Database and Databricks cluster using the Key Vault
10. You will learn how to mount he Azure Storage Account in the Databricks to access the files and preform transformation on it.
11. You will learn how to transform the data in the Azure Databricks using the pyspark.