Data Engineering using ADF | Azure Data Engineer | Data Mapping Flows | SQL Stored Procedure | Data Engineering
Use Azure data factory to automate data engineering tasks. This is a great course to introduce yourself to Azure Data Factory’s capabilities. We’ll look at the data factory from a data engineer perspective.
Through examples we’ll work side by side to create an Extract Transform and Load process to ingest movie rating data.
We are going to explore three different ways to transform your data.
The first is by using Azure Data Mapping flows. These are great no-code ways to do ETL.
We’ll then look at how you can do the same transformations using Python. This way, if you love Python, you know a solid way to use Azure data factory to work with your data.
Lastly, we’ll look at how you can create pipelines to use your knowledge of SQL and stored procedures.
What you’ll like about this course is that once you learn one way to transform the data, you can use that knowledge to learn about the other methods. So, if you’re a SQL expert but soft on python, you can learn the SQL way first, then go back and try it using Python. In the end you come out learning and appreciating alternative methods to ingesting, transforming, and storing data.
