In the previous article, we learned about Azure Data Factory. We’ve had a brief introduction to Azure Datasets and an understanding of the pipeline in Azure Data Factory. In this article, we’ll go ahead and create the Azure Data Factory from the Azure Portal. Next, we’ll learn to create datasets in the Azure Data Factory Studio, create a pipeline and learn to debug and trigger the pipeline.
Azure Data Factory
Azure Data Factory is an offering of Azure that enables the management and building of highly complex hybrid extract-transform-load (ETL), data integration projects, and extract-load-transform (ELT). Azure Data Factory makes it possible to orchestrate as well as operationalize the processes which are essential to refine the plethora of raw data accumulated in the big data into business insights that can serve the businesses in multitudes of dimensions.
Let us learn to create the Azure Data Factory in Azure and learn to create datasets, pipeline, debugging, and triggering of the Azure Data Factory pipeline.
Step 1
Log in to the Azure Portal. The welcome page will look similar to the one below.

Here, click on Create a Resource.

Step 2
Now, under the Categories, check for integration.

Now, we have the list of popular Azure services listed. Here, select the Data Factory.
Step 3
Next, choose your resource group or create one if you don’t have one.

Step 4
Next, name your instance, select the region and the version. The V2 is recommended as of May, 2022.

Step 5
Now, go to the Git Configuration.

Here, you have the option to setup the Github account by providing the github account link, repo name and branch with the root folder details or using Azure DevOps.

For now, select Configure Git Later. When you really need to integrate github in future, make sure the setup is chosen.
Step 6
Next, Click on Review + Create.
Step 7
As the validation is done, we have the Create option. Select it.

Step 8
The initialization process for the deployment initiates.

As the deployment is completed, we have the Go to Resource option. Click on it.

Step 9
Here, we can see the Data Factory being created. We can see different monitoring visualizations too.
For now, click on Open Azure Data Factory Studio to explore the Azure Data Factory.

Step 10
We are now welcomed to the Data Factory in Azure.

























Join the conversation! Your thoughts help the community grow.