Logic App to Trigger Azure Data Factory Pipeline

Introduction

Azure Logic Apps and Azure Data Factory are powerful services that can automate and streamline data workflows. In this blog, I'll walk you through the steps to create a Logic App that connects with Azure Data Factory and triggers a pipeline run.

Azure Logic Apps is a cloud service that helps you schedule, automate, and orchestrate tasks, business processes, and workflows. Azure Data Factory (ADF) is a cloud-based data integration service that allows you to create data-driven workflows for orchestrating data movement and transforming data at scale.

By integrating Logic Apps with Data Factory, you can automate the triggering of ADF pipelines, creating a seamless data workflow.

Steps to create a logic app that triggers an ADF pipeline run

Design the logic app workflow

Go to the Logic Apps Designer.
Choose a trigger for your Logic App. For example, you can use an HTTP trigger, a schedule trigger, or any other available trigger based on your requirements.

Add an action to trigger the ADF pipeline

After adding the trigger, click on "New step" to add an action.
Search for "Data Factory" and select the "Create a pipeline run" action.
Create a Connection to Connect Data Factory using OAuth/ServicePrincipal/Managed Identity. Note: Managed Identity is recommended.
Configure the action by selecting your Data Factory, specifying the pipeline name, and providing the necessary parameters for the pipeline run.

Save and test the logic app

Save your Logic App.
Trigger the Logic App using the configured trigger (e.g., send an HTTP request, wait for the schedule, etc.) or use the Run Option to Trigger.
Verify the Logic App Run History.
Verify that the ADF pipeline is triggered by checking the pipeline runs in your Data Factory. DataFactory -> Launch Studio -> Monitor -> Pipeline Runs.

This powerful combination of Logic App and Data Factory services can help you build robust and automated data workflows, improving efficiency and productivity.