As an Azure Data Engineer at Epsilon, you will be an integral part of our Data Engineering team within the Digital Experience organization. You will focus on developing and integrating data solutions that enhance marketing strategies for Epsilon's clients. This is a highly visible role, requiring collaboration with internal teams and external clients to deliver impactful, client-centric data-driven marketing solutions.
You will be responsible for working on the development and integration of data onto multiple Customer Data Platform (CDP) platforms. You will also ensure that the marketing data mart supports campaign creation, monitors data health, and optimizes processes for efficient data handling.
Key Responsibilities
- Development & Integration. Build and integrate marketing data solutions using Azure technologies, including ADF pipelines, Databricks, Pyspark, and SQL, to support the Marketing Data Mart for clients, particularly in the pharmaceutical industry.
- ETL Processes. Design, develop, and maintain efficient ETL processes that support both batch and real-time data ingestion. Ensure optimal data flow and performance, addressing issues like data extraction failures and performance tuning.
- Cross-Functional Collaboration. Work closely with business and technical teams to gather requirements, understand business goals, and ensure alignment across development and implementation. Clearly communicate complex technical processes and outcomes to stakeholders.
- Pipeline Management. Monitor and support pipeline operations, including performance monitoring, ingestion maintenance, and data load failures. Implement incremental data load strategies.
- Platform Support. Manage and enhance integration with CDP platforms, including Salesforce Marketing Cloud and Tealium, and ensure seamless data synchronization with other downstream systems.
- Automation & CI/CD. Set up and maintain automated test suites for ETL pipelines. Implement CI/CD pipelines for streamlined deployment and continuous improvement of the data engineering processes.
- Documentation & Testing. Ensure detailed documentation for all technical processes, data models, and system designs. Develop and test software and environment configurations to meet user needs and achieve business objectives.
Required Qualifications
Technical Skills
- Proficiency in Azure Data Factory (ADF), Databricks, Pyspark, SQL, and PL-SQL.
- Experience in designing and implementing serverless applications using Azure Functions and Azure Logic Apps.
- Strong knowledge of Azure Data Lake solutions and data pipeline development (both batch and real-time).
- Experience in building and optimizing ETL pipelines using cloud technologies (Azure, Databricks, Spark).
- Experience with automated testing and CI/CD pipelines for ETL workflows.
Business & Communication Skills
- Strong analytical skills with the ability to translate business needs into technical requirements.
- Excellent written and verbal communication skills to articulate complex technical concepts to both technical and non-technical audiences.
- Ability to collaborate effectively with cross-functional teams, including developers, project managers, business stakeholders, and clients.
Experience
- 3+ years of experience in data engineering, particularly in Azure cloud technologies.
- Experience with data mart design, ETL processes, and working with marketing data.
- Knowledge of Salesforce Marketing Cloud or Tealium CDP platforms is a plus.
- Familiarity with Agile/Scrum methodologies.
Why Epsilon?
- Innovative Environment. Work on cutting-edge, high-profile projects that directly impact leading global brands.
- Career Growth. Opportunities for career development in a fast-paced, entrepreneurial team.
- Client Interaction. Work closely with clients to understand and meet their business goals.
- Collaborative Culture. Join a team of passionate, business-oriented professionals who strive to deliver impactful results.
- Recognition & Benefits. Epsilon has been recognized as a Great Place to Work, offering a supportive and inclusive environment with competitive benefits.
How to Apply
If you're an immediate joiner based in Bangalore and have the necessary experience in Azure data engineering, ETL, and marketing data integration, we’d love to hear from you. Apply today to be part of our innovative team and help shape the future of marketing data solutions at Epsilon.