As a Data Engineer specializing in DBT (Data Build Tool) and Azure Databricks, you will play a critical role in designing, developing, and maintaining high-quality, scalable data transformation workflows. Your focus will be on building robust data pipelines, aligning technical solutions with business objectives, and ensuring the performance, reliability, and scalability of our data systems.
Responsibilities
- Designing and implementing best practices for DBT projects to ensure clean, efficient, and maintainable data workflows.
- Building and optimizing SQL models in DBT to enable structured, analytics-ready data sets.
- Collaborating with cross-functional teams including data analysts, engineers, and business stakeholders to translate business requirements into scalable data transformations.
- Creating and maintaining documentation for data transformation logic and DBT model lineage.
- Monitoring, debugging, and tuning data pipelines to ensure performance, reliability, and accuracy.
- Working extensively with Azure cloud components especially Azure Databricks and data lake storage for processing and storing large-scale data.
- Ensuring raw and unstructured data ingested from various sources is transformed into reliable and structured formats suitable for downstream analytics and reporting.
Preferred Education
-
Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field. However, equivalent work experience and proven expertise are equally valued.
Required Technical & Professional Expertise
- Proven hands-on experience with MS SQL Server and strong proficiency in writing complex SQL queries.
- Solid experience working with DBT (Data Build Tool) in a production environment, especially with incremental models, testing, documentation, and version control.
- Deep understanding of data modeling concepts and best practices in a modern cloud-based architecture.
- Experience working in Azure-based cloud ecosystems, including Databricks, Data Lake, and Azure Data Factory (ADF).
- Strong understanding of ELT/ETL patterns and data transformation principles using DBT.
- Demonstrated ability to ingest and structure raw, messy data into optimized datasets for analysis and visualization.
Preferred Technical & Professional Experience
- Demonstrated ability to build and enforce standardized DBT project structures and implement testing frameworks.
- Experience designing reusable data pipelines and transformations for scalable performance.
- Familiarity with CI/CD processes and Git integration in DBT workflows.
- Knowledge of orchestration tools (e.g., Airflow or Azure Data Factory) to schedule and monitor DBT pipelines.
- Strong interpersonal and communication skills, with a collaborative mindset and an ability to work across diverse teams.
Why Join Us?
- Work on cutting-edge cloud and data technologies in a highly collaborative, fast-paced consulting environment.
- Get exposure to a broad range of industries and complex data challenges.
- Be part of a team where innovation, learning, and growth are part of everyday life.
- Access IBM’s world-class training and career development programs to keep your skills sharp and relevant.
Join IBM Consulting’s Client Innovation Center, where we blend deep technical expertise with industry knowledge to help global clients solve complex problems and drive transformative digital change. At our Delivery Centers, you’ll be part of a collaborative and agile team delivering locally focused technology solutions with global impact. If you're passionate about turning raw data into powerful business insights and want to work at the forefront of cloud and data transformation, this is your opportunity.