Are you passionate about building efficient, scalable, and secure data platforms? We are looking for a highly skilled and experienced Data Engineer with strong expertise in Snowflake, data ingestion, and data transformation to join our growing data engineering team. This is an exciting opportunity to work with a dynamic and collaborative group of professionals, contributing to large-scale data modernization initiatives and cloud migration projects.
As a core member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines and storage solutions, primarily on Snowflake, while leveraging cutting-edge tools like Snowpark, DBT, and Apache Spark. You’ll play a pivotal role in shaping our data architecture, ensuring robust performance, high reliability, and seamless integration across systems.
Key Responsibilities
- Design, develop, and maintain scalable and efficient ETL/ELT data pipelines using Snowflake, DBT, and Snowpark.
- Migrate data solutions from on-premises systems, particularly Big Data platforms, to Snowflake, ensuring minimal disruption and maximum performance.
- Analyze existing data architectures (including Hadoop, Hive, and HDFS) and optimize them for performance and cost-effectiveness in Snowflake.
- Implement CI/CD pipelines using Jenkins and manage workflow automation with CTRL-M or similar tools.
- Ensure data integrity, accuracy, and quality through rigorous testing, monitoring, and validation of data processes.
- Collaborate closely with data analysts, data scientists, architects, and business stakeholders to understand data requirements and translate them into scalable engineering solutions.
- Leverage advanced SQL and scripting languages like Python or Scala to build and optimize data transformations, queries, and performance tuning.
- Drive improvements in data architecture design, coding standards, and data integration best practices.
- Contribute to data modeling efforts, including both OLTP and OLAP models, supporting analytical and operational use cases.
- Provide guidance and mentorship to junior engineers, fostering a culture of knowledge sharing and continuous improvement.
- Stay current with advancements in data engineering tools, cloud technologies (especially Azure), and industry trends to bring innovative solutions to the team.
Required Qualifications & Skills
- 3 to 7 years of overall experience in data engineering, with at least 2+ years of hands-on experience implementing data warehouses on Snowflake.
- Strong knowledge of Snowflake architecture, including virtual warehouses, micro-partitioning, and performance tuning techniques.
- Proficiency with Apache Spark, Hive, HDFS, and experience in distributed computing frameworks.
- Practical experience with CI/CD pipelines and workflow orchestration tools like Jenkins and CTRL-M.
- Solid experience working on cloud platforms, preferably Microsoft Azure, with a focus on data services (e.g., Azure Data Factory, Azure Blob Storage, etc.).
- Advanced expertise in SQL and scripting in Python or Scala.
- Strong understanding of data modeling, data integration, and building robust, scalable data pipelines.
- Experience with data migration projects, especially moving from Big Data platforms to Snowflake.
- Sound knowledge of data security, governance, and compliance standards.
- Familiarity with version control systems (e.g., Git) and Agile development practices.
- Strong problem-solving skills and the ability to troubleshoot and optimize complex data workflows.
- Experience in mentoring and guiding junior data engineers or team members is a plus.
Preferred Skills (Nice to Have)
- Certifications in Snowflake, Azure, or other relevant cloud/data technologies.
- Experience with additional data tools like Airflow, Talend, or Informatica.
- Exposure to BI tools like Power BI, Tableau, or Looker.
- Knowledge of containerization tools such as Docker and orchestration platforms like Kubernetes is an advantage.
What We Offer
- A collaborative, inclusive, and flexible work environment.
- Opportunities to work on cutting-edge technologies and cloud-native data solutions.
- Competitive salary and benefits package.
- Continuous learning and development through training programs and certifications.
- The ability to work with a talented team on challenging and rewarding data initiatives.
Join Us
If you're an experienced Data Engineer ready to take your Snowflake skills to the next level and make a measurable impact, we would love to hear from you. Apply now to be part of a high-performing team shaping the future of our data ecosystem.