Our client is seeking a skilled Data Engineer for a remote position based in India. The successful candidate will be responsible for designing, building, refactoring, and maintaining data pipelines to meet business requirements for reporting, analysis, and data science. This role involves working with various technologies including Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.
Responsibilities
- Data Pipeline Management. Design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science.
- Standards and Best Practices. Teach, adhere to, and contribute to DataOps and MLOps standards and best practices to accelerate and continuously improve data system performance.
- Pipeline Enhancements. Design and integrate fault tolerance and enhancements into data pipelines to improve quality and performance.
- Problem Solving. Perform root cause analysis and solve problems using analytical and technical skills to optimize data delivery and reduce costs.
- Mentorship. Mentor junior Data Engineers, providing guidance and support to help them grow their skills.
Required Skills and Experience
- Educational Background. Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or an equivalent combination of data engineering professional experience and education.
- Professional Experience. At least 3 years of proven Data Engineering experience.
Technical Proficiency
- Experience with Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, Power BI, or other cloud-based data systems.
- Experience with Azure DevOps, GitHub, and CI/CD processes.
- Experience with various database storage systems such as cloud, relational, mainframe, data lake, and data warehouse.
- Experience building cloud ETL pipelines using code or ETL platforms utilizing database connections, APIs, or file-based methods.
- Data Warehousing and Methodology. Demonstrated experience with data warehousing concepts and agile methodology.
- Data Manipulation. Experience designing and coding data manipulations, applying processing techniques to extract value from large, disconnected datasets.
- Continuous Learning. Commitment to continuous learning to upskill data engineering techniques and business acumen.
Why Join Us?
- Remote Work. Enjoy the flexibility of working from home, balancing your professional and personal life effectively.
- Professional Growth. Work in a dynamic environment that encourages continuous learning and professional development.
- Mentorship Opportunities. Grow your career by mentoring junior data engineers and honing your leadership skills.
This is a fantastic opportunity for a Data Engineer looking to take their career to the next level. If you have the skills and experience required, we would love to hear from you! Apply today and join a team committed to innovation and excellence.