We are looking for a Lead Data Engineer to join our dynamic team, with a specialized focus on Databricks and data engineering. As a Lead Consultant, you will work on cutting-edge data solutions, leading a team of 15 members across multiple tracks, ensuring the successful design and implementation of data pipelines. This role demands strong expertise in Databricks, data modeling, and database design, with a passion for leading teams in a fast-paced, high-performance environment.
Key Responsibilities
- Lead and Mentor. Lead a team of 15 engineers, managing multiple tracks and ensuring efficient project execution.
- Databricks Expertise. Leverage your deep experience in Databricks to design and optimize data pipelines.
- Data Engineering. Build and optimize data processing pipelines using technologies like SQL, Spark, Hive, Python, and Airflow.
- Performance Optimization. Ensure high performance of data pipelines through continuous improvements.
- Data Modeling & Infrastructure. Apply knowledge of data modeling and databases, including data lakes and data warehouses.
- Event-Driven Architecture. Utilize event-driven architecture for seamless data processing.
- Team Collaboration. Drive collaboration and foster an environment of learning and growth within the team.
Qualifications
Minimum Qualifications
- Strong Data Engineering Expertise. Proven experience in building data pipelines and optimizing their performance.
- Technological Proficiency. Hands-on experience with Databricks, SQL, Spark, Hive, Python, and Airflow.
- Data Modeling Knowledge. Solid understanding of data modeling and data infrastructure (databases, data lakes, data warehouses).
- Leadership Skills. Experience leading teams, with the ability to self-start and work independently.
- Adaptability. Quick learner who can thrive in a fast-paced development environment.
- Excellent Communication. Strong communication skills to manage project expectations and drive progress.
Preferred Qualifications
- Microservices Experience. Knowledge of microservices architectures and their integration with data pipelines.
- Real-Time Data Processing. Familiarity with implementing real-time data processing solutions.
- AWS Knowledge. Hands-on experience with AWS services like SQS, EC2, and related technologies.
- Software Engineering Background. Experience in software engineering practices, with an emphasis on efficient code development.
Why Genpact?
At Genpact, we celebrate diversity, innovation, and integrity. We create a dynamic and inclusive work environment where ideas thrive and collaboration is key. We offer opportunities for continuous learning, growth, and leadership, all while working on impactful projects that drive change across industries.
Equal Opportunity Employer
Genpact is committed to building a diverse and inclusive workforce. We offer equal employment opportunities without discrimination on the basis of race, color, religion, gender, sexual orientation, age, disability, or any other characteristic protected by applicable laws.