Lead Data Engineer

Bangalore Urban, Karnataka, India
Aug 08, 2024
Aug 08, 2025
Onsite
Full-Time
6 Years
Job Description

We are seeking an experienced Senior Data Engineer to join our Data Platform team. In this role, you will be at the forefront of building innovative data products that scale to meet industry standards. You’ll work on designing and implementing fault-tolerant feature stores, real-time data pipelines, and data catalogs, among other exciting challenges.

Key Responsibilities

  • Develop and manage scalable data pipelines using Spark and Scala.
  • Build and maintain fault-tolerant feature stores to support various data applications.
  • Implement real-time data processing solutions with technologies like Kafka and Debezium.
  • Integrate and manage data sources using tools such as Aerospike, DataBricks, EMR, Athena, Glue, RocksDB, Redis, and more.
  • Design and optimize data workflows using Airflow.
  • Collaborate with cross-functional teams to understand data needs and deliver solutions.
  • Ensure data integrity, accuracy, and availability across all systems.

Required Skills and Experience

  1. Experience. 6+ years in a data engineering role, with a strong background in E-Commerce preferred.
  2. Hands-on Expertise. Proficient in Spark and Scala.

Technologies

  1. Data Stores. Aerospike, Redis, RocksDB, MySQL.
  2. Data Pipelines. Kafka, Debezium, Airflow.
  3. Data Platforms. DataBricks, EMR, Athena, Glue.
  4. Other Data Sources. MongoDB, Neo4J.
  5. Industry Preference. Experience in the E-Commerce industry is highly desirable.

Why Join Us?

  • Work on cutting-edge technologies and projects that have a significant impact on user experience.
  • Be part of a vibrant team that thrives on innovation and creativity.
  • Enjoy a dynamic work environment where your contributions directly influence the success of our platform.

How to Apply

If you’re excited about this opportunity and have the required skills and experience, please submit your application. Join us at MakeMyTrip and help shape the future of travel!

MakeMyTrip is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Related Jobs