Are you passionate about shaping the future of data and analytics architecture? Network18 Media & Investments Limited is seeking a talented Lead Data Engineer to join our team in Noida, Uttar Pradesh, India. If you have 8-10 years of experience in high-performance data products or data systems, we want to hear from you!
Key Responsibilities
- Lead the design and implementation of data & analytics architecture to ensure compliance, quality, and sustainable platform growth.
- Build scalable end-to-end data pipelines to integrate and model datasets from different sources, meeting functional and non-functional requirements.
- Manage the technical scope and architecture of projects throughout their lifecycle.
- Collaborate with product, business, and functional stakeholders to understand data requirements and downstream analytics needs.
- Translate business requirements and end-to-end designs into technical implementations based on system capabilities.
- Define and promote reusable, extensible, scalable, and maintainable solutions.
- Foster a data-driven culture throughout the team and drive innovation.
- Communicate clearly and credibly about the importance of solution design at all levels.
Required Experience, Skills & Qualifications
- 8-10 years of relevant experience working with high-performance data products or data systems as a Data Architect/Engineer.
- Advanced level proficiency in designing and developing data products and orchestration tools/services.
- Proficiency in software engineering best practices, such as unit testing, integration testing, and software development tools.
- Extensive experience in at least one cloud platform with big data services (e.g., EMR, Databricks).
- Relevant experience in databases (columnar, NoSQL, and MPP databases: Redshift, DynamoDB, Aurora, Postgres, Google BigQuery, and/or Snowflake), along with best practices in portioning and clustering tables for efficient performance.
- Awareness of security compliances and design practices.
- Exceptional interpersonal, analytical, and communication skills, including the ability to explain and discuss DevOps concepts with colleagues and teams.
- Full adherence to and evangelization of an entire CI/CD pipeline.
- Understanding of API development and use of JSON/XML as data formats.
- Knowledge and hands-on experience with data engineering tools for any cloud provider (e.g., Apache Kafka, Apache Flink, Amazon S3, AWS Glue, Apache Airflow, Apache Spark).
If you're ready to drive innovation and deliver impactful data solutions, apply now! Join us in fostering a data-driven culture and shaping the future of data architecture.