Senior Databricks Data Engineer

Noida, Uttar Pradesh, India
Aug 08, 2024
Aug 08, 2025
Remote
Full-Time
3 Years
Job Description

We are excited to expand our team for projects in the Middle East, working with cutting-edge technologies on high-impact platforms. Our team consists of front-end and back-end developers, data analysts, data scientists, architects, and project managers. As a key player, you'll be integral to the ongoing evolution of our high-performance platforms. If you’re eager to be part of a dynamic and fast-paced environment, this role is an exceptional opportunity!

Responsibilities

  1. Collaborate with Business SME. Work closely with subject matter experts to define and implement data validation rules.
  2. Understand Business Needs. Translate business requirements into data-driven insights and solutions.
  3. Analyze Data. Gain a deep understanding of data flow and underlying structures.
  4. Platform Expertise. Familiarize yourself with the overall platform architecture to ensure effective data loading and integration.
  5. Adapt to Changes. Stay agile and responsive to changes in business processes and requirements.

Mandatory Skills

  1. Experience. Minimum of 7 years in a relevant field.
  2. Azure Databricks. Proficient with 3+ years of hands-on experience.
  3. Python and PySpark. Advanced skills with at least 5 years of experience.
  4. SQL. Strong expertise with 5+ years in complex data analysis.
  5. Data Platforms. Knowledge of Azure Data Lake/Delta Lake, data lake house architecture, and business intelligence.
  6. Development Practices. Proficient in Azure DevOps, CI/CD, and Git.
  7. Documentation Skills. Ability to prepare design documents, unit test plans, and code review reports.
  8. Agile Environment. Experience with Scrum and Agile methodologies is a plus.
  9. Communication. Excellent interpersonal and communication skills, both oral and written, with the ability to convey complex concepts clearly.
  10. Education. Bachelor's degree in IT, Computer Science, or a related field.

Nice-to-Have Skills

  • Financial Knowledge. Familiarity with financial markets, portfolio theory, and risk management is an advantage.

Languages

  • English. Proficiency at C2 level (Advanced)

Why Join Us?

Be part of an innovative team working on impactful projects in the Middle East. You’ll have the chance to work with modern technologies and contribute to evolving high-performance platforms in a dynamic, fast-paced environment.

Apply Now!

If you’re ready to take on this exciting challenge and make a significant impact, we’d love to hear from you. Apply today to join our team!