Lead Software Engineer(Pyspark)

Bengaluru, Karnataka, India
Aug 09, 2024
Aug 09, 2025
Onsite
Full-Time
8 Years
Job Description

The Product team at Epsilon is at the heart of our innovation, developing and scaling powerful platforms that connect millions of customers. As we continue to expand, we seek talented individuals who excel in building customized solutions in the digital marketing space.

What You'll Do

  1. Configuration Management & Automation. Establish and manage configuration, automate infrastructure, and develop CI/CD frameworks.
  2. Data Engineering. Develop modules using Python and PySpark, leveraging your expertise to create efficient data engineering solutions.
  3. Cloud Operations. Lead cloud operations, particularly on AWS and Azure, using Terraform for cloud-based deployments.
  4. Scripting & Automation. Utilize Python, Shell scripting, PowerShell, or JavaScript for automation tasks.
  5. UI & Application Development. Build and maintain UI and Java applications, ensuring seamless user experiences.
  6. Collaboration & Mentorship. Collaborate with stakeholders to understand requirements, develop solutions, and mentor junior team members.
  7. Documentation. Define, develop, and document software objectives, business requirements, and specifications.

What We're Looking For

  1. Experience. 8-10 years in cloud operations, with significant experience in AWS and Azure. Proficiency in Terraform, Python, and PySpark is essential.
  2. Automation Skills. Strong aptitude for automation, including experience with scripting languages such as Python, Shell, or PowerShell.
  3. CI/CD Pipelines. Experience in building CI/CD pipelines in cloud environments.
  4. UI & Java Development. Solid experience in building UI and Java applications.
  5. Communication. Excellent written and verbal communication skills in English, with the ability to work across multiple countries and time zones.
  6. Agile Methodologies. Familiarity with Agile methodologies, especially SCRUM.

Advantageous Experience

  1. Cloud Services. Hands-on experience with AWS CLI, Azure CLI, and Azure PowerShell.
  2. CI/CD Tools. Experience with Jenkins, GoCD, Nexus, or BitBucket.
  3. Data Engineering. Exposure to Big Data ecosystems (Spark, Kafka), SQL queries, and Databricks tools.
  4. Programming. Object-oriented and functional programming experience.

Additional Information

Epsilon is committed to diversity, inclusion, and equal employment opportunities. We strive to attract, recruit, and retain qualified individuals from diverse backgrounds, including women, people of color, LGBTQ individuals, and those with disabilities.

Apply Today

If you're a visionary engineer ready to work with cutting-edge technology and make a significant impact in the digital marketing space, we want to hear from you. Apply now and be part of a dynamic team that’s redefining the future of marketing technology!