We are seeking a highly skilled Senior Data Engineer to lead and mentor our data engineering team in Bengaluru. This role involves overseeing data engineering projects, designing and implementing data models and pipelines, and collaborating with stakeholders to deliver impactful data solutions. The ideal candidate will have extensive experience with big data tools, strong analytical skills, and proven leadership abilities.
Key Responsibilities
- Project Management. Lead and manage large-scale data engineering projects, including requirement gathering, estimation, and execution.
- Data Modeling. Collaborate with business teams to translate requirements into data models and strategies, ensuring long-term solutions.
- Data Pipeline Design. Design and develop robust and scalable data pipelines and data products across various domains.
- Data Integration. Build and maintain data lakes by integrating data from multiple sources, and develop scripts to enhance data evaluation processes.
- Testing & Deployment. Define data load procedures, ensure data quality, and implement data strategies in collaboration with development and data teams.
- Continuous Integration/Deployment (CI/CD). Implement and manage CI/CD pipelines for efficient updates to data solutions.
- Team Leadership. Mentor and guide a team of data engineers, managing project priorities and driving strategic initiatives.
- Stakeholder Collaboration. Work with stakeholders across the organization to understand their data needs and deliver tailored solutions.
Qualifications
- Extensive experience with big data tools like Hadoop, Hive, and Spark.
- Proficiency in Scala, Python, SQL, and PySpark.
- Familiarity with Unix/Linux systems and scripting in Bash.
- Experience with data pipeline management tools like Airflow.
- Knowledge of relational and NoSQL databases, including Postgres and Cassandra.
- Experience with cloud services (AWS or Azure) and stream-processing systems (Kafka, Spark-Streaming).
- Strong analytical skills with the ability to work with both structured and unstructured datasets.
- Strong problem-solving abilities and excellent communication skills.
- Proven leadership experience with the ability to manage and mentor a team.
- Detail-oriented with excellent organizational skills.
- Exposure to the financial services or payments industry is a plus.
Education and Experience
- Bachelor’s degree with 8+ years of relevant experience, or a Master’s degree with 5+ years of experience, or a PhD with 3+ years of experience.
Leadership Competencies
- Exhibits intellectual curiosity and a commitment to continuous learning.
- Demonstrates integrity, maturity, and a constructive approach to challenges.
- Acts as a role model for Visa’s core values and strives for excellence.
- Utilizes sound judgment to make informed decisions aligned with business strategy.
- Influences senior management and stakeholders effectively.
Additional Information
Visa is an Equal Employment Opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa also considers qualified applicants with criminal histories in accordance with EEOC guidelines and applicable local laws.
Apply Now. If you are ready to leverage your data engineering expertise in a dynamic environment and lead a team to success, we invite you to apply for this exciting opportunity.