Senior Data Engineer

As a Senior Data Engineer at Visa, you will play a crucial role in managing and driving key data engineering projects. You will be responsible for understanding business needs, creating and managing data models, and developing robust data pipelines. This role involves implementing and maintaining CI/CD pipelines for data solutions, and collaborating with various stakeholders to deliver effective data solutions. The ideal candidate will have extensive experience with big data tools such as Hadoop, Hive, and Spark, and strong programming skills in Scala, Python, SQL, and PySpark.

Essential Functions

1. Requirement Analysis. Translate business needs into data models and support long-term solutions.
2. Data Modeling. Collaborate with the Business team to implement data strategies, build data flows, and develop conceptual data models.
3. Data Pipeline Design. Create scalable data pipelines and products across various domains.
4. Data Integration. Develop and maintain data lakes by acquiring data from multiple sources and creating flexible, scalable data evaluation scripts.
5. Testing. Manage data load procedures to ensure datasets meet business rules and quality thresholds.
6. Deployment. Implement data strategies, develop physical data models, and work with development, data analyst, and information system teams to ensure robust data management systems.
7. Team Leadership. Coordinate with teams to manage and prioritize projects.
8. Stakeholder Management. Collaborate with stakeholders to understand and address their data needs.
9. CI/CD. Implement and maintain CI/CD pipelines for data solutions, ensuring efficient updates to the data environment.

Technical Skills

1. Big Data Tools. Extensive experience with Hadoop, Hive, and Spark.
2. Programming Languages. Proficiency in Scala, Python, SQL, and PySpark.
3. Systems & Tools. Experience with Unix/Linux systems and scripting in Bash, data pipeline tools like Airflow, relational SQL and NoSQL databases (Postgres, Cassandra), and cloud services (AWS or Azure).
4. Stream-Processing. Experience with stream-processing systems such as Kafka and Spark-Streaming.
5. Analytical Skills. Strong skills in working with both structured and unstructured datasets, and understanding data transformation, structures, and metadata.

Other Skills:

1. Problem-Solving. Strong analytical and problem-solving abilities.
2. Communication. Excellent communication and teamwork skills.
3. Organizational Skills. Detail-oriented with excellent organizational abilities.

Qualifications

• 7+ years of work experience with a Bachelor’s Degree in a relevant field (or an Advanced Degree such as Master’s, MBA, JD, MD, or PhD).
• 5+ years of experience with a Bachelor’s Degree or 3+ years with an Advanced Degree (Master’s, MBA, JD, MD) or 1+ years with a PhD.
• Exposure to the Financial Services/Payments industry.
• Proven leadership skills and experience leading large data engineering initiatives.

Leadership Competencies

1. Intellectual Curiosity. A desire for continuous learning and improvement.
2. Integrity. Demonstrates integrity, maturity, and a constructive approach to business challenges.
3. Respect. Shows respect for individuals at all levels in the workplace.
4. Excellence. Strives for excellence and extraordinary results.
5. Decision-Making. Uses sound insights and judgments to make informed decisions aligned with business strategy and needs.
6. Influence. Ability to persuade and influence internal stakeholders to build best-in-class solutions.

Additional Information

Visa is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa also considers qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.