We are seeking a Senior Data Engineer who will play a pivotal role in driving the strategy and execution of key data engineering initiatives at Visa. This role involves collaborating with cross-functional teams to prioritize projects, understand business needs, and translate them into scalable data solutions. You will be responsible for designing and implementing robust data models, developing data pipelines, and maintaining data lakes, ensuring our data infrastructure is efficient, reliable, and aligned with business objectives.
Key Responsibilities
- Requirement Analysis. Collaborate with business stakeholders to understand their needs and translate them into effective data models.
- Data Modeling. Develop conceptual data models and implement data strategies to support long-term business solutions.
- Data Pipeline Design. Create robust and scalable data pipelines and products across various domains.
- Data Integration. Build and maintain data lakes by acquiring and integrating data from primary and secondary sources.
- Testing and Deployment. Define and manage data load procedures, ensuring data quality and compliance with business rules.
- Team Leadership. Coordinate with cross-functional teams to manage and prioritize data engineering projects effectively.
- Stakeholder Collaboration. Engage with stakeholders to deliver tailored data solutions that meet their requirements.
- CI/CD Implementation. Maintain CI/CD pipelines for data solutions to facilitate seamless updates and improvements.
Technical Skills
- Extensive experience with big data tools such as Hadoop, Hive, and Spark.
- Proficient in programming languages including Scala, Python, SQL, and PySpark.
- Familiarity with Unix/Linux systems and scripting (Bash).
- Experience with data pipeline management tools like Apache Airflow.
- Proficient in both relational SQL and NoSQL databases (Postgres, Cassandra).
- Knowledge of cloud services, particularly AWS or Azure.
- Experience with stream-processing systems (Kafka, Spark-Streaming).
- Strong analytical skills for working with structured and unstructured datasets.
Other Skills
- Excellent problem-solving and organizational skills.
- Strong communication skills with the ability to collaborate effectively in a team environment.
- Detail-oriented approach with a focus on data quality and operational excellence.
Qualifications
- Basic. 7+ years of relevant experience with a Bachelor's Degree or an Advanced Degree (Master’s, MBA, JD, MD, or PhD).
Preferred
- 5+ years of experience with a Bachelor's Degree, or
- At least 3 years of experience with an Advanced Degree, or
- 1+ years of experience with a PhD.
- Exposure to the Financial Services/Payments industry.
- Proven leadership in large data engineering initiatives.
Leadership Competencies
- Demonstrates intellectual curiosity and a commitment to continuous learning.
- Exhibits integrity, maturity, and a constructive approach to business challenges.
- Respects individuals at all organizational levels.
- Strives for excellence and extraordinary results.
- Makes informed decisions aligned with business strategies and objectives.
Additional Information
Visa is an Equal Employment Opportunity (EEO) Employer. We welcome qualified applicants regardless of race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa also considers qualified applicants with criminal histories in accordance with EEOC guidelines and applicable local law.