As a Senior Data Engineer in the RSS team, you will play a key role in designing, developing, and implementing data-driven strategies and solutions for Visa clients. This position requires deep expertise in banking and payments, along with a strong background in building and maintaining data pipelines. Your role will involve solving complex data challenges and unlocking business value through innovative solutions.
Responsibilities
- Data Pipeline Development. Develop, maintain, and support big data ETL pipelines using technologies such as Hadoop, Hive, and Spark.
- Scalable Solutions. Implement and test scalable distributed systems to ensure data security, timeliness, and quality.
- Production Support. Provide support for production systems and resolve any issues that arise.
- Collaboration. Work closely with engineers and peers to design and develop efficient ETL pipelines.
- Requirements Analysis. Collaborate with product managers to understand and clarify requirements.
- Continuous Learning. Demonstrate a commitment to continuous learning and professional development. Quickly acquire new skills and knowledge in a fast-paced environment.
Qualifications
- Bachelor’s Degree or Advanced Degree (e.g., Masters, MBA, JD, MD, or PhD) with 2 or more years of relevant work experience.
- 5+ years of work experience with a Bachelor’s degree, or 4+ years with a Master’s or Advanced degree in an analytical field such as Computer Science, Statistics, Finance, Economics, or a related area.
- Extensive experience with the Hadoop ecosystem and associated technologies (e.g., Apache Spark).
- Proficiency in writing Spark and Hive code for processing large datasets in Hadoop environments.
- Strong SQL skills for extracting, aggregating, and processing big data.
- Development experience in one or more of the following languages: Scala, Python, or Java.
- Basic experience with Unix/Shell or Python scripting.
- Familiarity with scheduling tools like Airflow and Control-M is a plus.
- Experience with version control systems (VCS) like Git.
- Basic understanding of RDBMS such as MS SQL, DB2, Oracle for data retrieval.
- Knowledge of Kafka and Apache Hudi is a plus.
Additional Information
- Work Arrangement. This is a hybrid position, requiring employees to work from the office 2-3 set days a week, with a general guidepost of being in the office 50% or more of the time based on business needs.
Visa is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa will also consider qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local laws.