We are looking for a Senior Data Engineer to join our Risk Solution Services (RSS) Team in Bangalore, India. As a key member of the team, you will be responsible for designing, developing, and implementing scalable data-driven solutions that empower risk consultants with actionable insights. You will work with large-scale datasets, optimize data pipelines, and contribute to the continuous improvement of our fraud detection frameworks.
This role requires a strong background in big data processing, ETL pipeline development, and distributed computing frameworks such as Hadoop, Hive, and Spark. The ideal candidate will have hands-on experience with SQL, Scala, Python, and Java along with a deep understanding of data engineering best practices.
Key Responsibilities
- Design, develop, and maintain big data ETL pipelines to support risk analytics and fraud detection models.
- Develop scalable, distributed data processing solutions ensuring data security, integrity, and efficiency.
- Optimize existing data pipelines for performance, reliability, and scalability.
- Work closely with risk consultants, data scientists, and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop and enhance data ingestion, transformation, and storage frameworks using technologies like Hadoop, Hive, Spark, and Apache Hudi.
- Collaborate with cross-functional teams to improve Visa’s risk mitigation strategies through data insights.
- Support production systems and troubleshoot data pipeline issues to ensure seamless data processing.
- Implement data governance best practices for data security, compliance, and quality control.
- Stay updated with the latest advancements in big data technologies and industry trends.
Basic Qualifications
-
Minimum 2 years of relevant work experience with a Bachelor’s Degree in Computer Science, Data Engineering, Statistics, Finance, Economics, or a related field.
Preferred Qualifications
- 5+ years of experience in data engineering, with a strong foundation in big data technologies.
- Proficiency in Hadoop ecosystem and associated technologies such as Apache Spark, Hive, and HDFS.
- Hands-on experience in writing optimized Spark and Hive queries for processing large datasets.
- Strong expertise in SQL for extracting, aggregating, and transforming data within Hadoop environments.
- Programming experience in Scala, Python, or Java for data pipeline development.
- Knowledge of Unix/Shell scripting and Python scripting for automation and data processing.
- Experience with workflow scheduling tools like Apache Airflow or Control-M.
- Familiarity with version control systems like Git.
- Basic understanding of RDBMS such as MS SQL, DB2, or Oracle for data retrieval and integration.
- Experience with real-time data streaming technologies like Kafka and Apache Hudi is a plus.
- Ability to work in a fast-paced environment, manage multiple tasks efficiently, and demonstrate strong problem-solving skills.
Why Join Visa?
- Make an impact by working with a global leader in financial technology, driving innovation in secure payment solutions.
- Work with cutting-edge technologies and gain experience in big data, cloud computing, and fraud analytics.
- Collaborate with talented professionals in a diverse, inclusive, and dynamic work environment.
- Enjoy career growth opportunities with continuous learning, upskilling programs, and leadership development initiatives.
- Competitive compensation package with comprehensive benefits, including health insurance, retirement plans, and employee wellness programs.
Equal Opportunity Employer
Visa is an Equal Employment Opportunity (EEO) Employer and provides equal consideration to all qualified applicants, regardless of race, color, religion, gender, sexual orientation, national origin, disability, or veteran status. We also comply with applicable local laws regarding employment opportunities for individuals with criminal histories.
Join Visa and be a part of a team that is transforming the future of digital payments! Apply now and take your career to the next level.