Visa Corporate IT (CIT) is undergoing a significant transformation, evolving into an engineering powerhouse prioritizing customer experience and end-user support. As part of this evolution, we're consolidating operational functions into a unified team dedicated to delivering world-class support. Our Finance Engineering, Applications, and Analytics team seeks dynamic, tech-savvy professionals to join us on this journey. We specialize in developing and supporting integrated platforms crucial for Visa's financial applications, empowering Visa's global business partners. Additionally, we drive insights through analytics and reporting using revenue data.
We're seeking a skilled Big Data Engineer to lead the charge in leveraging cutting-edge technologies. The chosen candidate will oversee service delivery and operational excellence in services built on Hadoop technologies.
Responsibilities
- Design scalable architectural models for data processing and storage.
- Develop frameworks for data ingestion from diverse sources in both batch and real-time modes.
- Create frameworks for data analytics, search, and aggregation.
- Optimize existing data processing pipelines.
- Manage data integration, processing, and governance.
- Drive analytics and visualizations initiatives.
Qualifications
Basic Qualifications
- Bachelor's degree in Computer Science or related field.
- 4+ years of experience as a Data Engineer or similar role.
Preferred Qualifications
- Proficiency in Python/Java programming.
- Expertise in writing and optimizing complex SQL queries using Big Data technologies like Hive/Sqoop/Spark-SQL.
- Experience building resilient data pipelines with extensive data modeling in a production environment.
- Proficiency in building scalable data pipelines using Spark/Hive with Airflow/Control M scheduler/executor frameworks.
- Strong command of Linux command line and systems administration.
- Proven ability to develop innovative solutions and lead innovation efforts.
- Experience with ETL optimization and designing, coding, and tuning big data processes using Apache Spark or similar technologies.
- Proficiency in building applications for streaming and processing datasets at low latencies using Kafka/Java.
- Demonstrated ability to thrive in high-performing teams with agile development approaches.
Additional Information
Visa is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. We also consider qualified applicants with criminal histories in accordance with EEOC guidelines and applicable local laws. Join us and experience the possibilities of Life at Visa.