We are seeking a talented Senior Data Engineer to join our dynamic team in Bangalore, India. In this role, you will play a crucial part in driving our data engineering initiatives. You will coordinate with various teams to manage and prioritize projects, formulate strategies, and execute key data initiatives. Your expertise in translating business needs into effective data models, creating robust data pipelines, and maintaining data lakes will be vital in ensuring our data solutions are effective and efficient.
Key Responsibilities
- Requirement Analysis. Understand and translate business needs into data models that support long-term solutions.
- Data Modeling. Collaborate with business teams to implement data strategies, build data flows, and develop conceptual data models.
- Data Pipeline Design. Create scalable and robust data pipelines and data products across various domains.
- Data Integration. Develop and maintain data lakes by sourcing data from primary and secondary sources, while enhancing our data evaluation process.
- Testing. Define and manage data load procedures to ensure datasets meet defined business rules and quality standards.
- Deployment. Collaborate with development teams to implement data strategies and develop physical data models for robust operational data management systems.
- Team Leadership. Coordinate with cross-functional teams to manage and prioritize projects effectively.
- Stakeholder Management. Engage with stakeholders across the organization to understand their data needs and deliver tailored solutions.
- Continuous Integration and Deployment (CI/CD). Implement and maintain CI/CD pipelines for data solutions to ensure rapid and reliable updates to the data environment.
Technical Skills
- Extensive experience with big data tools, Hadoop, Hive, and Spark.
- Proficient in Scala, Python, SQL, and PySpark.
- Experience with Unix/Linux systems and scripting in Bash.
- Familiarity with data pipeline and workflow management tools, such as Airflow.
- Proficient in relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with cloud services like AWS or Azure.
- Familiarity with stream-processing systems, Kafka, Spark-Streaming, etc.
- Strong analytical skills for working with both structured and unstructured datasets.
Preferred Qualifications
- 5+ years of relevant work experience with a bachelor's degree, or at least 3+ years with an advanced degree (e.g., Master's, MBA) or 1+ years with a PhD.
- Exposure to the Financial Services/Payments Industry.
- Proven leadership skills with experience leading large-scale data engineering initiatives.
Leadership Competencies
- Intellectual curiosity and a commitment to continuous learning.
- Integrity, maturity, and a constructive approach to business challenges.
- Respect for individuals at all levels in the workplace.
- A drive for excellence and extraordinary results.
- Strong insight and judgment to make informed decisions aligned with business strategies.
- Ability to persuade and influence internal stakeholders to build best-in-class solutions.
Why Join Visa?
At Visa, you will be part of an innovative, purpose-driven industry leader, committed to making a positive impact on the world. We offer a collaborative work environment, opportunities for professional growth, and the chance to contribute to a transformative payments network.