Senior Data Engineer (Hive, SQL, PySpark, BI)

Bengaluru East, Karnataka, India
Oct 03, 2024
Oct 03, 2025
Hybrid
Full-Time
5 Years
Job Description

As a Data Engineer within the Finance Technology DevOps team, you will play a critical role in designing and developing Data & Business Intelligence (BI) solutions, with a focus on driving innovation through AI and Machine Learning (ML) technologies. This is an exciting opportunity to work on cutting-edge tools and technologies, transforming data into actionable insights, reports, and visualizations that empower strategic decisions.

You'll collaborate closely with product managers, business stakeholders, and technical teams to deliver scalable and high-impact reporting solutions. Your expertise in Data Modeling, SQL, and BI tools will contribute to the development of advanced analytics platforms, and you’ll be instrumental in researching and applying AI/ML models to solve complex business challenges.

Key Responsibilities

  1. Develop Scalable Data Solutions. Work with cross-functional teams to design and implement high-performing data models, reports, and dashboards. Build deep understanding of data and revenue applications to drive effective business insights.
  2. AI/ML Exploration. Research and develop machine learning algorithms and AI models to address complex data problems. Play a pivotal role in implementing advanced analytics and predictive models.
  3. Business Intelligence & Visualization. Lead the creation and administration of semantic data marts using OLAP tools and develop sophisticated visualizations through Tableau, Power BI, or similar tools. Proficiency in SQL, DAX scripting, and data structures is essential.
  4. DevOps & Agile Execution. Utilize DevOps practices, including CI/CD and JIRA for project management, ensuring smooth deployment and maintenance of BI components. Adhere to Agile methodologies to ensure timely delivery of solutions.
  5. Collaboration & Leadership. Engage with product managers and business stakeholders to ensure the alignment of BI solutions with business goals. Demonstrate leadership principles, including ownership, accountability, and a strong focus on customer needs.
  6. Platform Modernization. Assist with the ongoing evaluation and modernization of BI platforms, ensuring Visa remains at the forefront of technology innovation.

Required Qualifications

  • Experience. 5+ years of relevant work experience and a Bachelor's degree, OR 7+ years of relevant work experience in data engineering or a related field.

Technical Skills

  • Expertise in Data Modeling, Data Warehousing, OLAP, and SQL (or PLSQL).
  • Proficiency with BI tools (Tableau, Power BI) and scripting languages like DAX.
  • Experience with Big Data technologies (Hadoop, Spark, Scala, etc.) and ETL processes.
  • Knowledge in Machine Learning algorithms and AI models (xgboost, neural networks, NLP, LLMs) is a plus.
  • BI Administration. Familiarity with administration and performance tuning of BI platforms, including OLAP, SSAS, and reporting tools.
  • Domain Knowledge. Understanding of billing systems and the finance domain is preferred.

Preferred Qualifications

  • Bachelor's in Engineering, Analytics, Data Science, Statistics, Math, or Business.
  • 5+ years of hands-on experience with Business Intelligence tools, data visualization, and data modeling.
  • Strong knowledge of DevOps practices, CI/CD methodologies, and Agile frameworks.
  • Working knowledge of data administration, security architecture, and auditing.

Why Join Visa?

At Visa, we believe in fostering a collaborative environment that encourages growth, innovation, and diversity. As part of our Finance Technology team, you’ll work on impactful projects, leverage the latest in AI and data analytics, and help shape the future of global payments.

This hybrid role offers the flexibility of working remotely while still benefiting from regular in-office collaboration with Visa’s talented teams.

Visa is an equal opportunity employer and is committed to building an inclusive and diverse workforce. We welcome qualified applicants from all backgrounds and ensure fair treatment for individuals with criminal histories, in accordance with local laws.