Job Title. Senior Technical Lead - Data Engineering

About Us
Paytm, India's leading digital payments and financial services company, is dedicated to driving consumers and merchants to its platform by offering a variety of payment use cases. From utility payments and money transfers to empowering users with Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm FASTag, and Paytm Postpaid - Buy Now, Pay Later. For merchants, Paytm provides acquiring devices, payment aggregation, and additional commerce services through advertising and the Paytm Mini app store. Additionally, the company extends credit services such as merchant loans, personal loans, and BNPL, sourced through its financial partners.

About the Role
The Senior Technical Lead in Data Engineering is responsible for working on complex technical projects in a fast-paced and innovative environment. The role requires a strong product design sense and specialization in Hadoop and Spark technologies.

Requirements

• Minimum 8-11 years of experience in Big Data Technologies.
• Grow analytics capabilities with faster, reliable tools, handling petabytes of data daily.
• Designed and developed a real-time events pipeline for data ingestion and dash-boarding.
• Implement new components and emerging technologies in the Hadoop Eco-System.
• Act as a brand ambassador for Paytm with a commitment to innovation and excellence.

Skills for Success

• Fluent with hands-on experience in Hadoop, MapReduce, Hive, Spark, PySpark, etc.
• Excellent programming/debugging skills in Python/Java/Scala.
• Experience with scripting languages like Python, Bash, etc.
• It is good to have experience with NoSQL databases like Hbase and Cassandra.
• Hands-on programming experience with multithreaded applications.
• It is good to have experience in Databases, SQL, and messaging queues like Kafka.
• Experience in developing streaming applications (e.g., Spark Streaming, Flink, Storm).
• Good to have experience with AWS and cloud technologies such as S3.
• Experience with caching architectures like Redis, etc.

Why Join Us

• Opportunity to make a meaningful difference in a challenging and encouraging environment.
• Focus on meaningful use of technology for positive impact.
• Collective energy and unwavering focus on the customer.
• Explore exciting work through our Engineering blogs.

Compensation
If you are the right fit, we believe in creating wealth for you. With over 500 million registered users, 21 million+ merchants, and a depth of data in our ecosystem, we are uniquely positioned to democratize credit for deserving consumers & merchants. Join us in contributing to India's largest digital lending story. It's your opportunity to be a part of the story!