Data Engineer - Senior Technical Lead

Paytm is India's leading mobile payments and financial services distribution company. Pioneer of the mobile QR payments revolution in India, Paytm builds technologies that help small businesses with payments and commerce. Paytm’s mission is to serve half a billion Indians and bring them to the mainstream economy with the help of technology.

This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment. For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies.

Minimum 6-10 years of experience in Big Data technologies.

The position Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.

Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability. Make changes to our diagnosing any problems across the entire technical stack. Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.

Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake.

Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects.

Be a brand ambassador for Paytm Stay Hungry, Stay Humble, Stay Relevant!

Preferred Qualification :

Bachelor's/Master's Degree in Computer Science or equivalent.

Skills that will help you succeed in this role:

Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.

Excellent programming/debugging skills in Python/Java/Scala.

Experience with any scripting language such as Python, Bash etc.

Good to have experience of working with noSQL databases like Hbase, Cassandra.

Hands-on programming experience with multithreaded applications.

Good to have experience in Database, SQL, messaging queues like Kafka.

Good to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm, etc.

Good to have experience with AWS and cloud technologies such as S3Experience with caching architectures like Redis etc.