Senior Data Engineer

Paytm; Dadri; On-site; INR 1,500,000 - 3,500,000; Full time

Job summary

Paytm is seeking a highly skilled Data Engineer to design, build, and optimize scalable data systems powering products and insights. You will work with cross-functional teams to develop robust data infrastructure, ensure data quality, and enable data-driven decisions across the organization.

The role involves building data pipelines, ETL workflows, and collaborating with scientists, analysts, and engineers to translate business needs into technical solutions, while ensuring governance and

Qualifications

• Bachelor's degree in Computer Science or a related field.
• 3+ years of experience in data engineering or backend engineering.
• Strong SQL and programming in Java, Python or Scala.
• Experience with Spark, Kafka, and Airflow, and data warehousing.

Responsibilities

• Design, build, and maintain scalable data pipelines for ingestion, processing, and storage.
• Develop and manage ETL workflows using Spark, NiFi, or similar technologies.
• Integrate data from multiple sources into centralized data warehouses or data lakes.
• Collaborate with data scientists, analysts, and engineers to translate business needs.
• Ensure data quality, integrity, and reliability through validation and monitoring.
• Optimize data pipelines for performance, scalability, and efficiency.
• Monitor, troubleshoot, and resolve production issues with minimal downtime.
• Implement data governance, security, and compliance best practices.
• Contribute to automation and system reliability, documenting workflows.

Skills

Java

Python

SQL

Scala

Airflow

Apache Spark

Kafka

Kubernetes

REST

Spring Boot

Education

Bachelor's degree in Computer Science or related field

Tools

Apache NiFi

Docker

PostgreSQL

MongoDB

Cassandra

AWS

Job description

About Us:

Paytm is India's leading mobile payments and financial services distribution company. Pioneer of the mobile QR payments revolution in India, Paytm builds technologies that help small businesses with payments and commerce. Paytm's mission is to serve half a billion Indians and bring them to the mainstream economy with the help of technology.

About the Role:

We are looking for a highly skilled Data Engineer to design, build, and optimize scalable data systems that power our products and insights. You will work closely with cross-functional teams to develop robust data infrastructure, ensure data quality, and enable data-driven decision-making across the organization.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines for ingestion, processing, and storage
• Build and manage ETL workflows using tools such as Apache Spark, Apache NiFi, or similar technologies
• Integrate data from multiple sources into centralized data warehouses or data lakes
• Collaborate with data scientists, analysts, and engineers to translate business needs into technical solutions
• Ensure data quality, integrity, and reliability through validation and monitoring processes
• Optimize data pipelines for performance, scalability, and efficiency
• Monitor, troubleshoot, and resolve production issues with minimal downtime
• Implement best practices in data governance, security, and compliances
• Contribute to continuous improvement, automation, and system reliability
• Document workflows, systems, and technical specification
• Stay updated with emerging trends and technologies in data engineering

What You'll Do:

• Build systems to collect and transform complex datasets for production use
• Develop and maintain backend services and data infrastructure
• Implement scalable data schemas and improve data management practices
• Provide insights into product performance and customer behavior
• Act as a subject matter expert in data infrastructure, privacy, and security
• Collaborate with stakeholders to understand and deliver on requirements
• Participate in on-call rotations to support live systems

Minimum Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience)
• 3+ years of experience in data engineering or backend engineering
• Strong understanding of data structures and algorithms
• Proficiency in Java, Python, or Scala
• Strong SQL skills with the ability to write complex queriesExperience with workflow orchestration tools such as Airflow
• Hands-on experience with big data technologies like Apache Spark, Kafka, or Flink
• Experience with databases such as Cassandra, MongoDB, Oracle, or PostgreSQL
• Familiarity with cloud platforms (AWS or GCP)
• Experience with containerization tools like Docker and Kubernetes
• Experience building scalable microservices using REST, Spring Boot, or gRPC
• Strong problem-solving, communication, and collaboration skills

Preferred Qualifications:

• Experience with large-scale distributed systems
• Knowledge of data security and compliance standards
• Experience in building and scaling data platforms
• Passion for experimentation, rapid prototyping, and innovation

Why join us:

• Because you get an opportunity to make a difference, and have a great time doing that.
• You are challenged and encouraged here to do stuff that is meaningful for you and for those we serve.
• You should work with us if you think seriously about what technology can do for people.
• We are successful, and our successes are rooted in our people's collective energy and unwavering focus on the customer, and that's how it will always be.

Compensation:

If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 25 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants - and we are committed to it. India's largest digital lending story is brewing here. It's your opportunity to be a part of the story!