Director - Data Engineering

PayU; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

PayU is seeking a senior data technology leader to hire, build, and grow high-impact data teams. You will define technical and strategic vision for data platforms, enabling scalable data assets and ML applications across online finance services.

The role requires 12+ years in data engineering and 3+ years of management. Expertise in Spark, Airflow, Trino/Pinot and AWS is essential, with strong leadership and architectural design skills in a fast-moving fintech environment.

Qualifications

• BS/MS/PhD in Computer Science or equivalent.
• 12+ years in data engineering, data platform or related domain.
• 3+ years of hands-on management leading engineers and engineering managers.
• Excellent communication and leadership skills; experience hiring and growing teams in fast-moving environments.
• Experience with performance management, coaching, mentoring and team growth.
• Familiar with Python and SQL.
• Prior experience with Spark/Airflow/Trino/Pinot.
• Familiarity with AWS and large-scale batch/real-time ETL orchestration (Airflow, Kafka, Spark Streaming).
• Familiarity with Delta Lake, Apache Hudi, Glue Catalog, S3 formats.
• Experience building systems powering online applications.
• Exposure to PostgreSQL, MongoDB, Cassandra.
• Proficient in system design and AI applications in data space.

Responsibilities

• Lead hiring, build, grow and nurture impactful data teams focusing on business outcomes.
• Drive technical and strategic vision for embedded pods and foundational enablers for scale.
• Strive for continuous improvement of data architecture and development processes.
• Break down large systems into reusable data assets and components.
• Collaborate with stakeholders, external partners and fellow data leaders.
• Plan and execute for short- and long-term team and stakeholder success.
• Ensure reliability and quality for all data and ML applications.

Skills

Python

SQL

Spark

Airflow

Kafka

Spark Streaming

AWS

Delta Lake

Apache Hudi

Glue Catalog

S3

PostgreSQL

MongoDB

Cassandra

AI in Data

System Design

Leadership

Education

B.S./M.S./PhD in Computer Science or equivalent

Tools

Spark

Airflow

Trino

Pinot

AWS

Kafka

Job description

About PayU

PayU, a leading payment and Fintech company in 50+ high-growth markets throughout Asia, Central and Eastern Europe, Latin America, the Middle East and Africa, part ofProsusgroup, one of the largest technology investors in the world is redefining the way people buy and sell online for our 300.000+ merchants and millions of consumers.

As a leading online payment service provider, we deploy more than 400 payment methods and PCI-certified platforms to process approximately 6 million payments every single day.

Thinking of becoming a PayUneer and you are curious to know more about us? Read more about the life in PayU here

Job responsibilities

• As a technology leader, you are responsible for hiring, building, growing and nurturing impactful business focused data teams
• Drive the technical and strategic vision for the embedded pods and foundational enablers to meet current and future needs for scale and interoperability
• Strive for continuous improvement of data architecture and development process
• Think of quick wins while planning for long term strategy and engineering excellence. You should be excited about breaking down large systems into easy to use data assets and reusable components
• Required to cross collaborate with stakeholders, external partners and peer data leaders
• You should be planner and executioner. Well versed with tools to plan for short term and long term team and stakeholder success
• Reliability and quality is must have for all data and ML applications

Requirements to be successful in this role:

• B.S., M.S., or PhD. in Computer Science or equivalent
• 12+ years of experience working in data engineering, data platform or a related domain
• 3+ years of hands-on management experience of leading engineers and engineering mangers.
• Exceptional communication and leadership skills, experience hiring and growing teams with a proven ability to operate in a fast moving environment
• Experienced with performance management, coaching, mentoring and growing teams
• Familiar with programming languages Python and SQL
• Prior experience with Spark/Airflow/Trino/Pinot
• Prior experience with AWS ecosystem and large scale batch/real time ETL orchestration using Airflow, Kafka, Spark Streaming, etc.
• Familiarity with various data lake file formats such as Delta Lake, Apache Hudi, Glue Catalog, S3,etc
• Experience in building systems directly powering online applications
• Exposure to various databases such as PostgreSQL, MongoDB and Cassandra
• Proficient in system design and with a strong understanding and application of AI solutions in data space

About us

At PayU, we are a global fintech investor and our vision is to build a world without financial borders where everyone can prosper. We give people in high-growth markets the financial services and products they need to thrive. Our expertise in 18 high-growth markets enables us to extend the reach of financial services. This drives everything we do, from investing in technology entrepreneurs, to offering credit to underserved individuals, to helping merchants buy, sell and operate online. Being part ofProsus, one of the largest technology investors in the world, gives us the presence and expertise to make a real impact. Find out more www.payu.com

Our CommitmentToBuilding A DiverseAndInclusive Workforce

As a global and multi-cultural organization with varied ethnicities thriving across locations, we realize that our responsibility towards fulfilling the D&I commitment is huge. Therefore, we continuously strive to create a diverse, inclusive and safe environment, for all of our people, communities and customers. Our leaders are committed to create an inclusive work culture which enables transparency, flexibility and unbiased attention to each and everyPayUneerso they can succeed, irrespective of gender, color or personal faith. An environment where every person feels they belong, that they are listened to, and where they are empowered to speak up. At PayU we have zero tolerance towards any form of prejudice whether a specific race, ethnicity, or of persons with disabilities or the LGBTQ communities.