Lead Data Engineer
Mastercard
An application made for this job — a tailored resume and cover letter that speak straight to the posting.
Job summary
Mastercard in Navi Mumbai seeks an experienced Lead Data Engineer to guide the design, delivery, modernization, and operation of enterprise data platforms, warehouses, and data engineering solutions.
The role partners with Data Engineering, DBA, Cloud, SRE, Security, Analytics, and business teams to ensure reliable, scalable, secure data ecosystems while mentoring teams and driving strategic initiatives.
Qualifications
- 8+ years of experience in Data Engineering, Database Engineering, Data Warehousing, or related disciplines.
- Strong experience with Python, SQL, PySpark, ETL/ELT, and CDC-based architectures.
- Expertise in relational databases including PostgreSQL, MySQL, Aurora PostgreSQL, and Aurora MySQL.
- Strong understanding of database administration concepts including performance tuning, indexing, partitioning, backup/recovery, replication, and capacity planning.
- Experience designing and managing enterprise data warehouses, data lakes, and lakehouse platforms.
- Experience with cloud-based data services and modern analytics platforms.
- Strong expertise in AWS services including AWS Glue, S3, DMS, DynamoDB, IAM, VPC, and CloudWatch.
- Hands-on experience with Snowflake, Databricks, Apache Iceberg, or equivalent modern data platforms.
- Understanding of cloud security, governance, and cost optimization practices.
- Proven experience leading technical teams and complex cross-functional projects.
- Strong stakeholder management and communication skills.
- Experience managing incidents, RCAs, service reliability, and production support activities.
- Experience with Agile delivery methodologies, CI/CD, GitLab, and Infrastructure as Code (Terraform).
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Responsibilities
- Provide technical leadership for Data Engineering, Data Warehouse, and Database initiatives.
- Define and drive architecture standards, engineering best practices, and platform governance.
- Design scalable, secure, and high-performance data solutions across cloud and on-premise environments.
- Lead technical design reviews, solution assessments, and modernization initiatives.
- Mentor engineers and foster a culture of engineering excellence and continuous improvement.
- Design, develop, and oversee enterprise ETL/ELT and CDC pipelines.
- Manage data integration across relational, NoSQL, SaaS, and cloud-based platforms.
- Design and optimize data warehouse, lakehouse, and analytical solutions using Snowflake, Databricks, Apache Iceberg, and Amazon S3.
- Ensure data quality, reliability, observability, and operational readiness of all data products.
- Drive adoption of reusable frameworks, automation, and standardized engineering practices.
- Provide oversight of enterprise database environments including PostgreSQL, MySQL, Aurora PostgreSQL, Aurora MySQL, MongoDB Atlas, and DynamoDB.
- Ensure database availability, performance, security, backup, recovery, and capacity planning.
- Collaborate with DBA, SRE, and Cloud teams on performance tuning, incident resolution, disaster recovery, and operational improvements.
- Establish monitoring, alerting, and operational processes for critical platforms.
- Ensure successful and timely delivery of projects through effective planning, prioritization, and execution.
- Track project progress, dependencies, risks, and milestones.
- Proactively identify and remove blockers impacting team productivity and project delivery.
- Lead incident management and root cause analysis activities while driving preventive actions.
- Continuously improve operational processes, runbooks, and service reliability.
- Drive modernization initiatives including migration from legacy platforms to cloud-native solutions.
- Evaluate emerging technologies and conduct proof-of-concepts to support business objectives.
- Lead cost optimization efforts across cloud platforms, licenses, and data infrastructure.
- Partner with FinOps and platform teams to improve platform utilization and operational efficiency.
- Identify opportunities to simplify architecture, reduce technical debt, and improve scalability.
- Support workforce planning by forecasting resource needs for BAU activities and project initiatives.
- Align team objectives with business priorities, strategic initiatives, and individual development plans.
- Participate in hiring, onboarding, and succession planning activities.
- Balance workloads and capacity across multiple projects and operational responsibilities.
- Foster strong collaboration across Data Engineering, DBA, SRE, Cloud, Security, BI, and application teams.
- Establish regular stakeholder engagement to provide project updates, address challenges, and align priorities.
- Conduct performance reviews, career development discussions, coaching, and mentoring activities.
- Promote a culture of accountability, inclusion, innovation, and continuous learning.
Skills
Job description
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Lead Data Engineer
Lead Data Engineer
We are seeking an experienced Lead Data Engineer to lead the design, delivery, modernization, and operational management of enterprise data platforms, databases, data warehouses, and data engineering solutions. The role is responsible for providing technical leadership across Data Engineering, Database Administration, Cloud Data Platforms, and Data Warehouse operations while ensuring the reliability, scalability, security, and cost efficiency of the organization's data ecosystem. The ideal candidate will possess strong expertise in data engineering, database technologies, cloud platforms, data warehousing, ETL/ELT, CDC, and platform operations, combined with proven leadership experience in managing projects, driving strategic initiatives, mentoring teams, and collaborating across multiple technology functions. This role will partner closely with Data Engineering, DBA, Cloud Engineering, SRE, Security, Analytics, and Business teams to deliver scalable and business-aligned data solutions.
Provide technical leadership for Data Engineering, Data Warehouse, and Database initiatives.
Define and drive architecture standards, engineering best practices, and platform governance.
Design scalable, secure, and high-performance data solutions across cloud and on-premise environments.
Lead technical design reviews, solution assessments, and modernization initiatives.
Mentor engineers and foster a culture of engineering excellence and continuous improvement.
Design, develop, and oversee enterprise ETL/ELT and CDC pipelines.
Manage data integration across relational, NoSQL, SaaS, and cloud-based platforms.
Design and optimize data warehouse, lakehouse, and analytical solutions using technologies such as Snowflake, Databricks, Apache Iceberg, and Amazon S3.
Ensure data quality, reliability, observability, and operational readiness of all data products.
Drive adoption of reusable frameworks, automation, and standardized engineering practices.
Provide oversight of enterprise database environments including PostgreSQL, MySQL, Aurora PostgreSQL, Aurora MySQL, MongoDB Atlas, and DynamoDB.
Ensure database availability, performance, security, backup, recovery, and capacity planning.
Collaborate with DBA, SRE, and Cloud teams on performance tuning, incident resolution, disaster recovery, and operational improvements.
Establish monitoring, alerting, and operational processes for critical platforms.
Ensure successful and timely delivery of projects through effective planning, prioritization, and execution.
Track project progress, dependencies, risks, and milestones.
Proactively identify and remove blockers impacting team productivity and project delivery.
Lead incident management and root cause analysis activities while driving preventive actions.
Continuously improve operational processes, runbooks, and service reliability.
Drive modernization initiatives including migration from legacy platforms to cloud-native solutions.
Evaluate emerging technologies and conduct proof-of-concepts to support business objectives.
Lead cost optimization efforts across cloud platforms, licenses, and data infrastructure.
Partner with FinOps and platform teams to improve platform utilization and operational efficiency.
Identify opportunities to simplify architecture, reduce technical debt, and improve scalability.
Support workforce planning by forecasting resource needs for BAU activities and project initiatives.
Align team objectives with business priorities, strategic initiatives, and individual development plans.
Participate in hiring, onboarding, and succession planning activities.
Balance workloads and capacity across multiple projects and operational responsibilities.
Foster strong collaboration across Data Engineering, DBA, SRE, Cloud, Security, BI, and application teams.
Establish regular stakeholder engagement to provide project updates, address challenges, and align priorities.
Conduct performance reviews, career development discussions, coaching, and mentoring activities.
Promote a culture of accountability, inclusion, innovation, and continuous learning.
Recognize and encourage outstanding team contributions and achievements.
8+ years of experience in Data Engineering, Database Engineering, Data Warehousing, or related disciplines.
Strong experience with Python, SQL, PySpark, ETL/ELT, and CDC-based architectures.
Expertise in relational databases including PostgreSQL, MySQL, Aurora PostgreSQL, and Aurora MySQL.
Strong understanding of database administration concepts including performance tuning, indexing, partitioning, backup/recovery, replication, and capacity planning.
Experience designing and managing enterprise data warehouses, data lakes, and lakehouse platforms.
Experience with cloud-based data services and modern analytics platforms.
Strong expertise in AWS services including AWS Glue, S3, DMS, DynamoDB, IAM, VPC, and CloudWatch.
Hands-on experience with Snowflake, Databricks, Apache Iceberg, or equivalent modern data platforms.
Understanding of cloud security, governance, and cost optimization practices.
Proven experience leading technical teams and complex cross-functional projects.
Strong stakeholder management and communication skills.
Experience managing incidents, RCAs, service reliability, and production support activities.
Experience with Agile delivery methodologies, CI/CD, GitLab, and Infrastructure as Code (Terraform).
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
