Senior Data Engineer

Mastercard; O’Fallon (MO); On-site; USD 115,000 - 184,000; Full time

Benefits offered by this job

Health insurance

HSA/FSA

Paid parental leave

Vacation and personal days

Paid holidays

401k with company match

Tuition reimbursement

Wellness facilities

Job summary

Mastercard is seeking a Senior Data Engineer to build scalable data pipelines and quality frameworks on cloud platforms. The role emphasizes Spark, Databricks, AWS, and SQL across enterprise data assets.

You will partner with Data Strategists, Product Owners, and Engineers to improve trust and usability of data assets, while advancing observability and incident response.

Qualifications

• Advanced experience designing scalable data pipelines with Spark, Scala, Python, Java, Databricks, and AWS services.
• Strong expertise in data engineering, data quality frameworks, data warehousing, and ETL/ELT.
• Advanced SQL skills with Oracle, PostgreSQL, Iceberg, Hadoop, and object storage.
• Experience implementing data quality controls, monitoring, observability, and incident resolution.
• Able to collaborate with Data Strategists, Data Stewards, Product Owners, Architects, and Eng. teams.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Spark, Scala/Python/Java, Databricks, Hadoop, and AWS.
• Collaborate with cross-functional teams to solve data challenges and deliver quality solutions.
• Implement data quality frameworks, monitoring, and automated remediation for reliability.
• Develop and optimize data processing using AWS, SQL, data warehouses, and data lakes.
• Apply AI/ML techniques for data quality monitoring and anomaly detection.
• Perform production support, troubleshoot data issues, and ensure platform stability.
• Evaluate emerging technologies and AI capabilities to improve data quality and productivity.

Skills

Spark

Scala

Python

Java

Databricks

AWS services

SQL

Data quality

ETL/ELT

Big data

Data warehousing

Education

Bachelor's degree

Cloud/Data analytics certifications

Tools

Databricks

Hadoop

Oracle

PostgreSQL

Iceberg

Ozone

TensorFlow/PyTorch

Job description

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title And Summary

Senior Data Engineer

Who is Mastercard?

Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.

Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.

Overview

The Enterprise Data Quality team is seeking a Senior Data Engineer to help build and scale Mastercard's next-generation Data Quality platform. This role focuses on designing and developing high-performance data pipelines, data quality frameworks, and cloud-native data solutions that improve trust, reliability, and usability of enterprise data assets. The ideal candidate is passionate about solving complex data challenges, leveraging modern big data technologies, and driving continuous innovation in a fast-paced, collaborative environment.

Role

• Design, develop, and maintain scalable, high-performance data pipelines using Spark, Scala/Python/Java, Databricks, Hadoop, and cloud-native technologies to support enterprise data and analytics platforms.
• Partners with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to solve complex data challenges and deliver enterprise data quality and data engineering solutions.
• Implement and support data quality frameworks, validation controls, monitoring, observability, and automated remediation capabilities to improve data trust, reliability, and business outcomes.
• Develop and optimize data processing solutions using AWS services, SQL, data warehouses, and data lakes while ensuring performance, scalability, security, and operational excellence.
• Apply AI/ML techniques, anomaly detection, predictive analytics, and statistical modeling to enhance data quality monitoring, intelligent threshold recommendations, alert reduction, and root cause analysis.
• Perform production support, troubleshoot complex data issues, conduct root cause analysis, and independently resolve incidents while maintaining platform stability and service reliability.
• Contribute to architecture, engineering standards, and continuous innovation by evaluating emerging technologies, Generative AI capabilities, and best practices that improve data quality, developer productivity, and operational efficiency.

All About You

The ideal candidate for this position should:

Essential Knowledge, Skills, And Experience

• Have advanced experience designing and developing scalable data pipelines using Spark, Scala, Python, Java, Databricks, and AWS Services.
• Possess strong expertise in data engineering, data quality frameworks, data warehousing, ETL/ELT processes, Nifi and large-scale distributed data processing environments.
• Demonstrate advanced SQL skills and experience working with technologies such as Oracle, PostgreSQL, Iceberg, Ozone, Hadoop, and object storage platforms.
• Have experience implementing data quality controls, validation frameworks, observability, monitoring, and incident resolution processes to improve data reliability and trust.
• Be a strong communicator and collaborator, capable of working effectively with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to deliver business outcomes.
• Desirable or Additional Capabilities
• Experience applying Artificial Intelligence (AI), Machine Learning (ML), statistical modeling, and anomaly detection techniques to data quality, monitoring, and operational efficiency use cases.
• Familiarity with Deep Learning concepts, predictive analytics, pattern recognition, and AI/ML frameworks such as TensorFlow, PyTorch, or similar technologies.
• Experience leveraging Generative AI and AI-assisted development tools to improve engineering productivity, automate processes, accelerate delivery, and enhance solution quality.
• Demonstrate intellectual curiosity, a growth mindset, and a passion for continuous learning, innovation, and evaluating emerging technologies to solve complex business and data challenges.

Education

• Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, Mathematics, or a related technical field, or equivalent practical experience.
• Relevant cloud, data engineering, big data, AI/ML, or analytics certifications are a plus.

Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact [e-mail] and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard’s security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

In line with Mastercard’s total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions depending on the role. The base salary offered may vary depending on multiple factors, including but not limited to location, job-related knowledge, skills, and experience. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance); flexible spending account and health savings account; paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro-rated based on date of hire; 10 annual paid U.S. observed holidays; 401k with a best-in-class company match; deferred compensation for eligible roles; fitness reimbursement or on-site fitness facilities; eligibility for tuition reimbursement; and many more. Mastercard benefits for interns generally include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on-site fitness facilities in some locations.

Pay Ranges

O'Fallon, Missouri: $115,000 - $184,000 USD