Senior Data Engineer: Data Quality & AI Platforms

JobCubby; O’Fallon (MO); On-site; USD 115,000 - 184,000; Full time

Job summary

Mastercard is seeking a Senior Data Engineer to build and scale a next-generation Data Quality platform. You will design high-performance pipelines, develop data quality frameworks, and implement cloud-native solutions to improve trust and usability of enterprise data assets.

The role collaborates with data strategists, stewards, product owners, and engineers, and emphasizes AI/ML techniques, monitoring, and proactive remediation in a fast-paced environment.

Qualifications

• Advanced experience designing and developing scalable data pipelines using Spark, Scala, Python, Java, Databricks and AWS.
• Expertise in data quality frameworks, data warehousing, ETL/ELT, and large-scale distributed processing.
• Strong SQL skills and experience with Oracle, PostgreSQL, Iceberg, Ozone, Hadoop and object storage.
• Experience implementing data quality controls, observability, monitoring, and incident resolution processes.

Responsibilities

• Design, develop, and maintain scalable, high-performance data pipelines to support enterprise data and analytics platforms.
• Partner with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to deliver data quality improvements.
• Implement and support data quality frameworks, validation controls, monitoring, observability, and automated remediation.
• Develop and optimize data processing solutions using AWS services, SQL, data warehouses and data lakes.
• Apply AI/ML techniques for data quality monitoring, anomaly detection, and predictive analytics.
• Perform production support and root-cause analysis to maintain platform stability and reliability.
• Evaluate emerging technologies including Generative AI to improve data quality and engineering efficiency.

Skills

Spark

Scala

Python

Java

Databricks

AWS

SQL

Data Quality

ETL/ELT

Monitoring/Observability

Education

Bachelor's degree in Computer Science or related

Tools

Hadoop

Nifi

Oracle

PostgreSQL

Iceberg

Ozone

AWS Services

Job description

Mastercard is seeking a Senior Data Engineer to build and scale a next-generation Data Quality platform. You will design high-performance pipelines, develop data quality frameworks, and implement cloud-native solutions to improve trust and usability of enterprise data assets.

The role collaborates with data strategists, stewards, product owners, and engineers, and emphasizes AI/ML techniques, monitoring, and proactive remediation in a fast-paced environment.