Lead Data Engineer - Cloud Data Platform & Multi-Cloud

Mastercard Inc.; Arlington (VA); Hybrid; USD 161,000 - 266,000; Full time

Benefits offered by this job

Health insurance

401k with company match

Paid time off

Fitness reimbursement

Job summary

Mastercard in Arlington, VA is seeking a Lead Data Engineer to design, build, and scale cloud-native data and BI solutions across a multi-cloud ecosystem. You will focus on Databricks, Snowflake, and AWS to deliver scalable data pipelines and platform capabilities for enterprise data products.

The role requires strong hands-on engineering and technical leadership, with collaboration across Product, Architecture, Engineering, Data, and Business teams. Hybrid onsite three days/week in Arlington.

Qualifications

• Deep hands-on experience as a Lead or Senior Data Engineer.
• Strong expertise with Databricks, Snowflake, and AWS.
• Proficiency with Apache Spark/PySpark, Delta Lake, SQL, and Python for large-scale data processing.
• Experience building scalable ETL/ELT pipelines and data integration frameworks.
• Experience designing multi-cloud data architectures and cross-cloud integrations.
• CI/CD, Infrastructure as Code, automation, Git/GitHub, and DevOps practices for data platforms.
• Experience implementing enterprise security, governance, and access controls.
• Knowledge of Delta Lake and Apache Iceberg is a plus.
• Understanding of FinOps and cloud cost optimization.

Responsibilities

• Design and develop cloud-native data and BI solutions using Databricks and Snowflake on AWS.
• Build scalable data pipelines and analytics frameworks for enterprise data products.
• Lead multi-cloud architectures across AWS and Azure, including Azure Databricks and ADLS Gen2.
• Enable integration and interoperability across Databricks, Snowflake, AWS and Azure services.
• Build and maintain CI/CD pipelines, automation frameworks, and IaC for provisioning and deployment.
• Implement secure access patterns using RBAC, IAM, service principals, and identity integration.
• Lead architecture reviews and mentor engineers from design through implementation.
• Collaborate with Product, Architecture, Engineering, Data, and Business teams.

Skills

Databricks

Snowflake

AWS

PySpark

SQL

Python

CI/CD

IaC

RBAC IAM

Multi-cloud

Education

Bachelor's degree in Computer Science or related field

Equivalent practical experience

Tools

Azure Databricks

ADLS Gen2

Job description

Mastercard in Arlington, VA is seeking a Lead Data Engineer to design, build, and scale cloud-native data and BI solutions across a multi-cloud ecosystem. You will focus on Databricks, Snowflake, and AWS to deliver scalable data pipelines and platform capabilities for enterprise data products.

The role requires strong hands-on engineering and technical leadership, with collaboration across Product, Architecture, Engineering, Data, and Business teams. Hybrid onsite three days/week in Arlington.