Senior Data Engineer: Azure Data Lakes & Spark

drive for MPC; San Antonio (TX); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health insurance

401k matching

Paid time off

Educational reimbursement

Discretionary annual bonus

Job summary

Marathon Petroleum Company LP in San Antonio, Texas seeks a Senior Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data solutions using Azure data services, Data Lake, Synapse Analytics, Azure Functions, and Databricks.

The role requires strong Python/SQL, Spark, and orchestration tools such as Azure Data Factory or Databricks Workflows, with a focus on data security, governance, and collaboration across analytics, product, and governance teams.

Qualifications

• Bachelor’s degree or equivalent experience in IT or related field.
• 5+ years of relevant data engineering experience.
• Proficiency in Python and SQL with Spark experience.
• Experience with cloud data platforms and data governance concepts.

Responsibilities

• Designs, builds, and optimizes data extraction, ingestion and transformation processes.
• Develops complex data architectures to process large data sets.
• Ensures data security, privacy, and quality across pipelines.
• Mentors junior engineers and enforces engineering standards.

Skills

Python

SQL

Spark

Azure Data Factory

Databricks

Azure Functions

Data Security

Data Governance

NoSQL

Real Time Processing

Education

Bachelor’s Degree in Information Technology or related field

Tools

Azure Data Factory

Databricks

Synapse Analytics

Data Lake

Python

SQL

Spark

Azure Functions

Job description

Marathon Petroleum Company LP in San Antonio, Texas seeks a Senior Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data solutions using Azure data services, Data Lake, Synapse Analytics, Azure Functions, and Databricks.

The role requires strong Python/SQL, Spark, and orchestration tools such as Azure Data Factory or Databricks Workflows, with a focus on data security, governance, and collaboration across analytics, product, and governance teams.