Senior Data Engineer — Azure Data Pipelines & Cloud

drive for MPC; San Antonio (TX); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health, vision, and dental insurance

401k matching

Paid time off

Job summary

Marathon Petroleum seeks a Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions. You will collaborate with analytics, product, architecture, governance and business teams to translate requirements into robust data platforms.

The role requires strong Python, SQL and Spark skills, experience with Azure data services, and a mindset of continual improvement while mentoring other engineers.

Qualifications

• Bachelor’s Degree in Information Technology or related field required.
• 5+ years of relevant data engineering experience required.
• Proficiency in Python, SQL, Spark and cloud data services.

Responsibilities

• Design, develop and optimize scalable data pipelines and cloud-based data solutions.
• Collaborate with analytics, product, architecture, governance and business teams to translate requirements into data solutions.
• Mentor junior engineers and contribute to engineering standards and best practices.
• Ensure data security, privacy and quality across pipelines and storage.
• Oversee QA and testing of data solutions and participate in incident response.
• Drive continuous improvements in data processing methods and data governance.

Skills

Python

SQL

Spark

Databricks

Azure Data Factory

ETL

Data Modeling

Data Governance

Data Warehousing

DevOps

Education

Bachelor’s Degree in Information Technology

Tools

Azure Synapse Analytics

Azure Functions

Azure Data Lake

NoSQL Databases

Job description

Marathon Petroleum seeks a Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions. You will collaborate with analytics, product, architecture, governance and business teams to translate requirements into robust data platforms.

The role requires strong Python, SQL and Spark skills, experience with Azure data services, and a mindset of continual improvement while mentoring other engineers.