Senior Data Engineer — Azure Data Lakes & Pipelines Lead

Marathon Petroleum; Findlay (OH); On-site; USD 120,000 - 180,000; Full time

Job summary

Marathon Petroleum is seeking a Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions using Azure data services including Data Lake, Synapse Analytics, Azure Functions, and Databricks.

You will collaborate with analytics, product, architecture, governance and business teams to translate requirements into scalable data solutions, mentoring others while contributing to standards and reviews.

Qualifications

• Bachelor’s Degree in Information Technology or related field required.
• 5+ years of relevant data engineering experience required.
• Strong proficiency in Python, SQL, Spark; experience with orchestration tools such as Azure Data Factory and/or Databricks Workflows.

Responsibilities

• Designs, develops, and optimizes data extraction, ingestion and transformation processes.
• Facilitates development of complex data architecture to process high-volume data sets.
• Mentors less experienced data engineers and contributes to engineering standards and reviews.
• Ensures data security, privacy, and quality across data pipelines and projects.
• Collaborates with analytics, product, architecture, governance and business teams to translate requirements into scalable data solutions.

Skills

Python

SQL

Spark

Orchestration

Education

Bachelor's Degree in Information Technology or related field

Tools

Azure Data Factory

Azure Data Lake

Databricks

Synapse Analytics

Azure Functions

Job description

Marathon Petroleum is seeking a Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions using Azure data services including Data Lake, Synapse Analytics, Azure Functions, and Databricks.

You will collaborate with analytics, product, architecture, governance and business teams to translate requirements into scalable data solutions, mentoring others while contributing to standards and reviews.