Senior Data Engineer, Azure Data Pipelines & Mentorship

Marathon Petroleum Corporation; San Antonio (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Marathon Petroleum Corporation is seeking a Senior Data Engineer to design scalable data pipelines and cloud-based data solutions using Azure Data Lake, Synapse Analytics, Azure Functions, and Databricks. You will collaborate with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions.

The ideal candidate has strong Python, SQL, Spark skills, and experience with Azure Data Factory or Databricks Workflows, and will mentor others

Qualifications

• Bachelor’s Degree in Information Technology or related field required.
• 5+ years of relevant data engineering experience required.

Responsibilities

• Designs, develops and optimizes data extraction, ingestion and transformation processes.
• Facilitates development of complex data architecture to process and store high-volume data sets.
• Enables development of complex data pipelines with data security and privacy measures.
• Performs complex data quality tasks using open source and cloud services.
• Provides technical expertise during critical incidents.
• Promotes best practices for data security and privacy across departments.
• Drives continuous improvements in data processing methods and standards.
• Oversees QA and testing for data solutions.
• Mentors less experienced data engineers.

Skills

Big Data

Cloud Platform

Data Governance

Data Integration

Data Lifecycle

Data Modeling

Data Operations

Data Pipelines

Data Privacy

Data Quality

Data Security

Data Warehousing

DevOps

General Programming

Metadata Management

NoSQL Databases

Real Time Processing

Education

Bachelor’s Degree in Information Technology or related field

Job description

Marathon Petroleum Corporation is seeking a Senior Data Engineer to design scalable data pipelines and cloud-based data solutions using Azure Data Lake, Synapse Analytics, Azure Functions, and Databricks. You will collaborate with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions.

The ideal candidate has strong Python, SQL, Spark skills, and experience with Azure Data Factory or Databricks Workflows, and will mentor others