Senior Data Engineer

Marathon Petroleum Corporation; San Antonio (TX); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health, vision, and dental insurance

401k matching

Paid parental leave

Educational reimbursement

Job summary

Marathon Petroleum Corporation is seeking a Senior Data Engineer in San Antonio, TX. You will design and optimize scalable data pipelines using Azure data services (Data Lake, Synapse, Functions, Databricks) and mentor junior engineers.

The role requires strong Python, SQL, Spark skills and experience with orchestration tools like Azure Data Factory or Databricks Workflows. You will collaborate with analytics, product, governance and business teams.

Qualifications

• Bachelor’s Degree in Information Technology or related field.
• 5+ years of relevant data engineering experience.
• Strong proficiency in Python, SQL, Spark; experience with Azure Data Factory or Databricks Workflows.

Responsibilities

• Designs, develops and optimizes data extraction, ingestion and transformation processes.
• Develops complex data architectures to process and store high-volume data sets.
• Implements data security and privacy measures across pipelines and data stores.
• Performs data quality checks and processing using cloud services and open-source tools.
• Provides technical expertise during critical incidents and outages.
• Promotes best practices for data security, privacy and data integration across departments.
• Drives continuous improvements in data processing methods and standardization.
• Solves complex data engineering problems and contributes to strategic data infrastructure decisions.
• Oversees QA/testing of data solutions and mentors junior engineers.

Skills

Python

SQL

Spark

Azure Data Factory

Databricks Workflows

Data Pipelines

Data Modeling

Data Governance

Mentoring

Education

Bachelor's Degree in Information Technology

Tools

Azure Synapse Analytics

Databricks

Data Lake

Hadoop

Job description

San Antonio, Texas

Findlay, Ohio

Full time

00022182

An exciting career awaits you

At MPC, we’re committed to being a great place to work – one that welcomes new ideas, encourages diverse perspectives, develops our people, and fosters a collaborative team environment.

Position Summary

As a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data architecture, Azure data services, including Data Lake, Synapse Analytics, Azure Functions, and Databricks.

This role also includes close collaboration with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions. The ideal candidate brings strong technical depth (strong proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows), a continuous improvement mindset, and the ability to mentor while contributing to engineering standards, reusable patterns, and solution design reviews.

This position belongs to a family of jobs with increasing responsibility, competency, and skill level. Actual position title and pay grade will be based on the selected candidate’s experience and qualifications.

Key Responsibilities

• Conducts the design, innovation and optimization of data extraction, ingestion and transformation processes.
• Facilitates the development and design of complex data architecture to process and store high-volume data sets.
• Enables the development of complex data pipelines; advocates for and implements data security and privacy measures.
• Conducts complex data quality and processing tasks using open source and cloud services.
• Provide technical expertise during critical incidents.
• Facilitates the adoption of best practices for data security and privacy and collaborates with other departments to ensure seamless data integration.
• Facilitates the implementation of continuous improvements in data processing methods and drives consistency and best practices across data engineering projects.
• Solves complex problems; takes a new perspective on existing solutions; participates in strategic planning sessions for data infrastructure.
• Oversee quality assurance and testing for data solutions.
• Mentors less experienced data engineers.

Education and Experience

• Bachelor’s Degree in Information Technology, related field or equivalent experience
• 5+ years of relevant data engineering experience

Skills

• Big Data Technologies - Familiarity with big data technologies and frameworks, such as Hadoop, Spark, and distributed computing, for processing and analyzing large volumes of data.
• Cloud Platform - Knowledge of cloud-based data platforms, such as AWS, Azure, or GCP, and their associated services for data storage, processing, and analytics.
• Data Governance - Ability to establish and oversee a set of procedures, policies, and standards that ensure the effective and efficient management of an organization's data assets. This includes ensuring data quality, compliance with relevant laws and regulations, and secure data handling practices. It also involves the coordination between different departments to ensure that data is accurate, accessible, and used responsibly and ethically.
• Data Integration - Proficiency in integrating data from various sources, including structured and unstructured data, using technologies such as ETL (Extract, Transform, Load) processes, data pipelines, and data ingestion frameworks.
• Data Lifecycle - The data lifecycle refers to the sequential stages that data goes through from its creation or acquisition to its eventual disposal. These stages typically include data creation, storage, processing, analysis archival, and eventual deletion or destruction, with each phase governed by specific policies and practices.
• Data Modeling - Skill in designing and implementing data models that align with business requirements, ensuring data integrity, performance, and scalability.
• Data Operations - Data operations refer to the various actions and processes involved in managing, manipulating, and analyzing data throughout its lifecycle. These operations encompass tasks such as collection, storage, retrieval, transformation, and visualization of data to derive meaningful insights and support decision-making.
• Data Pipelines - Data pipelines are a set of processes that enable the flow of data from one or multiple sources to a destination, often involving tasks such as extraction, transformation, and loading (ETL). These pipelines are designed to efficiently and reliably move and process data, ensuring its quality and accessibility for various analytical and operational purposes.
• Data Privacy - Ability to understand and implement practices that ensure the protection and confidential handling of personal and sensitive information. This includes knowledge of relevant laws and regulations (such as GDPR or HIPAA), the ability to design and enforce policies that safeguard data, and the skills to manage data access rights and consent protocols.
• Data Quality Management – Strong understanding of data quality dimensions, methodologies, and best practices to establish and maintain data quality standards and processes.
• Data Security - Knowledge of data privacy regulations, cybersecurity best practices, and techniques for protecting sensitive information and ensuring compliance.
• Data Warehousing (DW) - Knowledge of monitoring and observability tools and practices for tracking data pipeline performance, data quality, and system health.
• DevOps- A set of practices that combines software development and information-technology operations which aims to shorten the systems development life cycle and provide continuous delivery with high software quality and a security first approach.
• General Programming – Applies a computer language to communicate with computers using a set of instructions and to automate the execution of tasks.
• Metadata Management – Proficiency in metadata management solutions to enable efficient data discovery, data lineage tracing, and data asset management.
• NoSQL Databases – NoSQL databases are a type of database management system that provides a flexible and scalable approach to storing and retrieving data, often diverging from the traditional relational database model. Unlike relational databases, NoSQL databases are designed to handle large volumes of unstructured or semi-structured data, offering high performance and horizontal scalability for modern applications.
• Real Time Processing – Real-time processing refers to the method of handling data or performing computations immediately as they occur, without any noticeable delay. In real-time processing systems, data is processed, and responses are generated within a timeframe that meets the requirements of the application or task, typically within milliseconds or microseconds.

MINIMUM QUALIFICATIONS:Bachelor’s Degree in Information Technology, related field or equivalent experience.5+ years of relevant experience

As an energy industry leader, our career opportunities fuel personal and professional growth.

Location:

San Antonio, Texas

Additional locations:

Findlay, Ohio

Job Requisition ID:

00022182

Location Address:

19100 Ridgewood Pkwy

Education:

Bachelors: Information Technology

Employee Group:

Full time

Employee Subgroup:

Regular

Marathon Petroleum Company LP is an Equal Opportunity Employer and gives consideration for employment to qualified applicants without discrimination on the basis of race, color, religion, creed, sex, gender (including pregnancy, childbirth, breastfeeding or related medical conditions), sexual orientation, gender identity, gender expression, reproductive health decision-making, age, mental or physical disability, medical condition or AIDS/HIV status, ancestry, national origin, genetic information, military, veteran status, marital status, citizenship or any other status protected by applicable federal, state, or local laws. If you would like more information about your EEO rights as an applicant, If you need a reasonable accommodation for any part of the application process at Marathon Petroleum LP, please contact our Human Resources Department at [e-mail] . Please specify the reasonable accommodation you are requesting, along with the job posting number in which you may be interested. A Human Resources representative will review your request and contact you to discuss a reasonable accommodation. Marathon Petroleum offers a total rewards program which includes, but is not limited to, access to health, vision, and dental insurance, paid time off, 401k matching program, paid parental leave, and educational reimbursement. Detailed benefit information is available at https://mympcbenefits.com .The hired candidate will also be eligible for a discretionary company-sponsored annual bonus program. Equal Opportunity Employer: Veteran / Disability

We will consider all qualified Applicants for employment, including those with arrest or conviction records, in a manner consistent with the requirements of applicable state and local laws. In reviewing criminal history in connection with a conditional offer of employment, Marathon will consider the key responsibilities of the role.

About Marathon Petroleum Corporation

Marathon Petroleum Corporation (MPC) is a leading, integrated, downstream energy company headquartered in Findlay, Ohio. The company operates the nation's largest refining system. MPC's marketing system includes branded locations across the United States, including Marathon brand retail outlets. MPC also owns the general partner and majority limited partner interest in MPLX LP, a midstream company that owns and operates gathering, processing, and fractionation assets, as well as crude oil and light product transportation and logistics infrastructure.