Senior Data Engineer

4500 Marathon Petroleum Company LP; San Antonio (TX); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Health insurance

401k matching program

Paid parental leave

Educational reimbursement

Discretionary annual bonus

Job summary

Marathon Petroleum Company LP is looking for a Senior Data Engineer located in San Antonio, Texas. You will design, develop, and optimize scalable data pipelines and cloud-based data solutions using Azure data services.

The ideal candidate will work closely with various teams to translate requirements into effective data solutions and employ a strong technical background in Python, SQL, and big data technologies.

The benefits package includes health insurance, a 401k matching program, and access to an annual bonus program.

Qualifications

• 5+ years of data engineering experience.
• Proficiency in big data technologies, cloud platforms, and data governance.
• Ability to establish and optimize data models and pipelines.

Responsibilities

• Design and optimize data extraction and transformation processes.
• Facilitate the development of complex data architecture.
• Enable the development of data pipelines and advocate for data security.

Skills

Python

SQL

Spark

Azure Data Factory

Databricks

Hadoop

AWS

GCP

ETL processes

NoSQL

DevOps

Education

Bachelor’s Degree in Information Technology

Job description

Position Summary

As a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data architecture, Azure data services, including Data Lake, Synapse Analytics, Azure Functions, and Databricks. This role also includes close collaboration with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions.

The ideal candidate brings strong technical depth (proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows), a continuous improvement mindset, and the ability to mentor while contributing to engineering standards, reusable patterns, and solution design reviews.

Key Responsibilities

• Conduct the design, innovation and optimization of data extraction, ingestion and transformation processes.
• Facilitate the development and design of complex data architecture to process and store high-volume data sets.
• Enable the development of complex data pipelines; advocate for and implement data security and privacy measures.
• Conduct complex data quality and processing tasks using open source and cloud services.
• Provide technical expertise during critical incidents.
• Facilitate the adoption of best practices for data security and privacy and collaborate with other departments to ensure seamless data integration.
• Facilitate the implementation of continuous improvements in data processing methods and drive consistency and best practices across data engineering projects.
• Solve complex problems; take a new perspective on existing solutions; participate in strategic planning sessions for data infrastructure.
• Oversee quality assurance and testing for data solutions.
• Mentor less experienced data engineers.

Education and Experience

Bachelor’s Degree in Information Technology, related field or equivalent experience.

5+ years of relevant data engineering experience.

Skills

• Big Data Technologies: Familiarity with Hadoop, Spark, and distributed computing for processing and analyzing large volumes of data.
• Cloud Platform: Knowledge of AWS, Azure, or GCP and their associated services for data storage, processing, and analytics.
• Data Governance: Ability to establish procedures, policies, and standards ensuring data quality, compliance, and secure handling.
• Data Integration: Proficiency in integrating data from various sources using ETL processes, data pipelines, and ingestion frameworks.
• Data Lifecycle: Understanding of stages from creation to disposal governed by policies.
• Data Modeling: Design and implement data models aligning with business requirements, ensuring integrity, performance, and scalability.
• Data Operations: Managing, manipulating, and analyzing data throughout its lifecycle for meaningful insights.
• Data Pipelines: Enable reliable flow of data from sources to destinations with ETL.
• Data Privacy: Implement practices ensuring protection of personal and sensitive information.
• Data Quality Management: Knowledge of quality dimensions, methodologies, and best practices.
• Data Security: Awareness of cybersecurity best practices and protection of sensitive information.
• Data Warehousing: Monitoring and observability of data pipeline performance and system health.
• DevOps: Integration of software development and IT operations for continuous delivery with security focus.
• General Programming: Use of a programming language to automate tasks.
• Metadata Management: Proficiency in solutions for data discovery, lineage tracing, and asset management.
• NoSQL Databases: Use of NoSQL for flexible, scalable storage of unstructured data.
• Real-Time Processing: Handling data immediately with minimal latency.

Minimum Qualifications

• Bachelor’s Degree in Information Technology, related field or equivalent experience.
• 5+ years of relevant experience.

Location

San Antonio, Texas (Additional locations: Findlay, Ohio).

Benefits

Marathon Petroleum offers a total rewards program which includes, but is not limited to, access to health, vision, and dental insurance, paid time off, 401k matching program, paid parental leave, and educational reimbursement. Detailed benefit information is available at https://mympcbenefits.com. The hired candidate will also be eligible for a discretionary company-sponsored annual bonus program.

EEO Statement

Marathon Petroleum Company LP is an Equal Opportunity Employer and gives consideration for employment to qualified applicants without discrimination on the basis of race, color, religion, creed, sex, gender (including pregnancy, childbirth, breastfeeding or related medical conditions), sexual orientation, gender identity, gender expression, reproductive health decision‑making, age, mental or physical disability, medical condition or AIDS/HIV status, ancestry, national origin, genetic information, military, veteran status, marital status, citizenship or any other status protected by applicable federal, state, or local laws.