Senior Data Engineer, Data Platforms and Integrations

Global GP LLC; United States; On-site; USD 182,000 - 190,000; Full time

Benefits offered by this job

Health Insurance

Dental Insurance

Vision Insurance

401k with match

Tuition reimbursement

Job summary

Global Partners LP seeks a senior Data Engineer to architect and operate their production data ingestion, integration, and analytics platform. You will design scalable AWS pipelines with Dagster, develop Snowflake/dbt models, and deploy containerized services on AWS ECS/Fargate.

You will establish CI/CD workflows with GitHub Actions and manage credentials with Secrets Manager, ensuring data quality and privacy." Collaborating with cross-functional teams across wholesale and trading, you’ll lead

Qualifications

• Master’s degree in Computer Science, IT or related field with 5 years in data engineering, software development, or systems architecture.
• Experience designing and supporting integration solutions; proficient in Python for data-intensive apps; REST APIs and Python frameworks like FastAPI; SQL/NoSQL databases.
• 4 years building cloud-native data solutions on AWS/Azure; 4 years with Docker and Kubernetes.
• 2 years building pipelines with ETL/ELT tools (Fivetran, Dagster, dbt, Snowflake); CI/CD with GitHub Actions; IaC with CloudFormation/Terraform; observability and data privacy/compliance.

Responsibilities

• Architect, build, and operate production data ingestion, integration, analytics, and data-platform solutions.
• Design scalable pipelines in AWS with Dagster; develop analytics models in Snowflake/dbt; deploy containerized services on AWS ECS/Fargate using Docker and CloudFormation.
• Establish CI/CD workflows via GitHub Actions; manage credentials with AWS Secrets Manager; implement monitoring, observability, and data-quality controls.
• Build and support source-ingestion, API, reverse-ETL, and backend data apps using Fivetran, Python, FastAPI, and Streamlit.
• Develop master data management solutions and automated data-governance guardrails for key entities.
• Apply AI-assisted development tools and build scalable data products using modern agile practices.
• Partner with terminal, wholesale, retail, supply, and trading teams; mentor and maintain runbooks; promote automation-first engineering.

Skills

Python

REST APIs

FastAPI

SQL

NoSQL

AWS

Docker

Kubernetes

Dagster

dbt

Snowflake

Fivetran

GitHub Actions

CloudFormation

Terraform

Prometheus

Grafana

Metaplane

Streamlit

Education

Master’s degree in Computer Science / IT

Tools

Docker

Kubernetes

AWS

Azure

CloudFormation

Terraform

GitHub Actions

Snowflake

Fivetran

Dagster

dbt

FastAPI

Job description

Job Summary: At Global Partners, business starts with people. Since 1933, we’ve believed in taking care of our customers, our guests, our communities, and each other—and that belief continues to guide us. The Global Spirit is how we work to fuel that long term commitment to success. As a Fortune 500 company with 90+ years of experience, we’re proud to fuel communities—responsibly and sustainably. We show up every day with grit, passion, and purpose—anticipating needs, building lasting relationships, and creating shared value.

Job Description

Responsibilities

• Architect, build, and operate the Company’s production data ingestion, integration, analytics, and data-platform solutions.


• Design and orchestrate scalable pipelines in AWS using Dagster, develop tested analytics models and transformation processes in Snowflake and dbt, and deploy containerized platform services on AWS ECS/Fargate using Docker and CloudFormation.


• Establish CI/CD workflows through GitHub Actions, manage secure configurations and credentials through AWS Secrets Manager, and implement monitoring, alerting, observability, data-quality controls, and privacy safeguards across development, test, and production environments.


• Build and support source-ingestion, API, reverse-ETL, and backend data applications using tools such as Fivetran, Python, FastAPI, and Streamlit.


• Develop master data management solutions, governed single sources of truth, and automated data-governance guardrails for key business entities.


• Apply AI-assisted development tools, contribute reusable AI development capabilities, and build MCP servers and other scalable data products using modern product-development and agile practices.


• Partner with terminal, wholesale, retail, supply, and trading teams; provide technical leadership and mentorship; maintain architecture documentation and operational runbooks; and champion automation-first engineering standards.

Requirements

Master’s degree in Computer Science, Information Technology or a related field and five years of experience as a Data Engineer, Software Developer, Systems Analyst/Architect or related role.

Experience must include five years each of the following: designing, developing, and supporting integration solutions; programming in Python on data-intensive applications; working with REST API protocols and Python API frameworks such as FastAPI; and working with SQL and NoSQL databases.

Experience must include four years each of the following: building cloud-native data solutions on AWS/Azure; and working with Docker and Kubernetes.

Experience must include two years each of the following: building data pipelines with ETL/ELT tools Fivetran, Dagster, dbt and Snowflake; implementing CI/CD using GitHub Actions; authoring infrastructure-as-code using AWS CloudFormation/Terraform; implementing observability and monitoring for data pipelines using tools such as Prometheus, Grafana, or Metaplane; and building and maintaining data pipelines that comply with data privacy and security regulations such as HIPAA/GDPR. Experience may be gained concurrently.

Pay Range: $182,300.00 - $190,000.00.

The pay range for this position is outlined above. The final amount offered at the start of employment is determined based on factors including, but not limited to, experience level, knowledge, skills, abilities and geographic location, and the Company reserves the right to modify base salary at any time, including for reasons related to individual performance, Company or individual department/team performance and market factors.

Benefits

• We offer competitive salaries and opportunities for growth. We have an amazing Talent Development Team who create trainings for growth and job development.


• Health & Wellness - Medical, Dental, Visions and Life Insurance.


• Along with additional wellness support.


• The Road Ahead – We offer 401k and a match component!


• Professional Development - We provide tuition reimbursement; this benefit is offered after 6 months of service.

Equal Opportunity and Diversity

Global Partners LP is an equal opportunity employer. We foster a company culture where ideas from all people help us grow, move and thrive. We embrace the diversity of all applicants and do not discriminate against race, color, religion, sex, age, national origin, sexual orientation, gender identity, disability, protected veteran status or any other basis prohibited by federal, state or local law.

If you have a disability and need an accommodation to apply, please contact our recruiting department at 781-747-9675 or 781-7GP-WORK.

*Disclaimer: At Global Partners, we don't use lie detector tests for any employment decisions. We follow all the rules and regulations, so we need to let you know: In Massachusetts, it's illegal to require or administer a lie detector test as a condition of employment of continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.