Global Data Engineering Lead - Enterprise-Scale Pipelines & AI

BP p.l.c.

United States

Remote

USD 180,000 - 240,000

Full time

5 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Flexible working options
Global team
Retirement benefits

Job summary

BP p.l.c. is seeking a Senior Enterprise Tech Engineer to establish and lead the Data Engineering squad within the global TA&I data team.

You will build and guide a high-performing group responsible for enterprise-scale data pipelines, mentoring 8–10 engineers and shaping the data engineering roadmap across multiple environments. You will apply deep expertise in Python, SQL, ETL, cloud platforms, and orchestration at scale, using Generative AI and modern DevOps to empower front-office trading

Qualifications

  • 10+ years as a Data Engineer with leadership experience.
  • Experience building market data solutions in trading/financial services.
  • Strong Python (Pandas, web scraping) and SQL with optimization skills.

Responsibilities

  • Establish and lead a global data engineering squad and set the technical direction.
  • Design, develop and deploy scalable data pipelines with Python, SQL and Airflow.
  • Oversee ETL of large time-series datasets from diverse sources (APIs, DBs, streams).
  • Leverage Generative AI platforms to deliver new capabilities for trading.
  • Work with AWS services to build secure, cost-efficient pipelines and optimise TCO.
  • Mentor 8–10 engineers and promote knowledge sharing and learning.
  • Collaborate across global teams and manage workload with Agile and ADO.

Skills

Python
SQL
Apache Airflow
AWS
Generative AI
CI/CD
Data pipelines

Education

Bachelor’s or Master’s degree in CS or related field

Tools

Tableau
Power BI
Databricks
PostgreSQL
Git
Azure DevOps
S3/Redshift

Job description

BP p.l.c. is seeking a Senior Enterprise Tech Engineer to establish and lead the Data Engineering squad within the global TA&I data team.

You will build and guide a high-performing group responsible for enterprise-scale data pipelines, mentoring 8–10 engineers and shaping the data engineering roadmap across multiple environments. You will apply deep expertise in Python, SQL, ETL, cloud platforms, and orchestration at scale, using Generative AI and modern DevOps to empower front-office trading

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Enterprise Technology Engineer
Enterprise Technology Engineer

BP p.l.c. • United States

Remote
USD 180,000 - 240,000
Flexible working options
Global team
Retirement benefits
Data Engineering Lead: Enterprise Pipelines & AI
Data Engineering Lead: Enterprise Pipelines & AI

Bollinger Shipyards, Inc. • Metairie (LA)

On-site
USD 130,000 - 180,000
Senior Data Engineer: Pipelines & Governance Lead
Senior Data Engineer: Pipelines & Governance Lead

Highmark Health • Topeka (KS)

On-site
USD 103,000 - 165,000
Staff Data Engineering Lead - Scalable Pipelines
Staff Data Engineering Lead - Scalable Pipelines

EngineersOfAI • Seattle (WA)

On-site
USD 130,000 - 170,000
Data Platform Engineering Lead - Build & Mentor Pipelines
Data Platform Engineering Lead - Build & Mentor Pipelines

Reflection AI Ltd • New York (NY)

On-site
USD 180,000 - 300,000
Top-tier compensation
Stock options
Health & wellness
+5
Senior Data Engineer: Build Scalable AI Pipelines
Senior Data Engineer: Build Scalable AI Pipelines

CI&T • United States

Remote
USD 110,000 - 150,000
Premium Healthcare
Meal voucher
Maternity and Parental leaves
+5
Lead Data Engineer: Architect & Deliver Scalable Pipelines
Lead Data Engineer: Architect & Deliver Scalable Pipelines

EPAM Systems • United States

Remote
USD 140,000 - 190,000
Healthcare benefits
Employee training & certificates
Paid time off
Data Engineer: Build Scalable Pipelines, AI Workflows
Data Engineer: Build Scalable Pipelines, AI Workflows

Globaldev Group • United States

Remote
USD 110,000 - 180,000
20 days vacation
Public holidays
Mobilization reservation for Ukrainian
+2
Lead AI/ML Data Engineer: Scalable Pipelines & Ops
Lead AI/ML Data Engineer: Scalable Pipelines & Ops

BlackLine Systems, Inc. • Seattle (WA)

Hybrid
USD 245,000 - 307,000
Lead Data Engineer: Scalable Pipelines & Architecture
Lead Data Engineer: Scalable Pipelines & Architecture

TALENT Software Services • Charleston (SC)

On-site
USD 120,000 - 180,000