Data Platform Engineer: Scalable Ingest & Orchestration

Alight

United States

Hybrid

USD 140,000 - 200,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alight is seeking a senior data engineer to own the technical design, architecture and implementation of the Data Engine’s ingestion, transformation and orchestration infrastructure. You will lead scalable, configuration-driven data pipelines and tooling that support thousands of client workloads in a production environment.

Collaborate with Product, Architecture and Operations to improve reliability, observability and cost efficiency on AWS, and to expand integration capacity while reducing

Qualifications

  • 8+ years of data platform, data engineering or software engineering experience.
  • Deep knowledge of data modeling, SQL, transformation frameworks, orchestration and data quality.
  • Extensive Python engineering experience with reusable abstractions.
  • Experience designing and scaling data platforms with large numbers of pipelines.

Responsibilities

  • Own the technical design, architecture and implementation of the Data Engine ingestion, transformation and orchestration infrastructure.
  • Increase Data Engine integration capacity while reducing manual engineering and operational effort.
  • Design extensible data models, transformation frameworks and configuration-driven abstractions for heterogeneous client and source data.
  • Build developer tooling and reusable platform capabilities for developing, deploying, monitoring and maintaining data integrations.
  • Design scalable orchestration and execution patterns supporting thousands of independently managed data pipelines and workloads.
  • Improve platform reliability, observability and operational efficiency through automated validation, recovery, monitoring and infrastructure optimization.
  • Partner with Product, Architecture, Software Engineering and Operations to align platform capabilities with product delivery and client rollout needs.
  • Deliver scalable configuration-driven integration frameworks, reusable data models, transformation libraries and orchestration patterns.
  • Establish platform standards, documentation, reference implementations and adoption guidance.

Skills

Python programming
SQL knowledge
Data modeling
Data orchestration
Production data systems

Tools

Dagster
AWS

Job description

Alight is seeking a senior data engineer to own the technical design, architecture and implementation of the Data Engine’s ingestion, transformation and orchestration infrastructure. You will lead scalable, configuration-driven data pipelines and tooling that support thousands of client workloads in a production environment.

Collaborate with Product, Architecture and Operations to improve reliability, observability and cost efficiency on AWS, and to expand integration capacity while reducing

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Platform Engineer — Scale Data Pipelines
Staff Data Platform Engineer — Scale Data Pipelines

Alight • Illinois

Hybrid
USD 185,000 - 235,000
Senior Data Engineer - Scalable Pipelines & Platform
Senior Data Engineer - Scalable Pipelines & Platform

Alchemy • New York (NY)

On-site
USD 120,000 - 160,000
Private Health Insurance
Gym Reimbursement
Commuter Benefits
+5
Staff Data Platform Engineer Scale Data Pipelines (Remote)
Staff Data Platform Engineer Scale Data Pipelines (Remote)

Alight Solutions • Belleville (IL)

Hybrid
USD 185,000 - 235,000
Senior Data Platform Engineer: Ingest, Orchestrate & Scale
Senior Data Platform Engineer: Ingest, Orchestrate & Scale

silver • United States

Remote
USD 140,000 - 180,000
Senior Data Engineer: Data Platform & Pipelines
Senior Data Engineer: Data Platform & Pipelines

Alchemy • San Francisco (CA)

On-site
USD 205,000 - 230,000
Private Health Insurance
Gym Reimbursement
Commuter Benefits
+5
Senior Data Platform Engineer – Pipelines & Snowflake
Senior Data Platform Engineer – Pipelines & Snowflake

Alchemy • New York (NY)

On-site
USD 120,000 - 170,000
Private Health Insurance
Gym Reimbursement
Commuter Benefits
+5
Data Platform Engineer: Ingest, Scale & Governance
Data Platform Engineer: Ingest, Scale & Governance

movableink • New York (NY)

On-site
CAD 130,000 - 165,000
Senior Data Platform Lead - Real-Time, AWS
Senior Data Platform Lead - Real-Time, AWS

ALO • Beverly Hills (CA)

On-site
USD 180,000 - 220,000
Senior Data Platform Engineer — Scale & Impact
Senior Data Platform Engineer — Scale & Impact

Aurora Innovation • United States

On-site
USD 146,000 - 260,000
Lead Data Engineer: Build Scalable, Petabyte-Scale Pipelines
Lead Data Engineer: Build Scalable, Petabyte-Scale Pipelines

Anduril Industries • Costa Mesa (CA)

On-site
USD 146,000 - 194,000