Staff Data Engineer, Core Migrations

machinifyinc

United States

On-site

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Machinify is seeking a Staff Data Engineer on the Migrations team to own client migrations end-to-end, from discovery through go-live and hypercare. You will reconstruct legacy logic, design scalable pipelines in Airflow and Spark, and coordinate across Operations, Client Success, Product, Data Science and Platform Engineering.

You will work in a high-trust, high-autonomy role, writing the code and making architectural decisions that impact the livelihood of health plan clients nationwide.

Qualifications

  • 8+ years hands-on Data Engineer or Software Engineer leading complex, multi-stakeholder projects from start to finish.
  • Strong Python and SQL—fluent with complex, unfamiliar legacy code.
  • Apache Spark—deep understanding of distributed processing, tuning, and debugging at scale.
  • Apache Airflow—advanced production DAG architectures from scratch.
  • AI-assisted development—uses coding agents effectively for code generation, debugging, and documentation.

Responsibilities

  • Lead discovery & technical due diligence to reconstruct legacy business logic and map it for migration.
  • Reverse-engineer complex legacy systems (SSIS, stored procedures) to design modern equivalents.
  • Architect and build migration pipelines with Airflow DAGs and Spark jobs on the Machinify platform.
  • Own the end-to-end migration workflow from ingestion through reconciliation to handoff.
  • Document architectural decisions and runbooks to uplift the practice and mentor junior engineers.

Skills

Python
SQL
Apache Spark
Apache Airflow
AI-assisted coding
Legacy ETL
AWS
Cross-functional coordination
Technical communication

Tools

SSIS
SQL Server

Job description

Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 85 health plans, including many of the top 20, and representing more than 270 million lives, Machinify brings together a fully configurable and content-rich, AI-powered platform along with best-in-class expertise. We're constantly reimagining what's possible in our industry, creating disruptively simple, powerfully clear ways to maximize financial outcomes and drive down healthcare costs.

As a Staff Data Engineer on the Migrations team , you are the end-to-end technical and operational owner of client migrations. You will drive the full lifecycle, from deep-dive legacy analysis to production deployment, while orchestrating collaboration across Operations, Client Success, Product, Data Science and Platform Engineering. You don't just implement; you own the outcome.

This is a high-trust, high-autonomy role for someone who can think like an architect, execute like a senior engineer, and coordinate like a program manager - all on the same project. You'll own the problem space from discovery to go-live, making the defining architectural decisions and writing the code that brings them to life.

What You'll Do
  • Lead discovery & technical due diligence - get to the bottom of poorly documented legacy systems (ETL, stored procedures, reporting layers, file feeds), reconstruct the business logic, and capture it in the lineage maps, mapping specs, and risk analyses everyone builds from.
  • Reverse-engineer complex legacy systems using agents- you will be responsible for reverse-engineering complex, undocumented legacy systems (SSIS packages, stored procedures) where business logic is embedded, not documented. You must be able to reconstruct the intent of these systems to build modern, stable equivalents.
  • Drive ambiguity to resolution - spot the unknowns early, own the open questions, and pull answers from clients, SMEs, and Operations instead of waiting to be unblocked.
  • Architect & build the migration pipelines - turn intricate legacy logic into production-grade Airflow DAGs and Spark jobs on the Machinify platform, edge cases, payer-specific carve-outs, and business-rule exceptions included, owning the full flow from ingestion through reconciliation to steady-state handoff.
  • Make and document the hard architectural calls - own the decisions that matter (pipeline design, partitioning strategy, validation approach) and leave a clear trail of the reasoning so others can learn from and build on it.
  • Prove correctness at scale - build automated reconciliation frameworks that confirm, with confidence, that migrated output matches the source down to the row.
  • Own the program end to end - be the single technical owner from kickoff through go-live and hypercare: scope, sequence, and track the work, surface risks before they bite, align Operations, Client Success, Platform Engineering, SMEs, and the client, and drive UAT through to sign-off.
  • Raise the bar for the practice - Institutionalize migration knowledge by codifying runbooks and retrospectives, mentor L3/L4 engineers to build independent capability, and turn recurring migration pain points into scalable, reusable tooling.
What You Bring
  • 8+ years a s a hands-on Data Engineer or Software Engineer, with demonstrated experience independently owning complex, multi-stakeholder technical projects from start to finish.
  • Strong Python and SQL - fluent with complex, unfamiliar legacy code, not just greenfield work.
  • Apache Spark - deep understanding of distributed processing, performance tuning, partitioning, and debugging at scale.
  • Apache Airflow - advanced; comfortable designing and authoring production DAG architectures from scratch.
  • AI-assisted development - actively uses coding agents (Claude, Copilot, Cursor, or equivalent) as a force multiplier in daily engineering work. Comfortable prompt-engineering for code generation, debugging, and documentation, and able to evaluate and trust AI output critically.
  • Legacy ETL stack - able to reconstruct intent from code and translate it faithfully into a modern stack (e.g., From SSIS, SQL Server stored procedures, T-SQL, or equivalent).
  • Data validation & reconciliation at scale - experience designing automated frameworks that prove migrated data matches source systems with high confidence.
  • AWS - proficient with S3, solid grasp of cloud-native data patterns such as partitioned object storage, secure cross-account access, and cost/performance trade-offs.
  • Cross-functional coordination - proven ability to drive alignment across engineering, operations, and client-facing teams simultaneously, without losing velocity.
  • Clear technical communication - able to write discovery specs, architecture docs, and stakeholder updates that are accurate, concise, and actionable for both technical and non-technical audiences.
  • Dat
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Engineer, Migrations & Platform Architecture
Staff Data Engineer, Migrations & Platform Architecture

machinifyinc • United States

On-site
USD 150,000 - 210,000
Software Engineering Manager, AI Migrations (Forward Deployed)
Software Engineering Manager, AI Migrations (Forward Deployed)

FDE Times • Menlo Park (CA)

On-site
USD 190,000 - 240,000
Data Migration Development Lead _ AY
Data Migration Development Lead _ AY

Central Business Solutions, Inc • St. Louis (MO)

On-site
USD 120,000 - 160,000
Senior Data Engineer - Legacy Database Modernization
Senior Data Engineer - Legacy Database Modernization

Ajentica • United States

Remote
USD 140,000 - 190,000
Staff Data Engineer
Staff Data Engineer

MeeruAI • Pleasanton (CA)

On-site
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Rawlings Company • United States

Remote
USD 180,000 - 220,000
Remote US
Healthcare
Unlimited PTO
+3
Sr Data Engineer
Sr Data Engineer

Cox Automotive • Atlanta (GA)

On-site
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 180,000
Technical Lead
Technical Lead

Overture Partners, LLC • Massachusetts

On-site
USD 120,000 - 150,000
Data Engineer
Data Engineer

Gennte Technologies • Philadelphia

On-site
USD 140,000 - 190,000