Lead Data Engineer (Remote - US only)

IllTip

United States

Remote

USD 140,000 - 210,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IllTip, a small software company building products for the U.S. federal government, is hiring a Lead Data Engineer for a health-services modernization program. The role is contingent on contract award and involves setting the technical direction to move legacy data warehouses and pipelines to a cloud lakehouse built on Azure and Databricks.

You will mentor engineers and shape the approach across teams. We seek an experienced engineer who can define migration patterns, implement reusable

Qualifications

  • Authorized to work in the United States; some roles may require U.S. citizenship and the ability to obtain and maintain a federal background investigation and/or security clearance.
  • Bachelor's degree in a relevant field.
  • Leadership experience on large data migration or modernization programs.
  • Deep experience with Databricks or Spark and Azure Data Factory.
  • Strong SQL and Python skills, with experience moving legacy ETL and data warehouse workloads to the cloud.
  • Understanding of lakehouse and medallion architecture, including Delta; experience in federal or regulated data environments is a plus.

Responsibilities

  • Define the technical approach for migrating data and pipelines to the lakehouse.
  • Set migration patterns, reconciliation methods, and data quality gates for delivery teams.
  • Build reusable migration pipelines using Azure Data Factory and Azure Databricks.
  • Specify how source and target data are reconciled to confirm accuracy; Troubleshoot the most difficult pipeline and performance issues.
  • Mentor data engineers, review their code, and coordinate with product, QA, and platform teams.

Skills

Leadership experience
SQL
Python

Education

Bachelor's degree

Tools

Azure Data Factory
Spark / Databricks

Job description

A small software company that builds products for the U.S. federal government is hiring a Lead Data Engineer for a federal health-services modernization program. The role is contingent on contract award. You will set the technical direction for moving legacy data warehouse data and pipelines onto a cloud lakehouse built on Azure and Databricks. The position suits an experienced engineer who wants to shape the approach and mentor others.

Responsibilities

  • Define the technical approach for migrating data and pipelines to the lakehouse
  • Set migration patterns, reconciliation methods, and data quality gates for delivery teams
  • Build reusable migration pipelines using Azure Data Factory and Azure Databricks
  • Specify how source and target data are reconciled to confirm accuracyTroubleshoot the most difficult pipeline and performance issues
  • Mentor data engineers, review their code, and coordinate with product, QA, and platform teams

Requirements

  • Authorized to work in the United States; some roles may require U.S. citizenship and the ability to obtain and maintain a federal background investigation and/or security clearance
  • Bachelor's degree
  • Leadership experience on large data migration or modernization programs
  • Deep experience with Databricks or Spark and Azure Data Factory
  • Strong SQL and Python skills, with experience moving legacy ETL and data warehouse workloads to the cloud
  • Understanding of lakehouse and medallion architecture, including Delta; experience in federal or regulated data environments is a plus

Applicants must be based in: United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer: Remote Azure Lakehouse Migration
Lead Data Engineer: Remote Azure Lakehouse Migration

Oddball • United States

Remote
USD 110,000 - 145,000
Fully remote
401(k) plan
Flexible PTO
+1
Lead Data Engineer
Lead Data Engineer

KDR Talent Solutions USA • United States

Remote
USD 198,000 - 242,000
Competitive compensation
Full benefits package
Flexible remote or hybrid options
+1
Lead Data Engineer (Databricks)
Lead Data Engineer (Databricks)

Celebal Technologies • Grand Rapids (MI)

Hybrid
USD 140,000 - 190,000
Lead Data Engineer (Fully Remote)
Lead Data Engineer (Fully Remote)

Oddball • United States

Remote
USD 140,000 - 190,000
Comprehensive Benefits Package
401(k) company match
Flexible PTO
Senior Data Engineer - Cloud Lakehouse Migrations
Senior Data Engineer - Cloud Lakehouse Migrations

IllTip • United States

Remote
USD 140,000 - 210,000
Lead Data Engineer
Lead Data Engineer

Recru • Houston (TX)

On-site
USD 130,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Envision • Indianapolis (IN)

On-site
USD 140,000 - 190,000
Lead Data Engineer / Databricks Solution Architect
Lead Data Engineer / Databricks Solution Architect

Celebal Technologies • Dallas (TX)

On-site
USD 180,000 - 240,000
Lead Data Engineer (Lakehouse / Databricks)
Lead Data Engineer (Lakehouse / Databricks)

Stafford Gray • Town of Lansing (NY)

Hybrid
USD 130,000 - 180,000
Lead Data Engineer
Lead Data Engineer

MasterApp Labs • Lansing (MI)

Hybrid
USD 83,000 - 165,000
401(k) matching
Dental insurance
Health insurance
+1