Senior Data Engineer — Lakehouse & Pipelines Lead

ADP, Inc.; Paris (VA); On-site; USD 150,000 - 165,000; Full time

Benefits offered by this job

Medical, dental, vision coverage

401(k) with company contribution

Paid time off + eleven federal HOLID?

Certification reimbursement

Life and disability insurance

Job summary

SHR Consulting Group, LLC is seeking a senior Lead Data Engineer to lead data pipeline engineering, operations, performance, migration, and integration activities supporting an enterprise FEMA effort.

You will design, build, test, deploy, and maintain scalable batch and streaming pipelines, implement metadata-driven ingestion, and ensure resilient schema evolution across a cloud-based lakehouse environment. This role is contingent on contract award.

Qualifications

• Extensive hands-on experience designing and developing enterprise data pipelines.
• Demonstrated experience with Databricks or comparable cloud-based Lakehouse platforms.
• Strong knowledge of metadata-driven data ingestion frameworks.
• Strong knowledge of schema evolution and enterprise data-processing patterns.
• Demonstrated ability to troubleshoot live production pipeline failures.

Responsibilities

• Lead technical delivery for FEMA pipeline engineering, operations, and migration.
• Design, construct, test, deploy, and maintain scalable batch and streaming data pipelines.
• Build and maintain metadata-driven ingestion pipelines.
• Implement robust schema evolution and data-processing patterns.
• Diagnose and resolve production pipeline failures and complex data-storage issues.
• Design pipelines aligned with FEMA architecture and best practices.
• Provide technical leadership and mentoring to engineers.

Skills

Enterprise data pipelines

Databricks / Lakehouse

Metadata-driven ingestion

CI/CD

Data quality

Technical leadership

Tools

Databricks

Job description

SHR Consulting Group, LLC is seeking a senior Lead Data Engineer to lead data pipeline engineering, operations, performance, migration, and integration activities supporting an enterprise FEMA effort.

You will design, build, test, deploy, and maintain scalable batch and streaming pipelines, implement metadata-driven ingestion, and ensure resilient schema evolution across a cloud-based lakehouse environment. This role is contingent on contract award.