Lead Databricks Data Engineer: Lakehouse & AWS Migration

Halvik; McLean (VA); On-site; USD 130,000 - 195,000; Full time

Benefits offered by this job

Medical, Dental, Vision

Paid Holidays

Performance-based incentives

401(k) matching

FSAs

Tuition Assistance

Charitable Contribution matching

Job summary

Halvik Corp is seeking a Senior Databricks Data Engineer / Technical Lead to support the U.S. Department of Transportation data modernization.

You will design, build, migrate and operate secure, scalable data pipelines in a Databricks Lakehouse, focusing on legacy data migration, metadata-driven ingestion, and production operations. In this hands-on role, you will work with Data Architects, SMEs, and DevSecOps to deliver reliable pipelines using PySpark, SQL and Delta Lake, with AWS S3 and

Qualifications

• Bachelor's degree in computer science, Data Engineering, Information Technology, Engineering, or related field.

Responsibilities

• Strategic Execution: Lead the design and implementation of reusable ingestion and transformation patterns for legacy and external data sources into Databricks, including support for migration to the AWS/OneDOT environment.

Skills

Python

PySpark

SQL

Databricks

Delta Lake

AWS S3

REST APIs

Git/CI/CD

Data orchestration

Education

Bachelor's degree in Computer Science, Data Engineering, IT, Engineering, or related field

Tools

Databricks

Delta Lake

AWS S3

REST APIs

Git/CI/CD

Data orchestration

Job description

Halvik Corp is seeking a Senior Databricks Data Engineer / Technical Lead to support the U.S. Department of Transportation data modernization.

You will design, build, migrate and operate secure, scalable data pipelines in a Databricks Lakehouse, focusing on legacy data migration, metadata-driven ingestion, and production operations. In this hands-on role, you will work with Data Architects, SMEs, and DevSecOps to deliver reliable pipelines using PySpark, SQL and Delta Lake, with AWS S3 and