Databricks Data Engineer Lead — Remote, Federal Clearance

The Judge Group; Arlington (VA); Remote; USD 120,000 - 150,000; Full time

Benefits offered by this job

Healthcare

401k

Job summary

Supporting the Federal Gov in Arlington, VA is seeking multiple Databricks data engineers at mid, senior, and lead levels. The role demands US citizenship and eligibility for an E Public Trust clearance, with fully remote work options.

The salary ranges from $120,000 to $150,000 per year, plus healthcare and 401k benefits. You will build and test Databricks pipelines, develop ETL/ELT solutions, ensure data quality, and collaborate with architects, engineers, and governance teams on a large

Qualifications

• Bachelor’s degree in computer science, data engineering, information systems, analytics, or a related field.
• Minimum 4 years of experience in data engineering, software development, ETL/ELT, cloud analytics, or a related technical discipline.
• Hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, and workflow orchestration.
• Experience building, testing, and maintaining batch data pipelines and curated data layers.
• Familiarity with Git, CI/CD, automated testing, deployment, monitoring, and troubleshooting.

Responsibilities

• Builds and maintains Databricks ingestion, transformation, orchestration, migration, and data-processing pipelines.
• Develop scalable ETL/ELT solutions using Databricks, Apache Spark, PySpark, Python, SQL, and Delta Lake.
• Implement source-to-target mappings, transformation rules, business logic, data contracts, metadata, lineage, and data-quality requirements.
• Develop migrated data feeds, APIs, curated datasets, reporting layers, and reusable data products.
• Create reconciliation routines and support source-to-target validation, exception analysis, and defect resolution.
• Build unit, integration, regression, performance, and data-quality tests and document technical results.
• Support Git-based development, CI/CD, release management, deployment, monitoring, troubleshooting, and stabilization.
• Analyze and resolve job failures, cluster-performance issues, pipeline bottlenecks, schema changes, and data-quality problems.
• Collaborate with data architects, engineering leads, integration engineers, profiling analysts, testers, security specialists, governance leads, and source-system teams.
• Document reusable code, technical patterns, runbooks, troubleshooting procedures, and lessons learned for later modernization waves.
• Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, and technical reviews.

Skills

Databricks

Apache Spark

PySpark

Python

SQL

Data pipelines

Education

Bachelor’s degree in computer science, data engineering, information systems, analytics, or related field

Tools

Delta Lake

Git

CI/CD

Workflow orchestration

Job description

Supporting the Federal Gov in Arlington, VA is seeking multiple Databricks data engineers at mid, senior, and lead levels. The role demands US citizenship and eligibility for an E Public Trust clearance, with fully remote work options.

The salary ranges from $120,000 to $150,000 per year, plus healthcare and 401k benefits. You will build and test Databricks pipelines, develop ETL/ELT solutions, ensure data quality, and collaborate with architects, engineers, and governance teams on a large