Senior Databricks Platform Engineer — Remote Lakehouse

General Dynamics Information Technology, Inc.; Washington (District of Columbia); Remote; USD 187,000 - 252,000; Full time

Job summary

General Dynamics Information Technology, Inc. is seeking a Data Platform Engineer to join the Case Management Modernization program. You will design and manage the Databricks Lakehouse Platform, enabling scalable data pipelines, governance, and analytics for a nationwide AO cloud solution.

The role requires extensive Databricks experience, Terraform automation, and strong SQL/Spark capabilities, with remote-friendly work arrangements and collaboration across security and data governance teams.

Qualifications

• 12+ years of general information systems experience with 10+ years in the specified domain.
• Hands-on Databricks Lakehouse Platform administration, Unity Catalog, clusters, and job/workflow orchestration.
• Strong SQL, Spark performance tuning, and workload management expertise.
• Experience with CI/CD pipelines and cloud environments (AWS or hybrid).

Responsibilities

• Design, build, and govern the Databricks Lakehouse Platform for data governance and analytics.
• Administer compute resources, clusters, SQL warehouses, and serverless options for performance and cost control.
• Develop and optimize ETL/ELT pipelines using Spark, Delta Lake, and Delta Live Tables.
• Implement Unity Catalog, RBAC, and data governance controls in AO environments.
• Automate platform provisioning with Terraform and Databricks APIs; monitor and troubleshoot workloads.

Skills

Databricks Lakeflow

Databricks Platform

Data Engineering

Data Ingestion

Education

MA/MS degree

Tools

Jenkins

GitLab CI

GitHub Actions

Azure DevOps

Terraform

Python

Bash

Job description

General Dynamics Information Technology, Inc. is seeking a Data Platform Engineer to join the Case Management Modernization program. You will design and manage the Databricks Lakehouse Platform, enabling scalable data pipelines, governance, and analytics for a nationwide AO cloud solution.

The role requires extensive Databricks experience, Terraform automation, and strong SQL/Spark capabilities, with remote-friendly work arrangements and collaboration across security and data governance teams.