Databricks Lakehouse Platform Engineer – Data Governance

General Dynamics Information Technology; Fairfax (VA); On-site; USD 170,000 - 229,000; Full time

Job summary

General Dynamics Information Technology is seeking a Data Platform Engineer to design, build, and govern a Databricks Lakehouse platform. You will manage Unity Catalog, RBAC, and scalable data architectures to enable Data Modernization for the AO program.

Responsibilities include optimizing compute, pipelines, and monitoring, while collaborating with security and governance teams. Strong SQL, Python, and cloud experience are essential.

Qualifications

• Extensive hands-on experience implementing and administering the Databricks Lakehouse Platform including Unity Catalog.
• Experience in performance engineering, scalability testing, and tuning of the data platform.
• Strong SQL, Spark performance tuning, and workload management expertise.
• Proficiency with CI/CD pipelines and automation scripting (Python/Bash).
• Experience operating Databricks in AWS-based or hybrid cloud environments.

Responsibilities

• Design, configure, and maintain the enterprise Databricks Lakehouse Platform, including workspaces and Unity Catalog.
• Administer and optimize Databricks compute, clusters, SQL warehouses, and workload management.
• Develop and optimize data pipelines using Spark, Delta Lake, and Databricks Workflows.
• Implement and govern Unity Catalog RBAC and data governance controls.
• Automate provisioning and deployments using Terraform, Python, SQL, and Databricks APIs.
• Implement monitoring, logging, and performance optimization.

Skills

Databricks Lakehouse expertise

SQL performance tuning

Python scripting

Shell scripting

CI/CD pipelines

Cloud platforms (AWS)

Education

MA/MS degree in a relevant field

Tools

Databricks

Unity Catalog

Terraform

Docker

Kubernetes

Grafana/Prometheus/Datadog/CloudWatch

Jenkins / GitLab CI / GitHub Actions / Azure DevOps

Job description

General Dynamics Information Technology is seeking a Data Platform Engineer to design, build, and govern a Databricks Lakehouse platform. You will manage Unity Catalog, RBAC, and scalable data architectures to enable Data Modernization for the AO program.

Responsibilities include optimizing compute, pipelines, and monitoring, while collaborating with security and governance teams. Strong SQL, Python, and cloud experience are essential.