Senior Databricks Lakehouse Engineer - Platform & Governance

General Dynamics Information Technology, Inc.; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

General Dynamics Information Technology, Inc. seeks a Data Platform Engineer to design, build, and govern a Databricks Lakehouse Platform for AO’s CMM program. You will architect scalable data pipelines, manage Unity Catalog, and optimize performance and costs across cloud environments.

The role requires deep expertise in Spark, SQL, Python, Terraform, and modern data governance with strong collaboration across security and data teams.

Qualifications

• Extensive hands-on Databricks Lakehouse Platform experience including Unity Catalog, clusters, SQL Warehouses, and orchestration.
• Strong SQL, Spark performance tuning, and workload management expertise.
• Hands-on CI/CD pipelines experience (Jenkins, GitHub Actions, Azure DevOps).
• Proficiency in Python and Bash for automation and scripting; SQL skills.

Responsibilities

• Design, build, administer, and govern the Databricks Lakehouse Platform to enable scalable data engineering and analytics.
• Optimize compute, storage, and governance to support AO data objectives and cost efficiency.
• Develop and optimize ETL/ELT pipelines using Apache Spark, Delta Lake, and Databricks Workflows.
• Collaborate with architecture, security, governance, and data teams; provide mentorship to platform users.

Job description

General Dynamics Information Technology, Inc. seeks a Data Platform Engineer to design, build, and govern a Databricks Lakehouse Platform for AO’s CMM program. You will architect scalable data pipelines, manage Unity Catalog, and optimize performance and costs across cloud environments.

The role requires deep expertise in Spark, SQL, Python, Terraform, and modern data governance with strong collaboration across security and data teams.