Remote Databricks Engineer for Secure Data Pipelines

General Dynamics Information Technology; United States; Hybrid; USD 140,000 - 190,000; Full time

Job summary

General Dynamics Information Technology (GDIT) is seeking a Databricks Engineer to design, build, and operate scalable data pipelines supporting federal and non-federal datasets.

You will work at the intersection of data engineering, cloud technology, and mission analytics, collaborating with data scientists, researchers, software engineers, and platform teams to deliver governed, reliable analytical resources.

Qualifications

• Bachelor's degree in a related technical field.
• 5+ years of data engineering experience with significant Databricks exposure.
• Strong experience with PySpark, SQL, Apache Spark, Delta Lake, and Databricks.
• Production-grade data pipelines and workflows experience.
• Cloud platforms storage experience (AWS S3, Azure Data Lake Storage, GCS).
• Git and CI/CD practices for data workloads.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, and Delta Lake.
• Develop and maintain Databricks notebooks, jobs, and workflows for high-volume analytics.
• Build reliable data ingestion, transformation, validation, and integration processes.
• Migrate and modernize existing data workloads for scalability and performance.
• Tune Spark workloads with partitioning, caching, and joins.
• Implement automated testing, data quality checks, monitoring, and logging.
• Support CI/CD and infrastructure automation for Databricks using Git and Azure DevOps or GitHub Actions.
• Configure and optimize Databricks compute, clusters, runtimes, and jobs.
• Work in secure cloud environments with proper data governance and access controls.
• Troubleshoot production issues and improve data service reliability.
• Collaborate with data scientists and engineers to deliver high-quality datasets.

Skills

Cloud Technology

Databricks Lakeflow

Databricks Platform

Databricks Unity Catalog

Data Lake

Education

Bachelor's degree in Computer Science / Software Engineering / Data Engineering

Job description

General Dynamics Information Technology (GDIT) is seeking a Databricks Engineer to design, build, and operate scalable data pipelines supporting federal and non-federal datasets.

You will work at the intersection of data engineering, cloud technology, and mission analytics, collaborating with data scientists, researchers, software engineers, and platform teams to deliver governed, reliable analytical resources.