Databricks Engineer: Build Secure Data Pipelines

Guidehouse; Arlington (TX); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Medical insurance

401(k) plan

Mobility stipend

Parental leave

Job summary

Guidehouse is seeking a Databricks Engineer to join our AI and Data Defense and Security team to support DHS projects with large-scale data pipelines and production workloads. You will design and maintain scalable ETL pipelines using Databricks, PySpark, SQL, and Delta Lake, while collaborating with data scientists and stakeholders to deliver secure, compliant data solutions.

The role requires strong communication, hands-on delivery, and the ability to own workstreams end-to-end in a fast-paced,

Qualifications

• Bachelor's degree in a related field.
• 5+ years of relevant experience in data engineering or analytics.
• Experience with Databricks and Delta Lake in production.

Responsibilities

• Design, build, and maintain scalable ETL pipelines with Databricks and Delta Lake.
• Tune batch and streaming workloads for performance.
• Troubleshoot job failures and data quality issues.
• Implement CI/CD for notebooks and data jobs.
• Lead Agile delivery and support backlog refinement.
• Collaborate with data scientists and stakeholders.

Skills

Databricks

PySpark

SQL

Delta Lake

CI/CD

Agile Scrum

Kanban

Data governance

Communication

Education

Bachelor's Degree

Tools

Azure DevOps

Jenkins

GitHub Actions

Terraform

Unity Catalog

Job description

Guidehouse is seeking a Databricks Engineer to join our AI and Data Defense and Security team to support DHS projects with large-scale data pipelines and production workloads. You will design and maintain scalable ETL pipelines using Databricks, PySpark, SQL, and Delta Lake, while collaborating with data scientists and stakeholders to deliver secure, compliant data solutions.

The role requires strong communication, hands-on delivery, and the ability to own workstreams end-to-end in a fast-paced,