Cleared Data Engineer — Databricks & Cybersec Analytics

US101 Guidehouse Inc.

Arlington (VA)

On-site

USD 85,000 - 141,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, Rx, Dental & Vision Insurance
401(k) Retirement Plan
Parental Leave and Adoption Assistance
Mobility Stipend

Job summary

Guidehouse is seeking a Data Engineer to design, build, and maintain scalable data pipelines (batch and streaming) in Databricks using Python, PySpark and SQL. You will transform raw data into analysis-ready datasets and support cybersecurity metrics, dashboards and executive reporting.

The role requires a current Active Secret clearance, a Bachelor’s degree, and 6+ years in data or programming with 3+ years in data engineering. Travel up to 50% to client sites and offices is expected.

Qualifications

  • ACTIVE and CURRENT SECRET federal security clearance.
  • Bachelor’s degree required.
  • Six years of total experience in data or programming, including three years in data engineering.
  • Proficiency in Python, PySpark and SQL.
  • Experience with scheduling, monitoring, troubleshooting, and optimizing ETL/ELT pipelines.
  • Willingness to commute to client and Guidehouse offices as needed.

Responsibilities

  • Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines.
  • Transform raw data into curated datasets and dimensional models for metrics and dashboards.
  • Develop automated data-quality controls for ETL processes.
  • Define handling for failed quality checks and coordinate corrective action.
  • Schedule and orchestrate production workflows; monitor and troubleshoot.
  • Optimize pipeline reliability, performance, and cost.
  • Maintain data governance, metadata, lineage, and access controls.
  • Maintain source-to-target mappings, data dictionaries, and runbooks.
  • Collaborate with analysts, data owners, and stakeholders to define requirements.

Skills

Python
PySpark
SQL
Data engineering
Problem solving
Communication

Education

Bachelor’s degree
Master’s degree

Tools

Databricks

Job description

Guidehouse is seeking a Data Engineer to design, build, and maintain scalable data pipelines (batch and streaming) in Databricks using Python, PySpark and SQL. You will transform raw data into analysis-ready datasets and support cybersecurity metrics, dashboards and executive reporting.

The role requires a current Active Secret clearance, a Bachelor’s degree, and 6+ years in data or programming with 3+ years in data engineering. Travel up to 50% to client sites and offices is expected.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Active-Secret Data Engineer: Databricks & Pipelines
Active-Secret Data Engineer: Databricks & Pipelines

Guidehouse Inc. • Arlington (VA)

On-site
USD 85,000 - 141,000
Medical Insurance
Dental & Vision
Holidays
+6
Data Engineer (Secret Clearance) – Databricks & Power Apps
Data Engineer (Secret Clearance) – Databricks & Power Apps

Guidehouse • Arlington (VA)

Hybrid
USD 85,000 - 141,000
Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Paid H
401(k) Retirement Plan
+2
Cleared Data Engineer
Cleared Data Engineer

Guidehouse Inc. • Arlington (VA)

On-site
USD 85,000 - 141,000
Medical Insurance
Dental & Vision
Holidays
+6
Databricks Data Engineering Lead - Delivery & DataOps
Databricks Data Engineering Lead - Delivery & DataOps

Guidehouse • McLean (VA)

On-site
USD 130,000 - 216,000
Medical Insurance
Dental & Vision Insurance
401(k) Retirement Plan
+2
Cleared Data Engineer
Cleared Data Engineer

US101 Guidehouse Inc. • Arlington (VA)

On-site
USD 85,000 - 141,000
Medical, Rx, Dental & Vision Insurance
401(k) Retirement Plan
Parental Leave and Adoption Assistance
+1
Databricks Data Engineering Lead — Senior Consultant
Databricks Data Engineering Lead — Senior Consultant

Guidehouse • Arlington (VA)

On-site
USD 130,000 - 216,000
Medical insurance
401(k) retirement plan
Parental leave
Databricks Data Engineer - TS/SCI Cleared, Lakehouse Expert
Databricks Data Engineer - TS/SCI Cleared, Lakehouse Expert

Gridiron IT • Washington

On-site
USD 120,000 - 180,000
Medical insurance
Dental insurance
Vision insurance
+5
Data Engineer - Secure Pipelines (Secret)
Data Engineer - Secure Pipelines (Secret)

Agile Defense, Inc. • Bellevue Second IV Precinct (NE)

On-site
USD 110,000 - 150,000
Data Engineer - Secret Clearance & Secure Pipelines
Data Engineer - Secret Clearance & Secure Pipelines

Agile Defense, Inc. • Waipahu (HI)

On-site
USD 135,000 - 165,000
Data Engineer - Onsite, Secret-Cleared, ETL & Analytics
Data Engineer - Onsite, Secret-Cleared, ETL & Analytics

Agile Defense, Inc. • Falls Church (VA)

On-site
USD 110,000 - 150,000