Cleared Data Engineer

Guidehouse Inc.

Arlington (VA)

On-site

USD 85,000 - 141,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical Insurance
Dental & Vision
Holidays
401(k) Plan
Tuition Reimbursement
Learning Opportunities
Mobility Stipend
Student Loan PayDown
Life Insurance

Job summary

Guidehouse is seeking a Data Engineer to design, develop, and manage scalable data pipelines in Databricks using Python, PySpark, and SQL. You will transform raw data into analysis-ready datasets to support cybersecurity metrics, dashboards, and executive reporting.

You will implement automated data-quality controls and governance, and collaborate with cross-functional teams to meet client needs. The role requires an Active Secret clearance, a Bachelor's degree and at least six years in data or

Qualifications

  • Active Secret clearance required.
  • Six years of total experience in data or programming, including three years in data engineering.
  • Proficiency in Python, PySpark, and SQL.
  • Experience with scheduling, monitoring, troubleshooting, and optimizing production ETL/ELT pipelines.

Responsibilities

  • Design, build, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, and SQL.
  • Transform raw data into curated, analysis-ready datasets and models supporting cybersecurity metrics, dashboards, and executive reporting.
  • Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, and timeliness checks.
  • Define handling for failed quality checks and coordinate corrective action with data owners.
  • Schedule and monitor production workflows; troubleshoot, optimize performance and cost.
  • Maintain data governance standards, including metadata, lineage, and access controls.
  • Document data mappings, transformation rules, and runbooks for audit readiness.
  • Collaborate with analysts, data owners, admins, dashboard developers, and stakeholders to define data needs.
  • Organize client meetings, prepare agendas, record minutes, and track action items.

Skills

Python
PySpark
SQL
Data Engineering
Problem Solving

Education

Bachelor's degree
Master's degree

Tools

Databricks

Job description

Job Family :

Data Engineering & Architecture Consulting

Travel Required :

Up to 50%

Clearance Required :

Active Secret

What You Will Do :
  • Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
  • Transform raw source data into curated, analysis-ready datasets and dimensional models that support cybersecurity metrics, risk analysis, dashboards, and executive reporting.
  • Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, consistency, uniqueness, timeliness, referential-integrity, and source-to-target reconciliation checks.
  • Define appropriate handling for failed quality checks, including quarantining invalid records, stopping critical loads, generating alerts, documenting exceptions, and coordinating corrective action with data owners.
  • Schedule and orchestrate production workflows; monitor job status, freshness, throughput, latency, resource utilization, and failures; troubleshoot root causes; and restore processing within agreed service levels.
  • Optimize pipeline reliability, performance, and cost through efficient transformations, workload configuration, incremental processing, partitioning, and compute-resource management.
  • Implement and maintain data-governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information.
  • Maintain source-to-target mappings, data dictionaries, transformation rules, validation evidence, standard operating procedures, runbooks, and other technical documentation needed for operations, knowledge transfer, and audit readiness.
  • Partner with cybersecurity analysts, data owners, system administrators, dashboard developers, and business stakeholders to define data requirements, metrics, thresholds, and acceptance criteria.
  • Maintain effective working relationships with client management and staff, anticipate stakeholder needs, communicate delivery risks and dependencies, and resolve issues in a timely and professional manner.
  • Organize and lead client meetings by coordinating schedules, developing and distributing agendas and pre-read materials, facilitating discussions and decisions, recording minutes, maintaining required documentation, and tracking action items through closure.
  • Participate in peer reviews, testing, release activities, and continuous-improvement efforts to strengthen engineering practices, reduce recurring defects, and improve the reliability and usability of data products.
What You Will Need :
  • An ACTIVE and CURRENT SECRET federal security clearance
  • Bachelor's degree
  • SIX (6) years of total experience in a data or programming discipline, including THREE (3) years of experience in data engineering
  • Proficiency in data engineering-related programming languages such as Python, PySpark, and/or SQL
  • Experience with scheduling, monitoring, troubleshooting, and optimizing production ETL/ELT pipelines
  • Experience with data engineering principles and best practices
  • Excellent problem-solving skills and attention to detail
  • Selected Candidate must be able to commute to client and Guidehouse offices as needed
What Would Be Nice To Have :
  • Master's degree in computer science or related field
  • Experience working with system and application logs
  • Familiarity with the Databricks platform
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment

The annual salary range for this position is $85,000.00-$141,000.00. Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.

What We Offer :
  • Medical, Rx, Dental & Vision Insurance
  • Personal and Family Sick Time & Company Paid Holidays
  • Position may be eligible for a discretionary variable incentive bonus
  • Parental Leave and Adoption Assistance
  • 401(k) Retirement Plan\
  • Basic Life & Supplemental Life
  • Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
  • Short-Term & Long-Term Disability
  • Student Loan PayDown
  • Tuition Reimbursement, Personal Development & Learning Opportunities
  • Skills Development & Certifications
  • Employee Referral Program
  • Corporate Sponsored Events & Community Outreach
  • Emergency Back-Up Childcare Program
  • Mobility Stipend
About Guidehouse

Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consiste

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cleared Data Engineer
Cleared Data Engineer

US101 Guidehouse Inc. • Arlington (VA)

On-site
USD 85,000 - 141,000
Medical, Rx, Dental & Vision Insurance
401(k) Retirement Plan
Parental Leave and Adoption Assistance
+1
Associate Director, Lead Data Architect - Databricks
Associate Director, Lead Data Architect - Databricks

Guidehouse Inc. • McLean (VA)

On-site
USD 140,000 - 200,000
Medical Insurance
401(k) Plan
Paid Holidays
+3
Managing Consultant, Databricks Data Engineering Lead
Managing Consultant, Databricks Data Engineering Lead

Guidehouse • San Antonio (TX)

On-site
USD 130,000 - 216,000
Health insurance
Paid holidays
Bonus eligible
+10
Senior Financial Management Data Engineer
Senior Financial Management Data Engineer

Guidehouse Inc. • McLean (VA)

On-site
USD 113,000 - 188,000
Medical insurance
401(k) Retirement Plan
Paid holidays
+4
Managing Consultant, Databricks Data Engineering Lead
Managing Consultant, Databricks Data Engineering Lead

Guidehouse • McLean (VA)

On-site
USD 130,000 - 216,000
Medical Insurance
Dental & Vision Insurance
401(k) Retirement Plan
+2
Senior Financial Management Data Engineer
Senior Financial Management Data Engineer

Guidehouse • McLean (VA)

On-site
USD 113,000 - 188,000
Medical, Rx, Dental & Vision Insurance
Parental Leave and Adoption Assistance
401(k) Retirement Plan
+1
Managing Consultant, Databricks Data Engineering Lead
Managing Consultant, Databricks Data Engineering Lead

US101 Guidehouse Inc. • Arlington (VA)

On-site
USD 130,000 - 216,000
Medical insurance
401(k) retirement plan
Parental leave
Associate Director, Lead Data Architect - Databricks
Associate Director, Lead Data Architect - Databricks

Jobtome • Universal City (TX)

On-site
USD 149,000 - 248,000
Medical, Rx, Dental & Vision Insurance
Parental Leave and Adoption Assistance
401(k) Retirement Plan
+2
Data Engineer
Data Engineer

US101 Guidehouse Inc. • Arlington (VA)

Hybrid
USD 85,000 - 141,000
Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Paid H
401(k) Retirement Plan
+2
Data Engineer
Data Engineer

Guidehouse • Washington

On-site
USD 113,000 - 188,000
Health Insurance
Paid Holidays
Discretionary bonusOpportunity
+7