Job Family :
Data Engineering & Architecture Consulting
Travel Required :
Up to 50%
Clearance Required :
Active Secret
What You Will Do :
- Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
- Transform raw source data into curated, analysis-ready datasets and dimensional models that support cybersecurity metrics, risk analysis, dashboards, and executive reporting.
- Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, consistency, uniqueness, timeliness, referential-integrity, and source-to-target reconciliation checks.
- Define appropriate handling for failed quality checks, including quarantining invalid records, stopping critical loads, generating alerts, documenting exceptions, and coordinating corrective action with data owners.
- Schedule and orchestrate production workflows; monitor job status, freshness, throughput, latency, resource utilization, and failures; troubleshoot root causes; and restore processing within agreed service levels.
- Optimize pipeline reliability, performance, and cost through efficient transformations, workload configuration, incremental processing, partitioning, and compute-resource management.
- Implement and maintain data-governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information.
- Maintain source-to-target mappings, data dictionaries, transformation rules, validation evidence, standard operating procedures, runbooks, and other technical documentation needed for operations, knowledge transfer, and audit readiness.
- Partner with cybersecurity analysts, data owners, system administrators, dashboard developers, and business stakeholders to define data requirements, metrics, thresholds, and acceptance criteria.
- Maintain effective working relationships with client management and staff, anticipate stakeholder needs, communicate delivery risks and dependencies, and resolve issues in a timely and professional manner.
- Organize and lead client meetings by coordinating schedules, developing and distributing agendas and pre-read materials, facilitating discussions and decisions, recording minutes, maintaining required documentation, and tracking action items through closure.
- Participate in peer reviews, testing, release activities, and continuous-improvement efforts to strengthen engineering practices, reduce recurring defects, and improve the reliability and usability of data products.
What You Will Need :
- An ACTIVE and CURRENT SECRET federal security clearance
- Bachelor's degree
- SIX (6) years of total experience in a data or programming discipline, including THREE (3) years of experience in data engineering
- Proficiency in data engineering-related programming languages such as Python, PySpark, and/or SQL
- Experience with scheduling, monitoring, troubleshooting, and optimizing production ETL/ELT pipelines
- Experience with data engineering principles and best practices
- Excellent problem-solving skills and attention to detail
- Selected Candidate must be able to commute to client and Guidehouse offices as needed
What Would Be Nice To Have :
- Master's degree in computer science or related field
- Experience working with system and application logs
- Familiarity with the Databricks platform
- Strong communication and collaboration skills, with the ability to work effectively in a team environment
The annual salary range for this position is $85,000.00-$141,000.00. Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.
What We Offer :
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Position may be eligible for a discretionary variable incentive bonus
- Parental Leave and Adoption Assistance
- 401(k) Retirement Plan\
- Basic Life & Supplemental Life
- Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Student Loan PayDown
- Tuition Reimbursement, Personal Development & Learning Opportunities
- Skills Development & Certifications
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Emergency Back-Up Childcare Program
- Mobility Stipend
About Guidehouse
Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.
Guidehouse will consider for employment qualified applicants with criminal histories in a manner consiste