Senior Data Engineer — Secret Clearance, Databricks Leader

Redhorse Corp.; USA; Vor Ort; USD 170.000 - 190.000; Vollzeit

Zusammenfassung

Redhorse Corporation is seeking a Senior Data Engineer / Lead to join our team supporting the US National Defense Strategy. You will translate complex defense requirements into scalable data pipelines and actionable insights, contributing to modernization of critical defense systems.

You will provide technical leadership, mentor engineers, and collaborate with stakeholders to deliver robust data architectures and pipelines using Databricks and PySpark.

Qualifikationen

• 8+ years of professional data engineering experience on enterprise-scale platforms.
• Must be a U.S. citizen with a current active U.S. Government Secret clearance.
• Experience providing technical mentorship and day-to-day task oversight.
• Hands-on experience designing and optimizing data transformation workflows in Databricks.

Aufgaben

• Provide day-to-day technical direction and code reviews.
• Elicit and translate mission requirements into robust specifications and data models.
• Architect and optimize high-throughput ETL/ELT workflows using Databricks.
• Identify bottlenecks, debug complex data pipelines, and improve data reliability.
• Collaborate with government product owners and data scientists to document architecture and trade-offs.
• Develop and maintain pipeline architecture documentation.

Kenntnisse

Python/PySpark

SQL

Data visualization

Technical leadership

Requirements development

Mentorship

Ausbildung

Bachelor’s degree in Computer Science or related field

Master’s degree in CS or related field

Tools

Databricks

Jobbeschreibung

Redhorse Corporation is seeking a Senior Data Engineer / Lead to join our team supporting the US National Defense Strategy. You will translate complex defense requirements into scalable data pipelines and actionable insights, contributing to modernization of critical defense systems.

You will provide technical leadership, mentor engineers, and collaborate with stakeholders to deliver robust data architectures and pipelines using Databricks and PySpark.