Lead Data Engineer — Databricks, PySpark, ETL (Secret)

Redhorse Corporation; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Redhorse Corporation is seeking a Senior Data Engineer and Lead to transform complex defense requirements into scalable data pipelines and actionable insights. You will provide technical leadership, architecture oversight, and mentor teammates while delivering robust ETL/ELT solutions on Databricks using Python/PySpark and SQL.

The role partners with government product owners, data scientists, and analysts to document architecture, coordinate sprints, and drive modernization of critical defense

Qualifications

• Minimum 8+ years in data engineering with enterprise-scale platforms.
• Active U.S. Government Secret clearance and U.S. citizenship.
• Advanced Python/PySpark and SQL skills with hands-on Databricks experience.

Responsibilities

• Provide day-to-day technical leadership, code reviews, and mentorship to engineering team members.
• Architect, develop, and optimize ETL/ELT workflows using Databricks and Python/PySpark.
• Partner with government product owners, data scientists, and analysts to document architecture and coordinate sprints.

Skills

Data engineering

Technical leadership

ETL/ELT design

Python

PySpark

SQL

Tools

Databricks

Job description

Redhorse Corporation is seeking a Senior Data Engineer and Lead to transform complex defense requirements into scalable data pipelines and actionable insights. You will provide technical leadership, architecture oversight, and mentor teammates while delivering robust ETL/ELT solutions on Databricks using Python/PySpark and SQL.

The role partners with government product owners, data scientists, and analysts to document architecture, coordinate sprints, and drive modernization of critical defense