Senior Data Engineer – Databricks & Pipelines Lead

Redhorse Corporation; United States; Remote; USD 170,000 - 190,000; Full time

Job summary

Redhorse Corporation is seeking a Senior Data Engineer / Lead to spearhead data engineering initiatives supporting the U.S. National Defense Strategy.

You will translate complex defense needs into scalable data pipelines and actionable insights, shaping modernization of critical systems. You will mentor engineers, drive architectural design, and collaborate with government stakeholders to deliver robust data models and resilient pipelines using Databricks and Python/PySpark.

Qualifications

• 8+ years of data engineering experience building enterprise-scale data platforms and pipelines.
• Experience providing technical mentorship and day-to-day technical task oversight.
• Hands-on Databricks experience designing and optimizing data transformation workflows.
• Advanced Python/PySpark and SQL skills for modular, OO programming and complex queries.

Responsibilities

• Provide day-to-day task prioritization and technical direction; lead code reviews and mentor engineers.
• Elicit, refine, and translate complex mission requirements into robust specifications and data models.
• Architect, develop, and optimize high-throughput ETL/ELT workflows using Databricks.

Skills

Python/PySpark

SQL

Databricks

Mentorship

Code reviews

Data modeling

Education

Bachelors or Masters in CS/IS/Engineering

Tools

GitLab

Jira

Job description

Redhorse Corporation is seeking a Senior Data Engineer / Lead to spearhead data engineering initiatives supporting the U.S. National Defense Strategy.

You will translate complex defense needs into scalable data pipelines and actionable insights, shaping modernization of critical systems. You will mentor engineers, drive architectural design, and collaborate with government stakeholders to deliver robust data models and resilient pipelines using Databricks and Python/PySpark.