Senior Data Engineer – Databricks & Data Pipelines

Redhorse Corporation

Oregon

Hybrid

USD 170,000 - 190,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Redhorse Corporation is seeking a Senior Data Engineer/Lead to advance data pipelines and provide technical leadership for government-scale programs in Oregon. The role focuses on translating complex defense requirements into scalable data models and high-throughput ETL/ELT workflows using Databricks.

Candidates must hold a U.S. Secret clearance and demonstrate mentorship, code reviews, and architecture discipline.

Qualifications

  • 8+ years of professional experience in data engineering
  • Experience providing technical mentorship and code reviews
  • Hands-on Databricks experience designing and optimizing data transformations
  • Advanced Python/PySpark scripting and SQL optimization
  • Experience building functional, user-centric reports and dashboards

Responsibilities

  • Provide day-to-day task prioritization and technical direction
  • Elicit and translate mission requirements into technical specifications and data models
  • Architect, develop, and optimize high-throughput ETL/ELT workflows using Databricks
  • Identify bottlenecks and implement automated solutions for reliability
  • Collaborate with government product owners, data scientists, and analysts
  • Develop and maintain pipeline architecture documentation

Skills

Data engineering
Python/PySpark
SQL
Databricks
ETL/ELT pipelines
Technical leadership
Code reviews
Documentation
Data visualization

Education

Bachelor's or Master's in Computer Science or related field

Tools

Apache Spark
Git
GitLab
Jira

Job description

Redhorse Corporation is seeking a Senior Data Engineer/Lead to advance data pipelines and provide technical leadership for government-scale programs in Oregon. The role focuses on translating complex defense requirements into scalable data models and high-throughput ETL/ELT workflows using Databricks.

Candidates must hold a U.S. Secret clearance and demonstrate mentorship, code reviews, and architecture discipline.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer – Databricks & Pipelines Lead
Senior Data Engineer – Databricks & Pipelines Lead

Redhorse Corporation • United States

Remote
USD 170,000 - 190,000
Senior Data Engineer — Secret Clearance, Databricks Leader
Senior Data Engineer — Secret Clearance, Databricks Leader

Redhorse Corp. • United States

On-site
USD 170,000 - 190,000
Lead Data Engineer — Databricks, PySpark, ETL (Secret)
Lead Data Engineer — Databricks, PySpark, ETL (Secret)

Redhorse Corporation • United States

Remote
USD 140,000 - 190,000
Lead Data Engineer (Fully Remote)
Lead Data Engineer (Fully Remote)

Redhorse Corporation • United States

Remote
USD 140,000 - 190,000
Top Secret DoD Data Engineer – ETL & Pipelines
Top Secret DoD Data Engineer – ETL & Pipelines

Redhorse • Arlington (VA)

On-site
USD 145,000 - 165,000
TS/SCI Data Engineer—DoD Data Pipelines & ETL
TS/SCI Data Engineer—DoD Data Pipelines & ETL

Redhorse Corporation • Arlington (VA)

On-site
USD 145,000 - 165,000
Senior Databricks Engineer - AWS Spark & Data Pipelines
Senior Databricks Engineer - AWS Spark & Data Pipelines

Red Cedar Consultancy • Washington

On-site
USD 140,000 - 180,000
Senior Databricks Data Engineer | OCDS & Gov Data Pipelines
Senior Databricks Data Engineer | OCDS & Gov Data Pipelines

Scicom Infrastructure Services • Oregon

Hybrid
USD 120,000 - 160,000
Senior Data Engineer (Secret) Databricks, ETL & Pipelines
Senior Data Engineer (Secret) Databricks, ETL & Pipelines

Kaizen Lab Inc. • Arlington (VA)

Hybrid
USD 100,000 - 130,000
Lead Data Engineer
Lead Data Engineer

Redhorse Corporation • Oregon

Hybrid
USD 170,000 - 190,000