Lead Data Engineer – Defense Analytics & Databricks

BigBear.ai

Norfolk (VA)

On-site

USD 140,000 - 190,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

BigBear.ai in Virginia seeks a Lead Data Engineer to develop and maintain data pipelines, analytics datasets, and dashboards supporting defense and intelligence operations. You’ll use Databricks, Python, Spark, and SQL to prepare data for analysis and reporting, working with engineers, analysts, and mission stakeholders to deliver reliable information for operational planning and senior‑leader decisions.

You will need an active TS/SCI clearance and a BS in information systems/tech/science or

Qualifications

  • Bachelor’s degree required in a related field.
  • 5+ years of combined experience supporting data or information systems.
  • Hands‑on experience using Databricks, Python, Spark or PySpark, and SQL.
  • Experience maintaining data pipelines and developing reports, dashboards, or analytics applications.
  • Experience troubleshooting production data or application issues and administering user access in a secure environment.
  • Ability to work on‑site Full time in Norfolk, Virginia.

Responsibilities

  • Develop, maintain, and troubleshoot data pipelines and transformations in Databricks using Python, PySpark, and SQL.
  • Clean and validate source data, investigate discrepancies, and deliver datasets for operational reporting and analytics.
  • Build and maintain Qlik Sense applications, dashboards, and SQL reports for mission users.
  • Manage user access and permissions across data and analytics platforms in accordance with security and data governance requirements.
  • Support database upgrades, system migrations, and production troubleshooting in coordination with engineering and operations teams.
  • Document data workflows, reporting logic, and support procedures so other team members can maintain them.
  • Work with mission stakeholders to translate operational reporting needs into data products and application improvements.

Skills

Data engineering
Analytics
Security compliance
Collaboration

Education

Bachelor’s degree in Information Systems, Information Technology, Computer Science, Engineering, or related field

Tools

Databricks
Python
Spark
PySpark
SQL
Qlik Sense

Job description

BigBear.ai in Virginia seeks a Lead Data Engineer to develop and maintain data pipelines, analytics datasets, and dashboards supporting defense and intelligence operations. You’ll use Databricks, Python, Spark, and SQL to prepare data for analysis and reporting, working with engineers, analysts, and mission stakeholders to deliver reliable information for operational planning and senior‑leader decisions.

You will need an active TS/SCI clearance and a BS in information systems/tech/science or

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer, Senior
Data Engineer, Senior

BigBear.ai • Norfolk (VA)

On-site
USD 140,000 - 190,000
Lead Data Scientist — AI/ML & Analytics (TS/SCI)
Lead Data Scientist — AI/ML & Analytics (TS/SCI)

AIToolboard • Washington

On-site
USD 120,000 - 190,000
Lead Data Scientist — Mission-Critical Analytics (Secret)
Lead Data Scientist — Mission-Critical Analytics (Secret)

BigBear • Norfolk (VA)

On-site
USD 150,000 - 210,000
Lead Data Engineer — Databricks, PySpark, ETL (Secret)
Lead Data Engineer — Databricks, PySpark, ETL (Secret)

Redhorse Corporation • United States

Remote
USD 140,000 - 190,000
Senior Data Engineer – Databricks & Pipelines Lead
Senior Data Engineer – Databricks & Pipelines Lead

Redhorse Corporation • United States

Remote
USD 170,000 - 190,000
Defense Data Engineer: Secure Pipelines & Analytics
Defense Data Engineer: Secure Pipelines & Analytics

Agile Defense, LLC • Falls Church (VA)

On-site
USD 135,000 - 165,000
Lead Data Scientist
Lead Data Scientist

Bigbear.ai • Norfolk (VA)

On-site
USD 180,000 - 240,000
Data Engineer – TS/SCI | Mission-Critical AWS ETL
Data Engineer – TS/SCI | Mission-Critical AWS ETL

BigBear.Ai, Inc. • Washington

On-site
USD 120,000 - 180,000
Junior Data Engineer: Build Pipelines (Clearance Eligible)
Junior Data Engineer: Build Pipelines (Clearance Eligible)

BigBear • Norfolk (VA)

On-site
USD 70,000 - 100,000
Junior Data Engineer - Cloud ETL & Data Pipelines
Junior Data Engineer - Cloud ETL & Data Pipelines

Bigbear.ai • Norfolk (VA)

On-site
USD 65,000 - 90,000