Senior Spark Data Engineer - Scalable ETL & AI-Driven Data

Booz Allen Hamilton; Chantilly (VA); On-site; USD 78,000 - 176,000; Full time

Benefits offered by this job

Health benefits

Life insurance

Disability benefits

Tuition assistance

Paid leave

Job summary

Booz Allen Hamilton is seeking a Senior Spark Data Engineer in Chantilly, VA to lead data engineering on mission-driven projects. You will design, build, and operate large-scale data pipelines and platforms, working with analysts, engineers, and data consumers in a fast-paced, agile environment.

The role requires strong experience with Spark, ETL at enterprise scale, distributed data tools, and a TS/SCI clearance with polygraph.

Qualifications

• 5+ years of Spark development (PySpark/Java Spark).
• 5+ years designing, developing, operationalizing, and maintaining complex data applications at enterprise scale.
• 5+ years building ETL pipelines for petabyte-scale data.
• Experience modeling complex data structures of varied formats.
• Experience with distributed data & computing tools (Spark, AWS, Kafka).
• Experience collaborating in cross-functional teams.
• Ability to develop scripts for data conversion and to scale, monitor, and operate data platforms.
• Bachelor’s degree.
• TS/SCI clearance with polygraph is required.

Responsibilities

• Lead data engineering activities on mission-driven projects.
• Develop and deploy data pipelines and platforms for big data.
• Collaborate with analysts, data engineers, developers, and data consumers.
• Assess, design, build, and maintain scalable data platforms for clients.

Skills

Spark development

Big data pipelines

Data modeling

Distributed data tools

Cross-functional teamwork

Scripting & automation

TS/SCI clearance with polygraph

Education

Bachelor's degree

Tools

Cassandra

PostgreSQL

Graph databases

Docker

Kubernetes

Agile practices

Job description

Booz Allen Hamilton is seeking a Senior Spark Data Engineer in Chantilly, VA to lead data engineering on mission-driven projects. You will design, build, and operate large-scale data pipelines and platforms, working with analysts, engineers, and data consumers in a fast-paced, agile environment.

The role requires strong experience with Spark, ETL at enterprise scale, distributed data tools, and a TS/SCI clearance with polygraph.