Senior Data Engineer: Lead Scalable Big Data Pipelines

Booz Allen Hamilton; Atlanta (GA); On-site; USD 78,000 - 176,000; Full time

Job summary

Booz Allen Hamilton is seeking a Senior Data Engineer in Atlanta, GA to lead data engineering activities across mission-driven projects. You will oversee pipelines, mentor a cross-functional team, and help design scalable platforms that organize diverse data sources for actionable insights.

The role emphasizes Python/SQL, Palantir Foundry collaboration, and modern analytics workflows across platforms, with a focus on deliverables and architectural support in a fast-paced environment.

Qualifications

• 5+ years of experience with PySpark, SQL, and distributed data processing.
• 5+ years of experience designing end-to-end production data pipelines.
• 5+ years of experience with data architecture, including schema design and performance optimization.
• 5+ years of experience collaborating with stakeholders and presenting to technical and non-technical audiences.
• 2+ years of experience with Databricks (Delta Lake, Unity Catalog, or Job orchestration).
• 2+ years of experience with Microsoft Azure (Azure Data Factory, Functions, Storage) and cloud platforms (AWS or GCP).
• Experience with Palantir Foundry (pipeline development and data modeling).
• Experience supervising others and delivering in cross-functional environments.
• Ability to obtain and maintain Public Trust or Suitability.

Responsibilities

• Lead data engineering activities on mission-driven projects and oversee pipelines and platforms.
• Guide and mentor a multi-disciplinary team of analysts, data engineers, developers, and data consumers.
• Develop and maintain scalable data platforms and reusable code libraries across enterprise teams.
• Oversee onboarding programs to Palantir Foundry and drive adoption through training and integration.
• Translate analytics workflows across platforms and ensure maintainability of code repositories.

Skills

PySpark

SQL

End-to-end pipelines

Data architecture

Stakeholder comms

Team mentoring

Public Trust eligibility

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Unity Catalog

Job orchestration

Azure Data Factory

Azure Functions

Azure Storage

Palantir Foundry

Job description

Booz Allen Hamilton is seeking a Senior Data Engineer in Atlanta, GA to lead data engineering activities across mission-driven projects. You will oversee pipelines, mentor a cross-functional team, and help design scalable platforms that organize diverse data sources for actionable insights.

The role emphasizes Python/SQL, Palantir Foundry collaboration, and modern analytics workflows across platforms, with a focus on deliverables and architectural support in a fast-paced environment.