Senior Databricks Data Engineer: ETL, AWS, Delta Lake

631 Booz Allen Hamilton_United States

Bethesda (MD)

On-site

USD 78,000 - 176,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Booz Allen is seeking a Senior Databricks Data Engineer to design, build, and maintain robust data pipelines on Databricks and AWS. You will lead end-to-end ETL, data modeling, and performance optimization while mentoring a multidisciplinary team in a fast-paced environment.

You will ensure data security and compliance, collaborate with cross-functional teams, and translate complex data into actionable insights for clients, contributing to scalable data platforms and analytics.

Qualifications

  • 8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines with robust error handling.
  • 3+ years of experience building and optimizing data pipelines with Databricks notebooks, clusters, and job orchestration tools.
  • 3+ years of experience writing Python and PySpark for ETL scripts and transformations.
  • Experience in data modeling within a medallion architecture (Bronze/Silver/Gold) and dimensional vs relational models.
  • Experience using AWS services (Glue, S3, RDS).
  • Knowledge of performance optimization for ETL (partitioning, bucketing, caching).
  • Ability to design data models from schemas to efficient structures for analytics.
  • Ability to obtain Public Trust or Suitability/Fitness per client requirements.

Responsibilities

  • Design, build, and maintain end-to-end data pipelines on Databricks and AWS.
  • Lead ETL development, data modeling, and performance optimization.
  • Ensure data security, compliance, and governance across platforms.
  • Collaborate with cross-functional teams and mentor a multi-disciplinary team.
  • Translate complex data into actionable insights for clients.

Skills

Databricks
Python
PySpark
ETL pipelines
Data modeling
AWS
Data governance
Public Trust clearance

Education

Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Mathematics, Physics, Information Systems, or Information Technology

Tools

Databricks notebooks
Databricks clusters
Delta Lake
Unity Catalog
AWS Glue
Amazon S3
Amazon RDS
Collibra

Job description

Booz Allen is seeking a Senior Databricks Data Engineer to design, build, and maintain robust data pipelines on Databricks and AWS. You will lead end-to-end ETL, data modeling, and performance optimization while mentoring a multidisciplinary team in a fast-paced environment.

You will ensure data security and compliance, collaborate with cross-functional teams, and translate complex data into actionable insights for clients, contributing to scalable data platforms and analytics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Data Engineer - ETL & AWS Lead
Senior Databricks Data Engineer - ETL & AWS Lead

Booz Allen • Bethesda (MD)

On-site
USD 78,000 - 176,000
Health benefits
Tuition assistance
Work-life programs
Senior Databricks Data Engineer - ETL & Cloud Pipelines
Senior Databricks Data Engineer - ETL & Cloud Pipelines

Booz Allen • Wando (SC)

On-site
USD 78,000 - 176,000
Senior Databricks Data Engineer (Remote)
Senior Databricks Data Engineer (Remote)

Booz Allen • Charleston (SC)

On-site
USD 78,000 - 176,000
Remote Databricks Data Engineer & Scientist
Remote Databricks Data Engineer & Scientist

Booz Allen • Denver (CO)

On-site
USD 78,000 - 176,000
Lead Databricks Data Engineer (Remote)
Lead Databricks Data Engineer (Remote)

Booz Allen • Wando (SC)

Hybrid
USD 78,000 - 176,000
Remote Data Engineer & Tech Lead (Databricks)
Remote Data Engineer & Tech Lead (Databricks)

Booz Allen • Alexandria (VA)

On-site
USD 99,000 - 225,000
Architect of AI-Driven Databricks Data Pipelines
Architect of AI-Driven Databricks Data Pipelines

Booz Allen Hamilton • Bethesda (MD)

On-site
USD 78,000 - 176,000
Health benefits
Professional development
Tuition assistance
+1
Lead Databricks Data Engineer — Mission-Driven Tech Lead
Lead Databricks Data Engineer — Mission-Driven Tech Lead

Booz Allen • Bethesda (MD)

On-site
USD 99,000 - 225,000
Senior Databricks Data Engineer - Spark, AWS & Delta Lake
Senior Databricks Data Engineer - Spark, AWS & Delta Lake

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 180,000
Senior Databricks Engineer: Delta Lake & AWS Data Platform
Senior Databricks Engineer: Delta Lake & AWS Data Platform

Robotics Technologies LLC • Pennsylvania

On-site
USD 92,000 - 131,000