Remote Databricks Data Engineer & Scientist

Booz Allen Hamilton; Denver (CO); On-site; USD 78,000 - 176,000; Full time

Job summary

Booz Allen Hamilton is seeking a Databricks Data Engineer and Scientist to design, build, and maintain data pipelines for a critical enterprise Lakehouse. You will apply data science and analytics skills, optimize ETL processes, and ensure data security and compliance while collaborating with cross-functional teams.

You will leverage Databricks, AWS, Python/PySpark, and AI-assisted coding tools to transform raw data into actionable insights and support enterprise analytics initiatives.

Qualifications

• 8+ years designing, developing, deploying, and managing ETL pipelines with robust logging and error handling.
• 3+ years building and optimizing data pipelines with Databricks notebooks/clusters/job orchestration (Delta Lake, Unity Catalog).
• 3+ years writing Python and PySpark for ETL scripts and transformations.
• Experience with AI-assisted coding tools to support data engineering and modeling tasks.
• Experience modeling data using Bronze/Silver/Gold medallion architecture.
• Experience with AWS services (Glue, S3, RDS).
• Knowledge of ETL performance optimization (partitioning, bucketing, caching) and troubleshooting.
• Ability to analyze legacy SQL and validate pipeline accuracy and performance.
• Ability to obtain Public Trust or Suitability/Fitness determination per client requirements.
• Bachelor's degree in relevant field.

Responsibilities

• Design, build, and maintain robust data pipelines for enterprise Lakehouse.
• Analyze pipelines, support data modeling, and improve performance and scalability.
• Collaborate with cross-functional teams on data security and compliance.
• Utilize Databricks and AWS to optimize end-to-end data flows.
• Turn raw data into actionable business insights.

Skills

ETL design

Databricks

Python/PySpark

AI-assisted coding

Data modeling

AWS

ETL optimization

Legacy SQL analysis

Public Trust clearance

Bachelor's degree

Education

Bachelor's degree in CS/CE/Engineering/Math/Physics/IS&T

Tools

Delta Lake

Unity Catalog

AWS Glue

S3

RDS

CloudWatch

Job description

Booz Allen Hamilton is seeking a Databricks Data Engineer and Scientist to design, build, and maintain data pipelines for a critical enterprise Lakehouse. You will apply data science and analytics skills, optimize ETL processes, and ensure data security and compliance while collaborating with cross-functional teams.

You will leverage Databricks, AWS, Python/PySpark, and AI-assisted coding tools to transform raw data into actionable insights and support enterprise analytics initiatives.