Lead Databricks Data Engineer (Remote)

Booz Allen Hamilton; Wando (SC); Hybrid; USD 78.000 - 176.000; Vollzeit

Zusammenfassung

Booz Allen Hamilton seeks a Lead Databricks Data Engineer to design, build, and maintain robust data pipelines in Databricks and AWS, providing technical leadership and mentorship for the team. You will deliver scalable data solutions and drive data-driven insights across projects.

You will mentor analysts, data engineers, developers, and data consumers in a fast-paced, agile environment, guiding assessments, design, build, and maintenance of data platforms for clients.

Qualifikationen

• 8+ years of experience designing, developing, deploying, and managing ETL pipelines.
• 3+ years building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools.
• 3+ years Python and PySpark for ETL scripts and transformations.
• Experience in data modeling within a medallion architecture (Bronze/Silver/Gold).
• Experience with AWS services: Glue, S3, RDS.
• Bachelor's degree in Computer Science, Engineering, Math, Physics, IS, or IT.

Aufgaben

• Design, build, and maintain end-to-end data pipelines in Databricks and AWS.
• Lead and mentor a multi-disciplinary team of analysts and engineers.
• Collaborate with cross-functional teams to improve performance and scalability.
• Ensure data security and compliance across platforms.

Kenntnisse

ETL design & development

Databricks data pipelines

Python PySpark

Data modeling (medallion)

AWS services

ETL performance optimization

Data modeling design

Ausbildung

Bachelor's degree (CS/Engineering/Math/Physics/IS/IT)

Tools

Databricks Delta

Unity Catalog

AWS Glue

Jobbeschreibung

Booz Allen Hamilton seeks a Lead Databricks Data Engineer to design, build, and maintain robust data pipelines in Databricks and AWS, providing technical leadership and mentorship for the team. You will deliver scalable data solutions and drive data-driven insights across projects.

You will mentor analysts, data engineers, developers, and data consumers in a fast-paced, agile environment, guiding assessments, design, build, and maintenance of data platforms for clients.