Lead Databricks Data Engineer (Remote)

Booz Allen Hamilton; Wando (SC); Híbrido; USD 78.000 - 176.000; Jornada completa

Descripción de la vacante

Booz Allen Hamilton seeks a Lead Databricks Data Engineer to design, build, and maintain robust data pipelines in Databricks and AWS, providing technical leadership and mentorship for the team. You will deliver scalable data solutions and drive data-driven insights across projects.

You will mentor analysts, data engineers, developers, and data consumers in a fast-paced, agile environment, guiding assessments, design, build, and maintenance of data platforms for clients.

Formación

• 8+ years of experience designing, developing, deploying, and managing ETL pipelines.
• 3+ years building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools.
• 3+ years Python and PySpark for ETL scripts and transformations.
• Experience in data modeling within a medallion architecture (Bronze/Silver/Gold).
• Experience with AWS services: Glue, S3, RDS.
• Bachelor's degree in Computer Science, Engineering, Math, Physics, IS, or IT.

Responsabilidades

• Design, build, and maintain end-to-end data pipelines in Databricks and AWS.
• Lead and mentor a multi-disciplinary team of analysts and engineers.
• Collaborate with cross-functional teams to improve performance and scalability.
• Ensure data security and compliance across platforms.

Conocimientos

ETL design & development

Databricks data pipelines

Python PySpark

Data modeling (medallion)

AWS services

ETL performance optimization

Data modeling design

Educación

Bachelor's degree (CS/Engineering/Math/Physics/IS/IT)

Herramientas

Databricks Delta

Unity Catalog

AWS Glue

Descripción del empleo

Booz Allen Hamilton seeks a Lead Databricks Data Engineer to design, build, and maintain robust data pipelines in Databricks and AWS, providing technical leadership and mentorship for the team. You will deliver scalable data solutions and drive data-driven insights across projects.

You will mentor analysts, data engineers, developers, and data consumers in a fast-paced, agile environment, guiding assessments, design, build, and maintenance of data platforms for clients.