Senior Data Engineer: Databricks & AWS Pipelines

Booz Allen; McLean (VA); On-site; USD 78,000 - 176,000; Full time

Job summary

Booz Allen Hamilton in McLean, VA seeks a Senior Data Engineer to design, develop, and maintain scalable data pipelines using Databricks and AWS, delivering reliable data products for mission‑critical analytics.

You will collaborate with data engineers, software developers, and stakeholders to transform data, optimize pipelines with SQL and Python, and apply Agile practices while supporting government clients; U.S. citizenship is required.

Qualifications

• 5+ years of experience in data engineering, database development, or data warehousing.
• Experience with SQL, including complex queries, joins and aggregations, CTEs, window functions, query optimization, and performance tuning, and relational databases.
• Experience developing and maintaining data pipelines using Python, and Apache Spark or PySpark for processing and transforming large datasets, including performance optimization and troubleshooting
• Experience with data engineering platforms such as Databricks.
• Experience with Amazon Web Services (AWS) and AWS data services such as S3, EMR, Glue, Lambda, or NoSQL databases.
• Experience with CI / CD pipelines, including using platforms such as GitHub Actions, including automated builds, testing, deployment, and promotion across environments.
• Knowledge of database design principles, and data warehousing concepts, including ETL / ELT, fact and dimension tables, star and snowflake schemas, slowly changing dimensions, data integration, and incremental data processing.
• Ability to independently troubleshoot data pipeline failures, data issues, performance problems, and production incidents, and identify appropriate root causes and corrective actions
• Public Trust
• Bachelor's degree in CS

Responsibilities

• Design, develop, test, and maintain scalable data pipelines and data processing workflows.
• Build data solutions using Databricks, including data transformation, processing, and orchestration.
• Develop automated workflows to improve the reliability, efficiency, and repeatability of data processing.
• Integrate data from multiple sources and formats into enterprise data platforms.
• Develop and optimize data transformations using SQL and Python.
• Troubleshoot data pipeline issues and identify opportunities for performance and reliability improvements.
• Collaborate with sof tware developers, data engineers, architects, and stakeholders to comprehend requirements and deliver technical solutions.
• Apply Agile development practices, version control, testing, and CI / CD throughout the sof tware development lifecycle.

Skills

SQL

Python

Databricks

AWS

CI/CD

Data warehousing

Troubleshooting

Education

Bachelor's degree in CS

Tools

GitHub Actions

AWS (S3/EMR/Glue/Lambda)

NoSQL databases

Job description

Booz Allen Hamilton in McLean, VA seeks a Senior Data Engineer to design, develop, and maintain scalable data pipelines using Databricks and AWS, delivering reliable data products for mission‑critical analytics.

You will collaborate with data engineers, software developers, and stakeholders to transform data, optimize pipelines with SQL and Python, and apply Agile practices while supporting government clients; U.S. citizenship is required.