Remote Data Engineer - Databricks & Python

Booz Allen; McLean (VA); Presencial; USD 62 000 - 141 000; Tempo integral

Resumo da oferta

Booz Allen is seeking a Data Engineer to design, develop, test, and maintain data pipelines and processing workflows using Databricks and Python to transform complex data into usable information. You will collaborate with engineers and stakeholders and participate in Agile development to deliver scalable data solutions. U.S.

citizenship is required due to the government client. Responsibilities include building and optimizing pipelines, integrating data from multiple sources, and contributing to

Qualificações

• 3+ years of experience in data engineering, database development, or data warehousing.
• Experience developing data pipelines using Python, and Apache Spark or PySpark.
• Experience with Git or GitHub for source-code management and collaborative development.
• Experience with Jenkins, SQL, including complex queries, joins and aggregations, CTEs, window functions, query optimization, and performance tuning, and relational databases.
• Knowledge of data warehousing concepts, including ETL/ELT, fact and dimension tables, star and snowflake schemas, slowly changing dimensions, and data integration.
• Knowledge of data modeling, including conceptual, logical, and physical data models, and data governance, including data ownership and stewardship, metadata, data lineage, data security, data classification, and data standards.
• Knowledge of CI/CD pipelines, including automated builds, testing, and deployments.
• Ability to develop and support Spark-based processing workflows.
• Public Trust

Responsabilidades

• Develop and maintain data pipelines and automated data processing workflows.
• Build data transformations and processing workflows using Databricks, SQL, and Python.
• Integrate data from multiple sources and formats.
• Automate repetitive data processing and operational tasks.
• Test, troubleshoot, and optimize data pipelines for reliability and performance.
• Collaborate with senior engineers and technical teams to implement data solutions.
• Participate in Agile development, code reviews, testing, and deployment activities.
• Contribute to technical documentation and data engineering best practices.

Conhecimentos

Data engineering

Python

Agile development

Data modeling

CI/CD

Formação académica

Bachelor's degree

Ferramentas

Databricks

Python

Apache Spark / PySpark

Git / GitHub

Jenkins

SQL

Descrição da oferta de emprego

Booz Allen is seeking a Data Engineer to design, develop, test, and maintain data pipelines and processing workflows using Databricks and Python to transform complex data into usable information. You will collaborate with engineers and stakeholders and participate in Agile development to deliver scalable data solutions. U.S.

citizenship is required due to the government client. Responsibilities include building and optimizing pipelines, integrating data from multiple sources, and contributing to