Lead Data Engineer: Build Scalable Data Lakes & Pipelines

Excella; Arlington (VA); Hybride; USD 138 000 - 185 000; Plein temps

Avantages offerts par ce poste

Health benefits

HSA contribution

Parental leave

Pet insurance discount

Care.com membership

Paid vacation + holidays

TechEleX devices program

Internet allowance

Professional development

Résumé du poste

Excella is a transformative technology firm committed to developing talent and delivering career growth. Lead Data Engineers design and build modern data solutions, including data lakes and cleansed data repositories, collaborating with cross-functional teams to ensure data availability and quality.

The role emphasizes production-grade pipelines, scalable architectures, and close coordination with Architects, Data Scientists, and DevOps to integrate data across client environments.

Qualifications

• 8+ years of professional experience in data engineering or related fields.
• Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems.
• Strong proficiency in SQL, Python, and orchestration tools like Airflow and dbt.

Responsabilités

• Develop and manage data processes to ensure availability and usability.
• Create and automate data pipelines and platforms.
• Write clean, efficient, and well-documented code to support data engineering solutions.
• Monitor and ensure data quality through automated testing frameworks.
• Collaborate with Architects, Product Owners, Data Scientists, and DevOps to design, build, and maintain scalable data solutions.
• Research data acquisition sources and evaluate suitability.
• Integrate data management solutions into client environments.
• Identify and mitigate risks to data while ensuring data recovery plans.
• Build and maintain data repositories, including data warehouses, data lakes, and operational data stores.

Connaissances

SQL

Python

Airflow

dbt

Databricks

Spark

Kafka

Parquet

Delta Lake

AWS

Formation

AWS ML Specialty

DASCA Certification

Databricks Certification

Python/Scala Certification

Outils

Airflow

dbt

Terraform

Git

Description du poste

Excella is a transformative technology firm committed to developing talent and delivering career growth. Lead Data Engineers design and build modern data solutions, including data lakes and cleansed data repositories, collaborating with cross-functional teams to ensure data availability and quality.

The role emphasizes production-grade pipelines, scalable architectures, and close coordination with Architects, Data Scientists, and DevOps to integrate data across client environments.