Lead Data Engineer — Scalable Data Pipelines & Lakes

Excella; Arlington (VA); Remote; USD 140.000 - 190.000; Vollzeit

Benefits dieser Stelle

Parental Leave

Pet Insurance

Care.com membership

Paid vacation

Paid holidays

Floating holidays

TechEleX devices

Internet reimbursement

Professional development

HeadSpace membership

TalkSpace access

Zusammenfassung

Excella is a transformative technology firm enabling organizations to unlock new possibilities through its talented people and collaborative teams. Lead Data Engineers will design and build modern data solutions, including data lakes and cleansed repositories, while collaborating with cross-functional teams to ensure data availability, quality, and integration.

Starting day one, you’re empowered to make an impact.

Qualifikationen

• 8+ years of professional data engineering experience.
• Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems.
• Strong proficiency in SQL, Python, and orchestration tools like Airflow and dbt.
• 2+ years of hands-on Databricks experience in cloud environments.
• Hands-on with Spark, Kafka, and data formats like Parquet, Delta Lake, Iceberg.
• Deep experience with AWS cloud data platforms (S3/Redshift/ Glue/EMR) or Azure equivalents.
• Solid data modeling, performance optimization, and secure data stores.
• Familiarity with data lake/analytical patterns (Star Schema, schema-on-read, data quality).
• Experience with CI/CD, Git, Terraform, and NoSQL databases.
• Excellent communication in Agile teams (Scrum/Kanban).
• Certifications: DASCA, Databricks Spark, AWS Data Analytics, Python/Scala, DHS Public Trust.

Aufgaben

• Develop and manage data processes to ensure availability and usability.
• Create and automate data pipelines and platforms.
• Write clean, efficient, and well-documented code for data solutions.
• Monitor and ensure data quality with automated tests.
• Collaborate with Architects, Product Owners, Data Scientists, and DevOps.
• Research data acquisition sources and evaluate suitability.
• Integrate data management solutions into client environments.
• Identify and mitigate data risks and ensure recovery plans.
• Build and maintain data warehouses, lakes, and operational stores.

Kenntnisse

Strong problem-solving

Growth mindset

Effective communicator

Agile experience

Tools

SQL

Python

Airflow

dbt

Databricks

Spark

Kafka

Parquet

Delta Lake

Iceberg

AWS

S3

Redshift

Terraform

NoSQL

Jobbeschreibung

Excella is a transformative technology firm enabling organizations to unlock new possibilities through its talented people and collaborative teams. Lead Data Engineers will design and build modern data solutions, including data lakes and cleansed repositories, while collaborating with cross-functional teams to ensure data availability, quality, and integration.

Starting day one, you’re empowered to make an impact.