Data Engineer Team Lead: Scalable Pipelines & Leadership

Accenture; Arlington (VA); On-site; USD 161,000 - 307,000; Full time

Job summary

Accenture Federal Services in Arlington, VA is seeking a Data Engineer Team Lead to guide a skilled team building and operating mission-critical data pipelines for DoD programs. You will set technical direction, promote modular and scalable Databricks-based solutions, and drive governance and automation.

The role requires 10+ years in data or software engineering, strong Python/SQL/Spark experience, and a US citizenship.

Qualifications

• 10+ years of experience in data engineering or software engineering.
• Expert-level proficiency with Python, SQL, Spark, or PySpark.
• Deep experience with cloud data platforms (e.g., AWS or Azure) and data engineering platforms like Databricks, Palantir, or Snowflake.
• Demonstrated experience leading projects.
• US Citizenship (No Dual Citizenship).

Responsibilities

• Lead, mentor, and manage a team of data engineers on pipeline development and operations.
• Drive the technical strategy for the data pipeline ecosystem for stability and scalability.
• Enforce reusable templates, automated monitoring, and IaC deployment standards.
• Oversee development of pipelines using modular patterns like Databricks Delta Live Tables.
• Direct optimization of pipelines with automated monitoring, alerting, and schema drift detection.
• Facilitate code reviews and maintain documentation and agile practices.
• Collaborate with the Solution Architect to implement improvements including GPUs for large-scale transformations.

Skills

Python

SQL

Spark

PySpark

Databricks

AWS

Azure

Palantir

Snowflake

Leadership

US Citizenship

Tools

Terraform

CI/CD

Job description

Accenture Federal Services in Arlington, VA is seeking a Data Engineer Team Lead to guide a skilled team building and operating mission-critical data pipelines for DoD programs. You will set technical direction, promote modular and scalable Databricks-based solutions, and drive governance and automation.

The role requires 10+ years in data or software engineering, strong Python/SQL/Spark experience, and a US citizenship.