Senior Data Engineer - Hybrid, Azure & Delta Lake Expert

Publicis Groupe; Arlington (VA); Hybrid; USD 109,000 - 130,000; Full time

Benefits offered by this job

Inclusive workplace

Ongoing learning & development

Competitive compensation & benefits

Work-life balance

Health benefits for you and family

Generous paid leave & holidays

Wellness program

Job summary

Publicis Sapient is seeking a Senior Data Engineer in Arlington, hybrid, to design and enhance scalable data pipelines. You will work with Azure Data Factory, Delta Lake, and Synapse, building Databricks-based solutions and ensuring data quality and performance.

You will own testing, documentation, and production support, collaborating with architects, analysts, and stakeholders to deliver enterprise data products with reliability and cost efficiency.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
• 4+ years of data engineering experience, including hands-on delivery and support of enterprise data pipelines.
• 2+ years of hands-on Azure Databricks data engineering experience.
• Strong experience with Databricks, Delta Live Tables (DLT), Delta Lake, PySpark, Python, SQL, and Spark SQL.
• Strong experience orchestrating data pipelines with Azure Data Factory.
• Experience loading and serving data through Enterprise Data Lake, Delta Lake, and Azure Synapse Analytics dedicated SQL pools.
• Experience configuring Databricks compute, data quality rules, monitoring, maintenance processes, and workload optimization.
• Experience performing unit testing and coordinating integration testing and UAT.
• Experience creating HLDs, detailed designs, data pipeline documentation, and operational runbooks.
• Experience with Azure DevOps, Git, CI/CD pipelines, and production deployment practices.
• Demonstrated experience supporting production data platforms and resolving data pipeline incidents.

Responsibilities

• Create and enhance scalable data pipelines using established ingestion frameworks.
• Orchestrate, schedule, and monitor data pipelines using Azure Data Factory.
• Develop data transformations using PySpark, Python, and SQL.
• Load data into Enterprise Data Lake, Delta Lake, and Azure Synapse pools.
• Build Databricks data engineering solutions including Delta Live Tables and pipeline maintenance.
• Configure data quality rules, monitoring, and automated alerts.
• Perform unit testing and coordinate integration testing and UAT with partners.
• Create high-level and detailed designs, data mappings, and runbooks.
• Tune Databricks, Spark, SQL, and Synapse workloads for performance and cost efficiency.
• Provide production support and incident resolution.

Skills

Azure Databricks

Delta Live Tables

PySpark

Python

SQL

Spark SQL

Azure Data Factory

Data Lake

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field

Tools

Azure DevOps

Git

CI/CD pipelines

Job description

Publicis Sapient is seeking a Senior Data Engineer in Arlington, hybrid, to design and enhance scalable data pipelines. You will work with Azure Data Factory, Delta Lake, and Synapse, building Databricks-based solutions and ensuring data quality and performance.

You will own testing, documentation, and production support, collaborating with architects, analysts, and stakeholders to deliver enterprise data products with reliability and cost efficiency.