Senior Data Engineer - Hybrid (Azure Databricks & Data Lake)

Publicis Groupe Holdings B.V; Arlington (VA); Hybrid; USD 109,000 - 130,000; Full time

Benefits offered by this job

Competitive compensation

Hybrid work model

Health benefits

Professional development

Job summary

Publicis Sapient, a digital transformation leader, is seeking a Senior Data Engineer in Arlington, hybrid. You will build scalable data pipelines, leverage Azure Data Factory, and develop transformations for enterprise data lakes and Synapse pools, while owning testing, data quality, and production support.

You will work with Databricks, Delta Lake, and Delta Live Tables, optimize Spark/SQL workloads, and collaborate with architects, analysts, and business partners to deliver reliable data

Qualifications

• Bachelor's degree in CS/Engineering/IS or related field.
• 4+ years delivering enterprise data pipelines.
• 2+ years Azure Databricks data engineering experience.
• Strong experience with Databricks, Delta Live Tables, Delta Lake, PySpark, Python, SQL.

Responsibilities

• Create and enhance scalable data pipelines using established ingestion frameworks.
• Orchestrate, schedule, and monitor data pipelines using Azure Data Factory.
• Develop and optimize data transformations using PySpark, Python, and SQL.
• Load data into Enterprise Data Lake, Delta Lake, and Azure Synapse dedicated SQL pools.
• Build and maintain Databricks data engineering solutions, including Delta Live Tables.
• Configure and maintain data quality rules, monitoring, and alerts.
• Coordinate unit, integration, and user acceptance testing with partners.
• Produce high-level and detailed data designs and runbooks.
• Tune workloads for performance and cost efficiency.
• Provide production support and incident resolution across data platforms.
• Collaborate with architects, analysts, and stakeholders to deliver reliable data products.

Skills

Azure Databricks

Python

SQL

Data pipelines

PySpark

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field

Tools

Databricks

Delta Lake

Delta Live Tables

Azure Data Factory

Azure Synapse

Git

Azure DevOps

Job description

Publicis Sapient, a digital transformation leader, is seeking a Senior Data Engineer in Arlington, hybrid. You will build scalable data pipelines, leverage Azure Data Factory, and develop transformations for enterprise data lakes and Synapse pools, while owning testing, data quality, and production support.

You will work with Databricks, Delta Lake, and Delta Live Tables, optimize Spark/SQL workloads, and collaborate with architects, analysts, and business partners to deliver reliable data