Senior Data Platform Engineer - AI-Ready Pipelines

Publicis Groupe UK; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Pension

Life Assurance

Private Medical

Income Protection

Work your World

Reflection Days

Help@Hand benefits

Family friendly policies

Flexible working

Birthday day off

Local discounts

Job summary

Publicis Groupe UK is seeking a Senior Data Engineer to lead the technical direction and architecture of the Data Foundation Platform within OneSuite. This hands-on role contributes to production code, builds pipelines, and shapes long-term data platform design.

You'll act as the technical authority for DFP, partnering with product teams and data science, driving best practices in data modeling, CI/CD, and governance, while mentoring engineers and delivering scalable, compliant data solutions

Qualifications

• Hands-on experience as a Data Engineer or Data Platform Developer.
• Expert-level proficiency in Python, SQL, and Apache Spark for data pipeline development.
• Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks.
• Solid understanding of data modeling, dimensional design, and schema normalization at enterprise scale.
• Strong experience with AWS (S3, Redshift, Glue, Lambda) or GCP (BigQuery, Dataflow).
• Experience working with marketing or ad platform data (Google Ads, Meta, TikTok, DV360, Amazon Ads).
• Demonstrated expertise in code versioning (GitHub), CI/CD integration, and data observability practices.
• Ability to write clean, modular, testable code and review peers’ contributions for maintainability and performance.

Responsibilities

• Data Platform Architecture: Lead the hands-on design, coding, and evolution of DFP’s cloud-native data architecture (AWS/GCP/Snowflake).
• Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT.
• Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms.
• Build and optimize schemas, transformations, and ETL logic for high-performance, reusable data workflows.
• Contribute directly to the DFP codebase (Python, SQL, Spark) — developing pipelines and infrastructure alongside the engineering team.
• Establish data versioning, testing, and governance frameworks ensuring reliability, lineage, and compliance.
• Data Engineering Leadership: Drive best practices in data modeling, CI/CD, code reviews, and performance optimization.
• Collaborate across engineering teams to define data contracts, schema validation rules, and automated quality checks.
• Mentor junior engineers by pairing on code, reviewing pull requests, and helping them deepen technical maturity.
• Participate actively in sprint planning and retrospectives, ensuring engineering execution aligns with platform goals.
• Partner with Product and Data Science teams to translate analytical requirements into efficient, production‑grade data solutions.
• AI‑Ready Infrastructure: Design and maintain pipelines supporting Retrieval‑Augmented Generation (RAG) and Context Engine™ workflows.
• Build high-performance APIs and caching strategies enabling low‑latency data access for AI agents and orchestration systems.
• Implement vector-based data retrieval layers (pgVector, Pinecone) and ensure efficient embedding pipelines for AI contexts.
• Partner with AI teams to monitor data latency, cost efficiency, and observability metrics.
• Collaboration & Governance: Partner with Platform Operations and Security to enforce privacy, compliance, and access control frameworks (GDPR, SOC2).
• Work cross‑functionally with analysts, AI engineers, and platform leads to deliver production‑grade, business‑critical data products.
• Lead by example in data documentation, pipeline testing, and lineage tracking — ensuring transparency and reproducibility across all pipelines.

Skills

Data engineering

Python

SQL

Apache Spark

CI/CD

Data modeling

Marketing data

Tools

Fivetran

Airflow

DBT

Databricks

Snowflake

GitHub

Job description

Publicis Groupe UK is seeking a Senior Data Engineer to lead the technical direction and architecture of the Data Foundation Platform within OneSuite. This hands-on role contributes to production code, builds pipelines, and shapes long-term data platform design.

You'll act as the technical authority for DFP, partnering with product teams and data science, driving best practices in data modeling, CI/CD, and governance, while mentoring engineers and delivering scalable, compliant data solutions