Senior Data Engineer — AI-Driven Pipelines (Hybrid)

Burson Cohn & Wolfe; Greater London; Hybrid; GBP 61,000 - 101,000; Full time

Job summary

Burson Cohn & Wolfe in London seeks a senior data platform engineer to design, build, and operate production data pipelines and AI-enabled enrichment workflows. You will lead technical design, collaborate with Product Owners in an Agile Jira environment, and deliver scalable data services across Azure Data Lake and relational databases.

The role emphasizes reliability, cost control, and mentoring junior engineers.

Qualifications

• Substantial experience designing, building, and operating production data platforms and ETL pipelines.
• Advanced proficiency in Python and SQL, incl. Pandas and REST APIs.
• Hands-on with Azure services (Data Factory, SQL, ADLS) and DevOps tooling (Git, CI/CD).
• Proven SRE experience: reliability, logging/monitoring, performance optimization.
• Mentor engineers; drive code reviews, standards, and docs.

Responsibilities

• Lead technical design and delivery of data pipelines and platform components for media monitoring and communications data sources.
• Collaborate with Product Owners in Agile Jira environment to translate requirements into scalable solutions.
• Build and maintain Python services, SQL transformation layers, star schemas, and API integrations across databases and Azure Data Lake.
• Optimize pipeline performance, reliability, and AI token costs; establish monitoring, alerting, and runbooks.
• Enhance configuration layers (NocoDB workflows) to streamline setup and reduce engineering intervention.
• Operationalize AI enrichment frameworks (classification, summarization, sentiment, topics, LLMs) with governance and cost controls.
• Deliver custom data engineering solutions for client needs; integrate internal/API datasets into reporting workflows.
• Mentor junior engineers through code reviews and knowledge sharing; address technical debt.

Skills

Data platform design

Python

SQL

Agile execution

Mentoring juniors

REST API integrations

LLM enrichment workflows

AI frameworks

Pandas

Performance optimization

Tools

Azure Data Factory

Azure SQL

ADLS

Azure DevOps

Git

CI/CD

Jira

Power BI

DAX

Terraform

Terragrunt

NocoDB

Airtable

Job description

Burson Cohn & Wolfe in London seeks a senior data platform engineer to design, build, and operate production data pipelines and AI-enabled enrichment workflows. You will lead technical design, collaborate with Product Owners in an Agile Jira environment, and deliver scalable data services across Azure Data Lake and relational databases.

The role emphasizes reliability, cost control, and mentoring junior engineers.