Senior Data Engineer – Azure, Real-Time Analytics (Remote)

WPP Media Limited; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Life insurance with wellness support

Wellness programs

Significant paid time off

Certifications and training sessions

Employee discounts

Job summary

WPP Media Limited is seeking a Senior Data Engineer to design, build, and optimize enterprise ETL/ELT pipelines using Azure Data Factory and Azure Data Lake Storage. You will work with US onshore leadership to deliver scalable data solutions and ensure high reliability in a global, collaborative environment.

The role emphasizes pipeline architecture, Databricks/dbt modernization, and strong SQL/Python skills to support advanced analytics and real-time processing.

Qualifications

• 3–4 years of progressive experience in data engineering.
• Expert-level hands-on experience with Azure Data Factory, Azure T-SQL/SQL, and cloud data platforms such as Azure and/or GCP.
• Proven experience designing, optimizing, and managing large-scale, production-grade ETL/ELT pipelines, including ADF orchestration and Azure Data Lake Storage.
• Advanced SQL performance tuning skills, including complex query optimization, partitioning, indexing, and high-volume data processing.
• Strong Python and API orchestration skills for automation.
• Advanced experience with production operations, troubleshooting, root cause analysis, high-availability processing, monitoring, SLA management, and CI/CD automation.
• Experience with Adverity, Dataflow, BigQuery, Databricks, dbt, Terraform, Wrike, Jira is a plus.
• DP-203 and/or GCP Professional Data Engineer certification is a plus.

Responsibilities

• Design, develop, and optimize enterprise ETL/ELT pipelines using Azure Data Factory, Azure Data Lake Storage, and serverless technologies, ensuring scalability, security, and reliability.
• Build and optimize complex Azure T-SQL solutions, including query tuning, partitioning, and indexing, to support advanced analytics models and real-time data processing.
• Develop automation frameworks with Python and API orchestration to streamline the data lifecycle and improve operational efficiency.
• Own production pipeline reliability by performing root-cause analysis, resolving critical incidents, and implementing long-term stability measures.
• Define and enforce coding and architectural standards through code reviews and technical audits, while mentoring engineers and raising delivery quality.
• Maintain documentation, data lineage, governance, and automated CI/CD deployment practices across data assets.
• Partner with US onshore leadership and analytics and media teams to translate business needs into scalable, high-performance technical solutions.
• Lead end-to-end pipeline architecture and modernization initiatives involving Databricks, dbt, and advanced DevOps practices; monitor SLAs, mitigate risk, and support compliance.

Skills

Azure Data Factory

Azure Data Lake Storage

SQL performance tuning

Python

CI/CD automation

Data engineering

Azure T-SQL

Cloud platforms (Azure/GCP)

Tools

Wrike

Jira

Databricks

dbt

Terraform

Azure DevOps

Job description

WPP Media Limited is seeking a Senior Data Engineer to design, build, and optimize enterprise ETL/ELT pipelines using Azure Data Factory and Azure Data Lake Storage. You will work with US onshore leadership to deliver scalable data solutions and ensure high reliability in a global, collaborative environment.

The role emphasizes pipeline architecture, Databricks/dbt modernization, and strong SQL/Python skills to support advanced analytics and real-time processing.