Data Engineering Lead – Pipelines & Architecture

Publicis Health Media; Philadelphia (Philadelphia County); On-site; USD 89,000 - 127,000; Full time

Benefits offered by this job

Medical coverage

Dental and vision

Disability insurance

401K

Paid time off

Job summary

Publicis Health Media is seeking a Data Manager of Data Engineering in the US. The role leads multiple client data projects, designs scalable pipelines from API feeds, and aligns data architecture with governance. You will collaborate across BI, Product, and Tech teams to enhance data flow and reliability.

Ideal candidates have strong PySpark, Python, SQL skills and experience with modern data platforms and cloud data services. A DS/ETL background and solid communication are required.

Qualifications

• BS in Computer Science, Information Technology, or related field.
• Strong hands-on experience with PySpark and data engineering.
• Proficiency in Python and SQL for data processing and automation.
• Experience building API-based data pipelines, including authentication and error handling.
• Solid knowledge of modern data architecture (data modeling, governance, warehouse, lakehouse).
• Experience with database structures, ETL, and cloud data platforms.

Responsibilities

• Lead a portfolio of data projects across multiple clients.
• Design and manage scalable pipelines, incl. ingestion from APIs and ETL sources.
• Contribute to data architecture decisions for efficient schema design and governance.
• Partner with BI, Product, and Media Tech teams to automate data integrations.
• Oversee ETL and metadata management for stability and security.
• Present issues, trends, and recommendations to stakeholders.
• Maintain best practices for handling, storing, and governing data.

Skills

PySpark

Python

SQL

API pipelines

Data modeling

Education

BS in Computer Science, Information Technology, or related field

Tools

AWS

Azure

Databricks

Snowflake

Redshift

Tableau

Datorama

Job description

Publicis Health Media is seeking a Data Manager of Data Engineering in the US. The role leads multiple client data projects, designs scalable pipelines from API feeds, and aligns data architecture with governance. You will collaborate across BI, Product, and Tech teams to enhance data flow and reliability.

Ideal candidates have strong PySpark, Python, SQL skills and experience with modern data platforms and cloud data services. A DS/ETL background and solid communication are required.