Senior Data Engineer – AI-Driven Pipelines

Hearst Magazines; New York (NY); On-site; USD 140,000 - 150,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k)

Paid holidays and PTO

Employee assistance programs

Job summary

Hearst Magazines seeks a Senior Data Engineer to own end-to-end data projects, from analysis through production support. You will build scalable pipelines, APIs, and data platforms across Snowflake, Fabric, and Databricks while ensuring governance and security across AWS/Azure/GCP.

You’ll mentor engineers, collaborate with analysts and data scientists, implement DevSecOps practices, and help shape the data/AI roadmap for Hearst Technology Services.

Qualifications

• 7+ years building production data pipelines and data engineering.
• Hands-on with generative AI tools applied to data engineering workflows.
• Experience on AWS, Azure, or GCP cloud platforms.
• ETL, data modeling, and modular component design for complex systems.
• Containerization experience (Docker/Kubernetes).
• Data governance, security, and quality standards, including PHI/PII/PCI.
• Informatica IDMC/MDM or similar tools.
• Strong data structures, algorithms, and software architecture knowledge.
• Ability to translate requirements with analysts, scientists, and stakeholders.
• Experience with Agile and DevSecOps (Jira/Scrum/Kanban).

Responsibilities

• Design and build scalable, secure data pipelines for large data volumes.
• Develop APIs and database logic to automate data fetch, transform, and storage.
• Leverage generative AI to accelerate pipelines across Snowflake, Fabric, and Databricks.
• Create modular components for data and AI apps deployed via Docker/Kubernetes.
• Build data solutions across AWS, Azure, and Google Cloud.
• Apply data governance, security, and quality standards across clouds.
• Handle PHI/PII/PCI data per compliance requirements.
• Collaborate with analysts, scientists, and IT to power new data products.
• Provide technical leadership: mentor engineers, review designs, and guide production issues.
• Apply DevSecOps practices and Agile methods to plan and deliver work.
• Monitor and improve performance, resiliency, and scalability as data grows.

Skills

Python

Data pipelines

Cloud platforms AWS/Azure/GCP

ETL & data modeling

Containerization Docker/Kubernetes

Data governance & security

Informatica IDMC/MDM

Agile/DevSecOps Jira/Scrum/Kanban

Stakeholder communication

Education

Bachelor’s degree in CS/IS or related field

Master’s degree preferred

Tools

Docker

Kubernetes

Informatica IDMC/MDM

Snowflake

Microsoft Fabric

Databricks

Jira

Job description

Hearst Magazines seeks a Senior Data Engineer to own end-to-end data projects, from analysis through production support. You will build scalable pipelines, APIs, and data platforms across Snowflake, Fabric, and Databricks while ensuring governance and security across AWS/Azure/GCP.

You’ll mentor engineers, collaborate with analysts and data scientists, implement DevSecOps practices, and help shape the data/AI roadmap for Hearst Technology Services.