Hybrid Data Engineer: Cloud Pipelines & AI Apps

Dow Jones; New York (NY); Hybrid; USD 110,000 - 150,000; Full time

Job summary

The New York Post, a premier media brand, is seeking a Data Engineer to design, build, and operate cloud-based data pipelines powering our digital platforms. You’ll work with real-time and batch processing, collaborating with product, editorial, and data science teams to enable analytics and AI-driven features.

You will leverage Python, SQL, and PySpark in a hybrid work environment, contributing to scalable data infrastructure and thoughtful data services for newsroom and product teams.

Qualifications

• MS or BS in computer science or related field.
• 2+ years of professional software engineering experience.
• Proficiency in Python, SQL, and PySpark.
• Experience with AWS and/or GCP services.
• Experience building data pipelines with Airflow, Dataflow, or Glue.
• Knowledge of data warehouses such as BigQuery, Snowflake, or Redshift.
• Familiarity with AI tooling, IDEs, Git, JIRA, and agile practices.
• Experience with REST/GraphQL APIs; CI/CD and containerization (Docker, Kubernetes) a plus.

Responsibilities

• Design, build, and operate cloud-based data pipelines.
• Collaborate with product, editorial, and data science teams to deliver infrastructure and services.
• Monitor, optimize, and secure cloud-based systems.
• Write clean, testable code (Python preferred).
• Participate in code reviews and agile ceremonies.
• Document functional requirements for technical and non-technical audiences.
• Work with AWS and GCP services (Vertex AI, Lambdas, DynamoDB, S3, BigQuery, etc.).

Skills

Python

SQL

PySpark

AWS / GCP

Data pipelines

Airflow

BigQuery

Snowflake

Redshift

AI tooling

Git

JIRA

Agile

Testing frameworks

Education

MS or BS in Computer Science

Tools

Docker

Kubernetes

Airflow

Job description

The New York Post, a premier media brand, is seeking a Data Engineer to design, build, and operate cloud-based data pipelines powering our digital platforms. You’ll work with real-time and batch processing, collaborating with product, editorial, and data science teams to enable analytics and AI-driven features.

You will leverage Python, SQL, and PySpark in a hybrid work environment, contributing to scalable data infrastructure and thoughtful data services for newsroom and product teams.