Senior Data Engineer — AI, Personalization & Insights

The Washington Post; Washington (District of Columbia); On-site; USD 120,000 - 199,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Pension and 401(k) match

Paid vacation and sick leave

Holidays and personal days

Parental leave (20 weeks)

Mental health resources

Caregiver support services

Pet insurance

Free Post digital subscription

Leadership and career development

Job summary

The Washington Post seeks a Senior Data Engineer for our Data and AI team. You will design, build, and deploy data solutions powering Generative AI, personalization, and recommendation systems, plus advertising insights and campaign infrastructure.

You'll lead data pipelines with Python, Spark, Flink, and collaborate with data scientists, product managers, and designers to deliver scalable, secure, and reliable solutions. On-site with strong mentorship and leadership responsibilities.

Qualifications

• 3+ years in ETL/ELT, data modeling and large dataset analysis.
• Experience with Python and PySpark in data engineering contexts.
• Strong SQL skills and familiarity with data lakehouse architectures on AWS.
• Experience with Apache Airflow and modern BI tools is a plus.

Responsibilities

• Lead data engineering efforts to design scalable data pipelines.
• Collaborate with data scientists, product managers and designers.
• Mentor junior engineers and drive best practices.
• Develop and maintain documentation for data systems.
• Ensure security, reliability and performance of data platforms.

Skills

ETL/ELT

Python

PySpark

SQL

Spark

Data modeling

Airflow

Lead & mentor

Communication

Problem solving

Education

Bachelor's degree in Computer Science/Software Engineering

Master's degree preferred

Tools

Apache Airflow

Docker

ECS

Apache Iceberg

PostgreSQL

MySQL

Redshift

Athena

EMR

Glue catalog

Tableau

Superset

Pub/Sub

Job description

The Washington Post seeks a Senior Data Engineer for our Data and AI team. You will design, build, and deploy data solutions powering Generative AI, personalization, and recommendation systems, plus advertising insights and campaign infrastructure.

You'll lead data pipelines with Python, Spark, Flink, and collaborate with data scientists, product managers, and designers to deliver scalable, secure, and reliable solutions. On-site with strong mentorship and leadership responsibilities.