Senior Data Platform Engineer - AI-Native Orchestration

Redfin Corporation

Seattle (WA)

On-site

USD 167,000 - 204,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision benefits
401K retirement plan
Paid time off

Job summary

Redfin is seeking an experienced data platform engineer to own the architecture and evolution of our Airflow platform, powering production batch workflows for ML, analytics, and product data across the company.

You will design and deliver platform features end to end, drive AI-native data engineering, build self-service tooling, improve reliability and observability, and mentor engineers to raise the bar on data quality and cost efficiency.

Qualifications

  • 5+ years of experience building and operating data platforms, developer tooling, or large-scale distributed systems.
  • Experience with workflow orchestration and production cloud platforms.
  • Proficiency with Python, Java, Airflow, Kubernetes, Helm, Terraform, Docker, Snowflake, dbt, Spark, Postgres, Kafka, and Datadog in AWS.

Responsibilities

  • Own the architecture and evolution of our Airflow platform, which runs production batch workflows behind ML, analytics, and product data.
  • Lead the design and delivery of platform features end to end for new technologies and data delivery integrations.
  • Drive AI-native data engineering by building tools, skills, and environments for rapid prototyping of production pipelines.
  • Build AI-powered self-service experiences to help answer engineering questions and diagnose failures.
  • Lead data discovery and metadata efforts by owning data catalog connectors and ingestion across data stores.
  • Raise reliability, observability, and cost efficiency across platforms, including compute sizing, autoscaling, IaC, and retiring legacy systems.

Skills

Airflow
Kubernetes
Python
Java
Terraform
Docker
Snowflake
dbt
Spark
Postgres
Kafka
Datadog
AWS
Observability

Tools

Airflow
Kubernetes
Terraform
Docker
Snowflake
dbt
Spark
Postgres
Kafka
Datadog
AWS

Job description

Redfin is seeking an experienced data platform engineer to own the architecture and evolution of our Airflow platform, powering production batch workflows for ML, analytics, and product data across the company.

You will design and deliver platform features end to end, drive AI-native data engineering, build self-service tooling, improve reliability and observability, and mentor engineers to raise the bar on data quality and cost efficiency.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer — Cloud, Airflow & Automation
Senior Data Platform Engineer — Cloud, Airflow & Automation

NielsenIQ • Chicago (IL)

On-site
MXN 1,388,000 - 1,696,000
Flexible working environment
Volunteer time off
Senior Platform Engineer - AI, Automation & Cloud
Senior Platform Engineer - AI, Automation & Cloud

Redfin Corporation • United States

Hybrid
USD 120,000 - 190,000
Senior Data Platform Engineer — AI & Analytics
Senior Data Platform Engineer — AI & Analytics

team.blue Global • United States

Remote
USD 140,000 - 200,000
Senior Data Platform Engineer - AI-Driven & Cloud-Native
Senior Data Platform Engineer - AI-Driven & Cloud-Native

Health Data Innovations, Inc. • United States

On-site
USD 180,000 - 220,000
Senior Data Engineer - AI-Driven Data Platform
Senior Data Engineer - AI-Driven Data Platform

Outmarket AI • United States

Remote
USD 120,000 - 150,000
Competitive compensation and meaningful equity
Remote-first flexibility
Ownership from day one
Senior Data Platform Engineer — Data Pipelines & AI
Senior Data Platform Engineer — Data Pipelines & AI

Turo Inc. • San Francisco (CA)

Hybrid
USD 182,000 - 228,000
Equity
Medical insurance
401(k) match
+4
Remote Data Platform Engineer - Airflow + Equity
Remote Data Platform Engineer - Airflow + Equity

Astronomer • United States

Remote
USD 200,000 - 250,000
Remote-friendly
Senior Software Engineer, AI Labs Data Platform
Senior Software Engineer, AI Labs Data Platform

Roboflow, Inc. • United States

Remote
USD 250,000 - 450,000
Travel stipends
Health insurance
Unlimited PTO
+2
Senior Data Engineer: Craft Scalable Pipelines for ML/NLP
Senior Data Engineer: Craft Scalable Pipelines for ML/NLP

Redicasystems • United States

On-site
USD 120,000 - 190,000
Senior Data Platform Engineer — Remote AI Data Pipelines
Senior Data Platform Engineer — Remote AI Data Pipelines

Handshake • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Equity ownership
401(k) match
Parental/fertility benefits
+6