Data Engineer II - Data Platform & Pipelines

Redfin; Seattle (WA); On-site; USD 119,900 - 162,200; Full time

Benefits offered by this job

Health benefits

401K retirement plan

Paid time off

Job summary

Redfin is hiring a Data Engineer II to own and enhance Redfin’s Data Platform, building and maintaining complex data pipelines across diverse sources. You will collaborate with Engineering and Analytics to deliver reliable data transformations and meet business requirements.

The ideal candidate has 3+ years in Python and SQL with experience in batch and streaming pipelines, data modeling, and both structured and unstructured data.

Qualifications

• 3+ years experience with Python or Java; Python preferred.
• 3+ years experience with SQL, data modeling and databases (Postgres, MySQL, Snowflake).
• Experience creating and maintaining complex data pipelines (batch and streaming).
• Experience with both structured and unstructured data sets; ability to translate business needs into technical requirements.

Responsibilities

• Design, develop, and support complex data pipelines from diverse sources for Redfin.
• Collaborate with Engineering to implement data exchange systems; maintain data quality and tests.
• Gather requirements from end users and deliver data in accessible formats.
• Automate processes to improve accuracy and performance; support dev/test/prod environments.
• Participate in on-call rotation to ensure data platform reliability.

Skills

Python

SQL

Data pipelines

Batch data processing

Streaming data

Tools

Airflow

Docker

Kubernetes

Spark

Git

Jenkins

Snowflake

Postgres

MySQL

AWS

Job description

Redfin is hiring a Data Engineer II to own and enhance Redfin’s Data Platform, building and maintaining complex data pipelines across diverse sources. You will collaborate with Engineering and Analytics to deliver reliable data transformations and meet business requirements.

The ideal candidate has 3+ years in Python and SQL with experience in batch and streaming pipelines, data modeling, and both structured and unstructured data.