Senior Data Engineer, Offline Experimentation & Routing

Lyft; Toronto; Hybrid; CAD 136.000 - 170.000; Vollzeit

Benefits dieser Stelle

Extended health and dental coverage

Mental health benefits

Family building benefits

Child care and pet benefits

Lyft Health Savings Account

RRSP plan with company match

Flexible paid time off

Paid parental leave (18 weeks)

Subsidized commuter benefits

Zusammenfassung

Lyft seeks a Senior Software Engineer, Data on the Mapping team to lead end-to-end data pipelines, route simulation services, and offline experimentation tooling. You will architect scalable data platforms and collaborate with engineers, data scientists, and product teams to improve routing accuracy and travel-time estimates.

You will work with AWS, Databricks, Kubernetes, and Airflow, building data governance and observability systems while mentoring others and driving best practices across the

Qualifikationen

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field.
• 5+ years of backend or data engineering with large-scale distributed systems.
• Strong experience with Spark and a scripting language (Python, Ruby, Bash).
• Experience with distributed storage, querying, and streaming technologies (e.g. Clickhouse, Hive, Presto, Delta, Iceberg, Kafka).
• Strong SQL skills (MySQL, PostgreSQL or similar), with performance tuning on high-volume events data.
• Hands-on with tools like dbt, Great Expectations, or Monte Carlo to diagnose complex datasets.
• Experience with Airflow, Prefect and infra tooling (Terraform, Docker, Kubernetes), preferably in AWS context.
• Experience designing API schemas and building backend services in microservices architecture.
• Proficient in using AI tools to accelerate coding and engineering workflows.
• Excellent communication skills across technical and non-technical audiences.
• Bonus: LLM orchestration, vector databases, experimentation/simulation platforms, A/B testing at scale.

Aufgaben

• Own core data pipelines end-to-end, defining SLAs for pipelines, services, and datasets to ensure reliability at scale.
• Lead the offline experimentation platform and route simulation services, setting direction and ensuring scalability in Lyft's routing ambitions.
• Evolve data models and schemas to meet business needs.
• Develop AI tools to support self-service data pipelines and perform SQL tuning for performance.
• Write clean, tested, scalable code with a focus on cost efficiency.
• Participate in code and architecture reviews to ensure quality and knowledge sharing.
• Manage on-call rotations and improve team processes.
• Mentor teammates and promote engineering best practices.

Kenntnisse

Spark

Python

SQL

Airflow

Kubernetes

Docker

Terraform

APIs

Data modeling

Big data

Ausbildung

Bachelor's degree in CS/Engineering/Math/Stats

Tools

ClickHouse

Hive

Presto

Delta Lake

Iceberg

Kafka

dbt

Great Expectations

Monte Carlo

AWS

Jobbeschreibung

Lyft seeks a Senior Software Engineer, Data on the Mapping team to lead end-to-end data pipelines, route simulation services, and offline experimentation tooling. You will architect scalable data platforms and collaborate with engineers, data scientists, and product teams to improve routing accuracy and travel-time estimates.

You will work with AWS, Databricks, Kubernetes, and Airflow, building data governance and observability systems while mentoring others and driving best practices across the