Data Engineer, Mapping

Rozgoo; Toronto; On-site; CAD 110,000 - 150,000; Full time

Benefits offered by this job

Extended health and dental coverage

Mental health benefits

Family building benefits

Child care and pet benefits

Lyft Health Care Savings Account

RRSP with company match

Flexible PTO

Paid parental leave

Commuter benefits

Job summary

Lyft is hiring a Data Engineer for the Mapping team to build and maintain scalable data pipelines supporting route simulations, analytics, and ML models. You will work with AWS, Kubernetes, and Airflow to improve route quality and travel-time estimations.

You will own data pipelines, define data models, and collaborate with data scientists, product managers, and engineers to enable data-informed decisions at scale.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field.
• 4+ years of relevant professional experience.
• Strong experience with Spark and a scripting language (Python, Ruby, Bash).
• Excellent analytical skills and data quality expertise.
• Able to communicate technical concepts to diverse audiences.
• Experience with diverse DBs, querying, and streaming tech.
• Familiarity with geospatial SQL and performance tuning.
• Experience with Airflow and other workflow tools; infra tooling in AWS.

Responsibilities

• Own core data pipelines in mapping and scale data processing for growth.
• Develop data models, schemas, and SLA definitions for datasets.
• Build tools for self-service ETL, schema evolution, and SQL tuning.
• Write clean, well-tested code prioritizing scalability and cost efficiency.
• Conduct code reviews and share knowledge across teams.
• Participate in on-call rotations for data workflows reliability.
• Collaborate with internal and external partners to drive results.

Skills

Spark

Python

SQL

Data quality

Communication

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or related field

Tools

Airflow

Oozie

Azkaban

UC4

Prefect

Terraform

Docker

Kubernetes

Kafka

Spark Streaming

Hive

Presto

Parquet

Iceberg

Flink

Job description

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive.

As a Data Engineer on the Mapping team, you will collaborate with our world class team of engineers, product managers, and data scientists to grow and improve the quality of recommended routes and accuracy of our travel time estimations. You will architect, build, and maintain scalable data pipelines and services to support route simulation, experimentation, analytics, and machine learning models. Your work will enable integration with partner teams and allow stakeholders across Engineering, Data Science, and Product to make data-informed decisions that directly impact Lyft’s growth and profitability.

Our technology stack is based on the latest technologies such as AWS, Kubernetes and Apache Airflow. You will work with incredibly passionate and talented colleagues from software engineering, machine learning and data science on projects that directly impact millions of riders and drivers.

Responsibilities

• Owner of the core data pipelines in mapping, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
• Develop strong subject matter expertise in the systems you manage, setting and managing SLAs for both data pipeline and datasets
• Continuously evolve data models and schemas to meet business and engineering requirements
• Develop tools that support self-service management of data pipelines (ETL), schema evolution, and perform SQL tuning to optimize data processing performance
• Write clean, well-tested, and maintainable code, prioritizing scalability and cost efficiency
• Conduct code reviews to uphold code quality standards and facilitate knowledge sharing
• Participate in on-call rotations to maintain high availability and reliability of data workflows
• Unblock, support and communicate with internal & external partners to achieve results

Experiences

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field
• 4+ years of relevant professional experience
• Strong experience with Spark and with a scripting language (Python, Ruby, Bash)
• Exceptional analytical skills, with an in-depth understanding of data quality issues and the ability to dive into complex datasets to resolve inconsistencies
• Excellent communication skills, with the ability to articulate technical concepts clearly to both technical and non-technical audiences while collaborating effectively across teams
• Experience with disparate database, querying and streaming technologies such as S3, DynamoDB, HDFS, Hive, Presto, Pig, HBase, Parquet, Iceberg, Flink, Spark Streaming, Kafka
• Experience with data quality tools such as Great Expectations, dbt, Monte Carlo, Soda, Collibra
• Strong understanding of SQL Engine, experience with querying geospatial data, and able to conduct advanced performance tuning
• Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
• Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4, Prefect)
• Experience with infra tooling (Terraform, Cloud Formation, Docker, Kubernetes, Ansible, Chef, Puppet etc preferably in an AWS context)
• Experience defining API schemas and developing backend services in a microservices environment

Benefits

• Extended health and dental coverage options, along with life insurance and disability benefits
• Mental health benefits
• Family building benefits
• Child care and pet benefits
• Access to a Lyft funded Health Care Savings Account
• RRSP plan with company match to help save for your future
• In addition to provincial observed holidays, salaried team members are covered under Lyft's flexible paid time off policy. The policy allows team members to take off as much time as they need (with manager approval). Hourly team members get 15 days paid time off, with an additional day for each year of service
• Lyft is proud to support new parents with 18 weeks of paid time off, designed as a top-up plan to complement provincial programs. Biological, adoptive, and foster parents are all eligible.
• Subsidized commuter benefits and Lyft ride c