Senior Data Engineer — Real-Time Pipelines & Cloud

eBay; Toronto; Sur place; CAD 90 000 - 130 000; Plein temps

Résumé du poste

eBay is seeking a Data Engineer to design, build, and optimize real‑time and batch data pipelines. You will work with Kafka, Spark, and Flink to enable scalable insights and personalized experiences for millions of users.

Responsibilities include data orchestration with Airflow, data quality tooling with Monte Carlo or Great Expectations, and cloud‑native solutions on Databricks and AWS. You will collaborate across Data Science, Product, and engineering to advance the data platform.

Qualifications

• B.Sc. or M.Sc. in Computer Science or equivalent experience.
• 3+ years of software design and development in data pipelines and backend services.

Responsabilités

• Design and develop real‑time and batch data pipelines using Kafka, Spark and Flink.
• Build and manage workflow orchestrations with Airflow for reliable data processing.
• Implement data quality frameworks using Monte Carlo or Great Expectations.
• Leverage Databricks and AWS to create cloud‑native data solutions.
• Own major data engineering projects from design to deployment and support.
• Collaborate with Data Science, Product, and engineering leads on roadmap items.

Connaissances

Python

Java

Scala

Kafka

Spark

Flink

Databricks

AWS

Airflow

DBT

Monte Carlo

Great Expectations

Formation

B.Sc. or M.Sc. in Computer Science

Outils

Databricks

AWS

Airflow

DBT

Description du poste

eBay is seeking a Data Engineer to design, build, and optimize real‑time and batch data pipelines. You will work with Kafka, Spark, and Flink to enable scalable insights and personalized experiences for millions of users.

Responsibilities include data orchestration with Airflow, data quality tooling with Monte Carlo or Great Expectations, and cloud‑native solutions on Databricks and AWS. You will collaborate across Data Science, Product, and engineering to advance the data platform.