Senior Data Engineer: Spark, Databricks & Lakehouse Lead

Citi; Mississauga; On-site; CAD 167,000 - 237,000; Full time

Job summary

Citi is seeking an Applications Development Technology Lead Analyst in Mississauga to architect, develop, and operate enterprise‑scale data pipelines. You will balance hands‑on coding with technical leadership across Spark, Databricks, and streaming architectures.

You will mentor a global team, optimize workloads, and drive end‑to‑end delivery while ensuring governance and security. A strong background in Scala, Python, and SQL is essential.

Qualifications

• Bachelor’s degree/University degree or equivalent experience.
• Master’s degree preferred.
• 6+ years of relevant Apps Development or systems analysis experience.
• Expert‑level development skills in Scala and Python.
• Advanced SQL development and query‑optimization skills.
• Strong knowledge of data warehousing concepts, Lakehouse modelling, and medallion architecture.
• Hands‑on experience with Apache Iceberg or Delta Lake is required.
• Extensive hands‑on experience with Apache Spark, Spark Structured Streaming, Databricks, Delta Live Tables, and Kafka.

Responsibilities

• Lead architecture, design, and development of high‑throughput batch and real‑time data pipelines.
• Provide SME guidance in Spark architecture, job optimization, SQL tuning, and Databricks performance.
• Mentor and develop a global team of data engineers; conduct code and architecture reviews.
• Collaborate with stakeholders to align data platforms with business goals and delivery milestones.
• Define standards for coding, testing, deployment, monitoring, and data quality.

Skills

Scala

Python

SQL

Apache Spark

Databricks

Kafka

Iceberg/Delta Lake

Lakehouse modelling

Medallion architecture

AWS/GCP

Education

Bachelor's degree/University degree or equivalent experience

Master's degree preferred

Job description

Citi is seeking an Applications Development Technology Lead Analyst in Mississauga to architect, develop, and operate enterprise‑scale data pipelines. You will balance hands‑on coding with technical leadership across Spark, Databricks, and streaming architectures.

You will mentor a global team, optimize workloads, and drive end‑to‑end delivery while ensuring governance and security. A strong background in Scala, Python, and SQL is essential.