Senior Data Engineer — Azure & Databricks for AI Pipelines

Publicis Sapient; Toronto; On-site; CAD 115,000 - 160,000; Full time

Benefits offered by this job

Inclusive workplace

Learning & development

Competitive compensation

Work-life balance

Health benefits

Paid leave & holidays

Wellness program

Job summary

Publicis Sapient in Toronto is seeking a Senior Associate Data Engineer to lead and deliver data solutions for large-scale digital transformation projects, leveraging cloud platforms and modern data pipelines. You will translate client requirements into scalable designs, build batch and streaming data pipelines, and mentor junior engineers while driving data platform modernization and AI-enabled data services for client engagements.

Qualifications

• Demonstrated experience implementing end-to-end data pipelines and production-grade data platforms.
• Hands-on experience with at least one leading public cloud data platform: AWS, Azure, or GCP.
• Experience with Azure Cloud Services, including ADLS, Functions, AKS, and Databricks.
• Strong Python proficiency and practical data engineering tooling.
• In-depth knowledge of Scala, Spark, PySpark, Java, and shell scripting.
• Experience with SQL/NoSQL databases and data warehousing.
• Experience with data pipelines for streaming and batch using Glue, Lambda, Dataflow, ADF, Spark, etc.
• Proficiency with Apache Airflow for orchestration.
• Familiarity with MLOps concepts and AI/ML data support responsibilities.
• Ability to handle module-level responsibilities while delivering hands-on.

Responsibilities

• Lead, design, develop and deliver large-scale data systems and modernization initiatives.
• Build and optimize batch and streaming data pipelines across cloud platforms.
• Support AI-enabled engineering use cases by designing high-quality data foundations and scalable data services.
• Automate data platform operations, observability, and telemetry pipelines including latency and cost data.
• Mentor, support, and grow junior team members while contributing hands-on to delivery.

Skills

End-to-end data pipelines

Public cloud platforms

Azure Data Services

Databricks

Python proficiency

Spark/Scala

SQL/NoSQL databases

Airflow orchestration

Data modeling

MLOps awareness

Communication skills

Tools

Azure Data Lake Storage

Azure Functions

AKS

Databricks

Delta Lake

Job description

Publicis Sapient in Toronto is seeking a Senior Associate Data Engineer to lead and deliver data solutions for large-scale digital transformation projects, leveraging cloud platforms and modern data pipelines. You will translate client requirements into scalable designs, build batch and streaming data pipelines, and mentor junior engineers while driving data platform modernization and AI-enabled data services for client engagements.