Senior Data Engineering - AI Personalization & Real-Time Customer Data

Intello Technologies Inc.; Vancouver; Hybrid; CAD 144,000 - 217,000; Full time

Job summary

A leading technology company in Vancouver is seeking a Senior Data Engineer to design and operate real-time data pipelines that support AI-driven personalization and customer experiences. The ideal candidate has over 4 years of experience in Data Engineering, strong skills in Python and SQL, and hands-on experience with GCP tools. This role includes optimizing data flows for real-time applications and collaborating with cross-functional teams to ensure data quality and reliability. Competitive salary and bonus structure offered.

Benefits

Minimum 3 weeks of vacation

Flexible benefits plan

Company-matched pension and share purchase programs

Qualifications

• 4+ years of experience in Data Engineering or backend data systems.
• Strong experience with Python and SQL in production environments.
• Hands-on experience with GCP, especially BigQuery and Pub/Sub.

Responsibilities

• Build and operate real-time data pipelines that ingest customer events.
• Develop event-driven architectures using GCP services.
• Partner with Data Scientists to productionize AIPP models.

Skills

Experience in Data Engineering

Python

SQL

GCP

Event-driven pipeline design

Education

Bachelor's degree in Computer Science or related field

Tools

BigQuery

Pub/Sub

Dataflow

Job description

Senior Data Engineering - AI Personalization & Real‑Time Customer Data

Location: Toronto, ON, CA; Calgary, AB, CA

The AI Products and Platform (AIPP) team builds the foundational capabilities that enable AI‑driven personalization, decisioning, and real‑time customer experiences at scale. Our work supports intelligent interactions across digital and assisted channels, helping ensure customers receive timely, relevant, and responsible experiences. The team develops and operates platforms for customer segmentation, anomaly detection, and AI‑based decisioning, where machine learning models aria used to arbitrate recommendations and outcomes. These capabilities rely on high‑quality, real‑time data to function reliably in production. While Data Engineers on the team do not build machine learning models, they play a critical role in enabling and operationalizing AI by designing event‑driven data pipelines, data architecture, and foundational datasets that allow models to be trained, scored, monitored, and safely activated in real time. Their work ensures AI outputs are reliable, explainable, and actionable across downstream systems.

This is a hands‑on engineering role focused on event‑driven pipelines, customer segmentation, and data ingestion. You will partner closely with Data Scientists, Product Managers, IVR/CCAI teams, and Software Engineers to productionize ML models, enable real‑time triggers, and support internal tooling such as future offer‑loading or segmentation UIs.

What you will do:

• Build and operate real‑time data pipelines that ingest customer events (payments, app behavior, IVR interactions) and power ML product decisions across channels.
• Develop event‑driven architectures using GCP services (Pub/Sub, Dataflow, Cloud Run, BigQuery) to support low‑latency triggers and segmentation.
• Partner with Data Scientists and ML engineers to productionize AIPP models (e.g., ML2), transforming model outputs into reliable, explainable data feeds.
• Translate business and marketing requirements into scalable data logic, including customer segments, eligibility rules, and offer mappings.
• Enable IVR and CCAI experiences by supporting data flows for intelligent routing, proactive messaging, and self‑serve journeys.
• Support internal tools and future UI capabilities by providing clean datasets, schemas, and APIs for Software and Full Stack Engineers.
• Monitor, troubleshoot, and improve production pipelines, ensuring data quality, reliability, and observability during peak periods.
• Optimize for performance and cost, balancing streaming workloads, BigQuery usage, and API integrations.
• Enable responsible AI practices through validation, lineage, and monitoring so personalization decisions remain transparent and trustworthy.
• Contribute to long‑term architecture and standards, helping AIPP evolve into a steady‑state personalization platform.

What you bring

• 4+ years of experience in Data Engineering or backend data systems.
• Strong experience with Python and SQL in production environments.
• Hands‑on experience with GCP, especially BigQuery and Pub/Sub.
• Experience designing and operating streaming or event‑driven pipelines.
• Understanding of data modeling, data quality, and pipeline reliability.
• Experience integrating data via APIs, including retries, rate limiting, and failure handling.
• Bachelor’s degree in Computer Science, Engineering, Data Systems, or a related technical field OR equivalent hands‑on industry experience building production‑grade data pipelines.

Nice to Have

• Experience with Adobe Experience Platform or other CDPs.
• Exposure to AI/ML feature pipelines or real‑time model scoring.
• Experience with Dataflow (Apache Beam), dbt, or Airflow/Composer.
• Familiarity with personalization or decisioning platforms (PEGA‑like concepts).
• Telecom or high‑volume consumer data experience.

Salary Range: $104,000–$156,000

Performance Bonus or Sales Incentive Plan: 15%

Actual total compensation will be determined based on factors such as knowledge, skills, performance and experience. We encourage all qualified candidates to apply, even if the posted salary range doesn't match your expectations. We're open to discussing competitive compensation packages tailored to your experience level and expertise.

Salary and benefits may vary per job function and can include a comprehensive total rewards package highlighting competitive salary and bonus structures, minimum 3 weeks of vacation, flexible benefits plan, company‑matched pension and share purchase programs, opportunities to give back to communities, and career growth and learning & development opportunities.

We are committed to diversity and equitable access to employment opportunities based on ability. Your unique contributions and talents will be valued and respected here. When you join our team, you’re helping us make the future friendly.

Note for Quebec candidates: if knowledge of English is required for this position, it is because the team member will be asked, on a regular basis, to interact in English with external or internal parties or to use English applications or software as part of their tasks.