Lead Data Engineer

ITC Infotech; Vancouver; Hybrid; CAD 140,000 - 190,000; Full time

Job summary

ITC Infotech seeks a Technical Lead – Data Engineering to own end-to-end solutioning for a multi-track data engineering program in Retail. The role requires a senior leader who combines deep technical fluency with delivery leadership across cross-geo teams.

You will guide governance, data platforms, and AI-enabled delivery, influencing architecture and ensuring production readiness through disciplined execution.

Qualifications

• Over 10 years in technology with 5+ years in data engineering leadership for complex programs.
• Proven success delivering multi-track programs with senior stakeholder engagement.
• Deep experience in ETL/ELT, data modeling, observability, and production support.
• Fluent in SQL and Python with strong governance and delivery discipline.

Responsibilities

• Own solutioning and engineering practice across multiple tracks including roadmap and milestones.
• Establish governance cadence with weekly status, risk reviews, and steering updates.
• Drive delivery predictability and operational rigor with clear plans and metrics.
• Lead and mentor ~20-person teams including offshore/matrix reporting.
• Influence architecture through reviews and collaboration with architects.

Skills

Data engineering leadership

Multi-track program delivery

SQL (advanced)

Python

Airflow

Kafka

Databricks/Spark

Snowflake

Postgres

Agile delivery

Stakeholder management

Education

Bachelor’s of Engineering or related field

Tools

Jira

Confluence

Job description

ITC Infotech is a leading global technology services and solutions provider, led by Business and Technology Consulting. ITC Infotech provides business-friendly solutions to help clients succeed and be future-ready, by seamlessly bringing together digital expertise, strong industry specific alliances and the unique ability to leverage deep domain expertise from ITC Group businesses. We provide technology solutions and services to enterprises across industries such as Banking & Financial Services, Healthcare, Manufacturing, Consumer Goods, Travel and Hospitality, through a combination of traditional and newer business models, as a long-term sustainable partner.

Role Summary:

We are seeking a results-driven Technical Lead – Data Engineering to own end-to-end solutioning and technical leadership for a multi-track Data Engineering program in the Retail domain. This role is intended for a senior data engineering leader who combines deep technical fluency with proven delivery leadership, driving predictable execution, engineering discipline, and continuous improvement.

Also, looking for strong background, experience and understanding of relevant AI toolset applicable in a Snowflake, Python code-base and Airflow orchestration landscape.

You will lead a 20+ person delivery team (cross-geo), with onsite/NA team members reporting directly and strong coordination across matrix/offshore teams. The role is highly stakeholder-facing, partnering with customer Directors, Tech Managers, Program/Project Managers, Product Management, BSAs, Engineers, and Architects.

This role is not expected to be the primary solution architect for every area but is expected to influence architecture and engineering outcomes through design reviews, technical governance, and partnership with architects/tech leads.

Key Responsibilities

• Own solutioning and engineering practice across multiple tracks: scope, roadmap, milestones, dependencies, RAID, and change control.
• Establish and run governance cadence: weekly status, executive readouts, risk reviews, planning alignment, and steering updates.
• Drive delivery predictability and operational rigor through clear plans, measurable outcomes, and disciplined execution.
• Act as the primary delivery interface for customer stakeholders (Directors, Tech Managers, PgMs/PjMs, Product team, BSAs, Engineers, Architects).
• Translate business priorities into actionable plans with clear acceptance criteria, sequencing, and release milestones.
• Communicate proactively on progress, tradeoffs, risks, mitigations, and decisions required; manage escalations and align on next steps.

Technical Delivery Leadership (Data Engineering)

• Lead delivery across ingestion, streaming, transformation, orchestration, and data product enablement using:
• Airflow for orchestration, scheduling, dependency management, and operational SLAs
• Kafka for event/stream processing patterns and reliability considerations
• Databricks/Spark for processing and pipelines
• Snowflake for warehousing/analytics, performance, and cost considerations
• Postgres for operational data sources / integrations
• Influence solution quality through technical governance: design reviews, coding standards, data modeling standards, performance practices, and reusable patterns.
• Ensure production readiness: monitoring/alerting, runbooks, incident response, root-cause analysis, and preventative actions across tracks.
• Lead and motivate a ~20-person team; directly manage NA/onsite reports and influence matrix/offshore teams to deliver outcomes.
• Build a culture of ownership, accountability, collaboration, and continuous improvement.
• Coach leads and scrum masters on execution discipline, stakeholder communication, and delivery predictability.

Optimization & AI-Enabled Delivery

• Drive efficiency via automation and AI-assisted workflows (e.g., AI-assisted code review, test/data validation generation, documentation/runbooks acceleration, incident triage support).
• Implement Lean/Kaizen practices to reduce cycle time, defect leakage, operational toil, and cost.
• Establish delivery and operational metrics to identify bottlenecks and continuously improve throughput, quality, and reliability.

Required Qualifications

• 10+ years in technology, with 5+ years in data engineering leadership for complex programs (services/consulting experience strongly preferred).
• Proven success delivering multi-track programs with complex dependencies and senior stakeholder engagement.
• Deep experience in data engineering delivery including ETL/ELT, orchestration, data modeling, data quality, observability/monitoring, and production support.
• Technical fluency required to lead engineering outcomes and challenge decisions (not required to be the primary architect for all areas), including:
• SQL (advanced) and Python fundamentals
• Snowflake and Databricks/Spark delivery experience (one can be primary; the other must be strong working knowledge)
• Airflow concepts (DAG patterns, scheduling, SLAs, failure handling, operationalization)
• Kafka concepts (producer/consumer patterns, reliability considerations, event-driven delivery)
• Postgres fundamentals (query design/performance basics; source/integration patterns)
• Strong Agile delivery experience (Scrum/Kanban) and tools (Jira/Confluence or equivalent).
• Excellent communication skills—able to align technical and non-technical audiences and drive decisions.

Preferred / Nice-to-Have

• Retail domain experience (ecomm, merchandising, inventory, supply chain, pricing/promotions, customer/loyalty).
• Experience applying AI/automation to improve engineering delivery and operations (Copilot-style tools, workflow automation, guardrails).
• Data governance/compliance experience (PII handling, access controls, audit readiness).
• Familiarity with BI tools (Power BI/Tableau) and semantic layer concepts.
• Certifications: PMP, CSM/PSM, SAFe, Databricks/Snowflake certifications.

Education

• Bachelor’s of Engineering or related fields.

ITC Infotech is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. ITC infotech is committed to providing veteran employment opportunities to our service men and women.