Lead Data Engineer

ITC Infotech; Vancouver; On-site; CAD 150,000 - 190,000; Full time

Job summary

ITC Infotech is seeking a Technical Lead – Data Engineering to own end-to-end solutioning for a multi-track Data Engineering program in the Retail domain. This senior leader combines deep technical fluency with proven delivery leadership across cross-geo teams.

You will influence architecture and governance, drive delivery discipline, and partner with Directors, Tech Managers, PMs, Product teams, BSAs, Engineers, and Architects to deliver outcomes.

Qualifications

• 10+ years in technology, with 5+ years in data engineering leadership.
• Proven success delivering multi-track programs with complex dependencies.
• Deep experience in data engineering delivery including ETL/ELT, modeling, quality and observability.

Responsibilities

• Own solutioning and engineering practice across multiple tracks: scope, roadmap, milestones, dependencies, RAID, and change control.
• Establish and run governance cadence: weekly status, executive readouts, risk reviews, planning alignment, and steering updates.
• Drive delivery predictability and operational rigor through clear plans and disciplined execution.
• Act as the primary delivery interface for customer stakeholders and cross-functional teams.

Skills

Data engineering leadership

Delivery leadership

SQL

Python

Agile delivery

Communication

Education

Bachelor's degree in Engineering

Tools

Airflow

Kafka

Snowflake

Databricks/Spark

Postgres

Jira/Confluence

Job description

ITC Infotech is a leading global technology services and solutions provider, led by Business and Technology Consulting. ITC Infotech provides business-friendly solutions to help clients succeed and be future-ready, by seamlessly bringing together digital expertise, strong industry specific alliances and the unique ability to leverage deep domain expertise from ITC Group businesses. We provide technology solutions and services to enterprises across industries such as Banking & Financial Services, Healthcare, Manufacturing, Consumer Goods, Travel and Hospitality, through a combination of traditional and newer business models, as a long-term sustainable partner.

Role Summary:

We are seeking a results-driven Technical Lead – Data Engineering to own end-to-end solutioning and technical leadership for a multi-track Data Engineering program in the Retail domain. This role is intended for a senior data engineering leader who combines deep technical fluency with proven delivery leadership, driving predictable execution, engineering discipline, and continuous improvement.

Also, looking for strong background, experience and understanding of relevant AI toolset applicable in a Snowflake, Python code-base and Airflow orchestration landscape.

You will lead a 20+ person delivery team (cross-geo), with onsite/NA team members reporting directly and strong coordination across matrix/offshore teams. The role is highly stakeholder-facing, partnering with customer Directors, Tech Managers, Program/Project Managers, Product Management, BSAs, Engineers, and Architects.

This role is not expected to be the primary solution architect for every area but is expected to influence architecture and engineering outcomes through design reviews, technical governance, and partnership with architects/tech leads.

Key Responsibilities

• Own solutioning and engineering practice across multiple tracks: scope, roadmap, milestones, dependencies, RAID, and change control.
• Establish and run governance cadence: weekly status, executive readouts, risk reviews, planning alignment, and steering updates.
• Drive delivery predictability and operational rigor through clear plans, measurable outcomes, and disciplined execution.
• Act as the primary delivery interface for customer stakeholders (Directors, Tech Managers, PgMs/PjMs, Product team, BSAs, Engineers, Architects).
• Translate business priorities into actionable plans with clear acceptance criteria, sequencing, and release milestones.
• Communicate proactively on progress, tradeoffs, risks, mitigations, and decisions required; manage escalations and align on next steps.

Technical Delivery Leadership (Data Engineering)

• Lead delivery across ingestion, streaming, transformation, orchestration, and data product enablement using:
• Airflow for orchestration, scheduling, dependency management, and operational SLAs
• Kafka for event/stream processing patterns and reliability considerations
• Databricks/Spark for processing and pipelines
• Snowflake for warehousing/analytics, performance, and cost considerations
• Postgres for operational data sources / integrations
• Influence solution quality through technical governance: design reviews, coding standards, data modeling standards, performance practices, and reusable patterns.
• Ensure production readiness: monitoring/alerting, runbooks, incident response, root-cause analysis, and preventative actions across tracks.
• Lead and motivate a ~20-person team; directly manage NA/onsite reports and influence matrix/offshore teams to deliver outcomes.
• Build a culture of ownership, accountability, collaboration, and continuous improvement.
• Coach leads and scrum masters on execution discipline, stakeholder communication, and delivery predictability.

Optimization & AI-Enabled Delivery

• Drive efficiency via automation and AI-assisted workflows (e.g., AI-assisted code review, test/data validation generation, documentation/runbooks acceleration, incident triage support).
• Implement Lean/Kaizen practices to reduce cycle time, defect leakage, operational toil, and cost.
• Establish delivery and operational metrics to identify bottlenecks and continuously improve throughput, quality, and reliability.

Required Qualifications

• 10+ years in technology, with 5+ years in data engineering leadership for complex programs (services/consulting experience strongly preferred).
• Proven success delivering multi-track programs with complex dependencies and senior stakeholder engagement.
• Deep experience in data engineering delivery including ETL/ELT, orchestration, data modeling, data quality, observability/monitoring, and production support.
• Technical fluency required to lead engineering outcomes and challenge decisions (not required to be the primary architect for all areas), including:
• SQL (advanced) and Python fundamentals
• Snowflake and Databricks/Spark delivery experience (one can be primary; the other must be strong working knowledge)
• Airflow concepts (DAG patterns, scheduling, SLAs, failure handling, operationalization)
• Kafka concepts (producer/consumer patterns, reliability considerations, event-driven delivery)
• Postgres fundamentals (query design/performance basics; source/integration patterns)
• Strong Agile delivery experience (Scrum/Kanban) and tools (Jira/Confluence or equivalent).
• Excellent communication skills—able to align technical and non-technical audiences and drive decisions.

Preferred / Nice-to-Have

• Retail domain experience (ecomm, merchandising, inventory, supply chain, pricing/promotions, customer/loyalty).
• Experience applying AI/automation to improve engineering delivery and operations (Copilot-style tools, workflow automation, guardrails).
• Data governance/compliance experience (PII handling, access controls, audit readiness).
• Familiarity with BI tools (Power BI/Tableau) and semantic layer concepts.
• Certifications: PMP, CSM/PSM, SAFe, Databricks/Snowflake certifications.

Education

• Bachelor’s of Engineering or related fields.

ITC Infotech is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. ITC infotech is committed to providing veteran employment opportunities to our service men and women.