Data Engineering Lead

Querentia; Calgary; On-site; CAD 120,000 - 190,000; Full time

Job summary

Querentia is seeking a Data Engineering Lead to design, implement, and optimize batch, distributed, and real-time data pipelines. The role emphasizes fault-tolerant architectures, self-healing data flows, and leading complex technical programs.

You will build highly available data platforms and guide strategic data initiatives across the organization. The ideal candidate will demonstrate strong leadership, deep expertise in data engineering, experience with large-scale datasets, and excellent

Qualifications

• Deep expertise in data engineering and distributed data processing.
• Experience designing and supporting batch, distributed, and real-time data pipelines.
• Strong understanding of highly available and fault-tolerant data architectures.
• Experience building self-healing and adaptive data pipelines.
• Strong experience with distributed query engines and large-scale data processing.
• Proven ability to optimize queries across datasets containing billions of rows.
• Strong technical leadership and consultation skills.
• Experience leading complex technical implementations.
• Strong troubleshooting and root cause analysis capabilities.
• Excellent documentation and communication skills.

Responsibilities

• Demonstrate deep knowledge of the data engineering domain to build and support batch and distributed data processing, real-time data pipelines, and highly available data platforms.
• Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines.
• Provide technical consultation and lead the implementation of complex data engineering programs.
• Develop and maintain comprehensive documentation for assigned systems and projects.
• Tune queries processing billions of rows within distributed query engines.
• Perform detailed root cause analysis to identify permanent resolutions to software and business process issues.
• Support ongoing optimization, reliability, and performance improvements across data engineering capabilities.

Job description

Data Engineering Lead

Possible 3 Month CTH

Role Name: Data Eng Lead_SOW176
Work Site: Calgary, CA Onsite
Start Date: Immediate Availability

Role Summary

We are seeking a Data Engineering Lead with deep expertise in data engineering and distributed data platforms. The role will focus on building and supporting highly available data capabilities, including both batch/distributed and real-time data pipelines.

The successful candidate will be responsible for developing fault-tolerant and adaptive data pipelines, leading complex technical implementations, optimizing distributed queries, and driving permanent resolutions to software and business process issues.

Key Responsibilities

• Demonstrate deep knowledge of the data engineering domain to build and support:

  • Batch and distributed data processing

  • Real-time data pipelines

  • Highly available data platforms

  • Data and technology capabilities

• Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines.

• Provide technical consultation and lead the implementation of complex data engineering programs.

• Develop and maintain comprehensive documentation for assigned systems and projects.

• Tune queries processing billions of rows of data within distributed query engines.

• Perform detailed root cause analysis (RCA) to identify permanent resolutions to software and business process issues.

• Support ongoing optimization, reliability, and performance improvements across data engineering capabilities.

Required Skills & Experience

• Deep expertise in data engineering and distributed data processing.

• Experience designing and supporting batch, distributed, and real-time data pipelines.

• Strong understanding of highly available and fault-tolerant data architectures.

• Experience building self-healing and adaptive data pipelines.

• Strong experience with distributed query engines and large-scale data processing.

• Proven ability to optimize queries across datasets containing billions of rows.

• Strong technical leadership and consultation skills.

• Experience leading complex technical implementations.

• Strong troubleshooting and root cause analysis capabilities.

• Excellent documentation and communication skills.