Data Engineer: Ingestion & AI Automation

Ensemble; Toronto; On-site; CAD 80,000 - 100,000; Full time

Job summary

A leading travel agency consortium seeks an experienced Data Engineer to build and optimize ingestion pipelines in a high-volume data environment. The successful candidate will work with technologies such as Python, PySpark, and Azure Data Factory to ensure data accuracy and operational stability. This role emphasizes automation, data quality, and collaboration with cross-functional teams, ideal for someone excited about modern data systems and AI-driven improvements.

Qualifications

• Strong hands-on experience with Python, PySpark, and SQL for ingestion and transformation.
• Experience with cloud-scale ETL tools like Microsoft Fabric and Azure Data Factory.
• Demonstrated ability to troubleshoot ingestion issues end-to-end across cloud, application, and data layers.

Responsibilities

• Design, build, and automate ingestion pipelines using various technologies.
• Own operational reliability of partner production data and integration processes.
• Support CRM and finance data flows by developing reliable integrations.

Skills

Python

PySpark

SQL

API integration

Data quality assurance

Automation

Problem-solving

Education

3–5 years of experience in data engineering or ETL development

Tools

Microsoft Fabric

Azure Data Factory

Synapse Analytics

Job description

A leading travel agency consortium seeks an experienced Data Engineer to build and optimize ingestion pipelines in a high-volume data environment. The successful candidate will work with technologies such as Python, PySpark, and Azure Data Factory to ensure data accuracy and operational stability. This role emphasizes automation, data quality, and collaboration with cross-functional teams, ideal for someone excited about modern data systems and AI-driven improvements.