Data Engineer

Compunnel Inc.; Montreal; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading technology company in Montreal is seeking a highly skilled Data Engineer to design and maintain ETL pipelines using Python and DataBricks. You will collaborate with cross-functional teams and work with cloud technologies in an agile environment. The ideal candidate has 7-15 years of experience in data engineering and proficiency with cloud-based warehouses like Snowflake.

Qualifications

• Strong proficiency in Python programming and software engineering best practices.
• Hands-on experience with DataBricks for developing scalable data solutions.
• 7-15 years of relevant experience.

Responsibilities

• Collaborate with cross-functional teams to gather and understand data requirements.
• Design, develop, and deploy scalable ETL processes using Python and DataBricks.
• Own the end-to-end engineering lifecycle of data.

Skills

Python programming

DataBricks

ETL design

Cloud-based data warehousing

Agile methodologies

Version control (Git)

Problem-solving

Education

Bachelor’s degree in Computer Science or related field

Tools

Snowflake

Power BI

Apache Airflow

Job description

We are seeking a highly skilled Data Engineer with expertise in Python and DataBricks to design, build, and maintain robust ETL pipelines and data solutions. In this role, you will work closely with cross-functional teams to transform business requirements into efficient, scalable, and reliable data workflows. This position offers a dynamic environment where you will contribute to innovative solutions, work with modern cloud technologies, and engage in agile delivery practices within an international, collaborative setting.

Key Responsibilities

• Collaborate with cross-functional teams to gather and understand data requirements.
• Design, develop, and deploy scalable ETL processes using Python and DataBricks.
• Own the end-to-end engineering lifecycle, including extraction, transformation, and loading of data.
• Create and manage data pipelines with robust error handling, monitoring, and performance optimization.
• Implement automation scripts and tooling to streamline workflows.
• Participate actively in agile ceremonies such as sprint planning, daily stand-ups, and retrospectives.
• Conduct code reviews and maintain high-quality coding standards.
• Apply testing methodologies (unit, integration, etc.) to ensure reliability and performance.
• Integrate various data sources using REST APIs and related techniques.
• Maintain documentation including technical specifications and data flow diagrams.

Required Skills

• Strong proficiency in Python programming and software engineering best practices.
• Hands‑on experience with DataBricks for developing scalable data solutions.
• 7-15 years of relevant experience.
• Proficiency with Snowflake or similar cloud-based data warehouses.
• Solid understanding of ETL design, data modeling, and warehousing principles.
• Familiarity with agile methodologies and collaborative development environments.
• Experience with Git or other version control systems.
• Excellent problem‑solving abilities and strong attention to detail.
• Working knowledge of Linux environments and REST API integrations.

Preferred Skills

• Experience with data visualization tools (e.g., Power BI).
• Background in database administration or performance tuning.
• Familiarity with orchestration tools like Apache Airflow.
• Exposure to big data frameworks such as Hadoop or Spark.

Education

Bachelor’s degree in Computer Science, Information Systems, or a related field preferred.