Data Engineering Consultant: Lakehouse on Databricks

Avanade Inc.; New Brunswick; On-site; CAD 97,000 - 115,000; Full time

Job summary

Avanade Inc. seeks a data engineer to partner with client stakeholders, design scalable data pipelines, and deliver lakehouse solutions using Microsoft Fabric and Azure Databricks.

You will implement Python-based data transformations, lead Agile delivery, and mentor junior teammates while collaborating with architects, analysts, and AI engineers across onshore and offshore teams. This role requires 3–6 years in data roles, strong SQL/PySpark skills, and eligibility for Government of Canada

Qualifications

• 3 to 6 years in data engineering or related data roles.
• Hands-on experience with Microsoft Fabric and Azure Databricks.
• Strong Python, PySpark, and SQL skills.
• Experience building ETL/ELT pipelines and lakehouse data layers.
• Consulting experience with client stakeholders.
• Ability to structure complex problems and drive pragmatic solutions.
• Stakeholder management and presentation skills.
• Explain technical concepts to diverse audiences.
• Experience with Azure Data Factory, Data Lake Storage, Power BI, Purview, or DevOps.
• Experience in Agile delivery and estimation, planning, testing, and releases.
• Eligible for Government of Canada Secret Security Clearance.

Responsibilities

• Partner with client stakeholders to understand priorities and translate needs into data solutions.
• Lead problem-solving across ambiguous environments, evaluating options and risks.
• Design, build, test, and support data pipelines and lakehouse solutions using Fabric and Databricks.
• Develop data transformations using Python, PySpark, and SQL.
• Facilitate workshops, backlog refinement, and solution walkthroughs with stakeholders.
• Communicate progress and manage expectations through regular updates.
• Apply data quality, observability, security, and governance best practices.
• Contribute to architecture decisions, estimates, and technical documentation.
• Collaborate with architects, analysts, data scientists, AI engineers, and delivery teams.
• Mentor junior team members through guidance and reviews.
• Explore AI engineering opportunities with Microsoft Foundry and Copilot Studio.

Skills

Data engineering

Python

PySpark

SQL

ETL/ELT pipelines

Lakehouse

Consulting

Stakeholder management

Agile delivery

Security clearance

Tools

Microsoft Fabric

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Power BI

Microsoft Purview

Azure DevOps

Job description

Avanade Inc. seeks a data engineer to partner with client stakeholders, design scalable data pipelines, and deliver lakehouse solutions using Microsoft Fabric and Azure Databricks.

You will implement Python-based data transformations, lead Agile delivery, and mentor junior teammates while collaborating with architects, analysts, and AI engineers across onshore and offshore teams. This role requires 3–6 years in data roles, strong SQL/PySpark skills, and eligibility for Government of Canada