Consultant, Data Engineering

Avanade Inc.; New Brunswick; In loco; CAD 97.000 - 115.000; Tempo pieno

Descrizione del lavoro

Avanade Inc. seeks a data engineer to partner with client stakeholders, design scalable data pipelines, and deliver lakehouse solutions using Microsoft Fabric and Azure Databricks.

You will implement Python-based data transformations, lead Agile delivery, and mentor junior teammates while collaborating with architects, analysts, and AI engineers across onshore and offshore teams. This role requires 3–6 years in data roles, strong SQL/PySpark skills, and eligibility for Government of Canada

Competenze

• 3 to 6 years in data engineering or related data roles.
• Hands-on experience with Microsoft Fabric and Azure Databricks.
• Strong Python, PySpark, and SQL skills.
• Experience building ETL/ELT pipelines and lakehouse data layers.
• Consulting experience with client stakeholders.
• Ability to structure complex problems and drive pragmatic solutions.
• Stakeholder management and presentation skills.
• Explain technical concepts to diverse audiences.
• Experience with Azure Data Factory, Data Lake Storage, Power BI, Purview, or DevOps.
• Experience in Agile delivery and estimation, planning, testing, and releases.
• Eligible for Government of Canada Secret Security Clearance.

Mansioni

• Partner with client stakeholders to understand priorities and translate needs into data solutions.
• Lead problem-solving across ambiguous environments, evaluating options and risks.
• Design, build, test, and support data pipelines and lakehouse solutions using Fabric and Databricks.
• Develop data transformations using Python, PySpark, and SQL.
• Facilitate workshops, backlog refinement, and solution walkthroughs with stakeholders.
• Communicate progress and manage expectations through regular updates.
• Apply data quality, observability, security, and governance best practices.
• Contribute to architecture decisions, estimates, and technical documentation.
• Collaborate with architects, analysts, data scientists, AI engineers, and delivery teams.
• Mentor junior team members through guidance and reviews.
• Explore AI engineering opportunities with Microsoft Foundry and Copilot Studio.

Conoscenze

Data engineering

Python

PySpark

SQL

ETL/ELT pipelines

Lakehouse

Consulting

Stakeholder management

Agile delivery

Security clearance

Strumenti

Microsoft Fabric

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Power BI

Microsoft Purview

Azure DevOps

Descrizione del lavoro

What You’ll Do

• Partner with client stakeholders to understand business priorities, uncover root causes, define requirements, and translate complex needs into actionable data solutions.
• Lead problem‑solving activities across ambiguous and complex environments, evaluating options, risks, dependencies, and trade‑offs.
• Design, build, test, and support scalable data pipelines, lakehouse solutions, and curated data products using Microsoft Fabric and Azure Databricks.
• Develop reliable data transformations and engineering components using Python, PySpark, and SQL.
• Facilitate discovery sessions, technical workshops, backlog refinement, solution walkthroughs, and stakeholder updates.
• Manage stakeholder expectations through clear communication, proactive issue management, and transparent delivery reporting.
• Apply sound engineering practices for data quality, observability, security, governance, performance optimization, and operational support.
• Contribute to architecture decisions, estimates, delivery plans, technical documentation, and client presentations.
• Collaborate with architects, analysts, data scientists, AI engineers, and delivery teams across onshore and offshore environments.
• Support and mentor junior team members through technical guidance, reviews, and knowledge sharing.
• Explore opportunities to integrate AI engineering capabilities into data solutions, including Microsoft Foundry and Microsoft Copilot Studio.

Skills and experience

• 3 to 6 years of experience in data engineering, analytics engineering, business intelligence, or related data roles.
• Hands‑on experience delivering solutions with both Microsoft Fabric and Azure Databricks.
• Strong programming skills in Python, with practical experience using PySpark and SQL.
• Experience designing and building ETL/ELT pipelines, lakehouse architectures, data transformations, and curated data layers.
• Proven consulting or professional services experience, including direct interaction with client stakeholders.
• Demonstrated ability to structure complex problems, investigate root causes, evaluate alternatives, and drive pragmatic solutions.
• Strong stakeholder management, facilitation, communication, and presentation skills.
• Ability to explain technical concepts to both technical and non‑technical audiences.
• Experience with Azure Data Factory, Azure Data Lake Storage, Power BI, Microsoft Purview, or Azure DevOps.
• Experience working in Agile delivery environments and contributing to estimation, planning, testing, and release activities.
• Eligibility for Government of Canada Secret Security Clearance.

AI Engineering Exposure

• Exposure to AI engineering concepts and the delivery of AI‑enabled or agentic solutions.
• Familiarity with Microsoft Foundry for developing, evaluating, or operationalizing AI solutions.
• Familiarity with Microsoft Copilot Studio for building and integrating copilots or agents into business workflows.
• Understanding of how governed, high‑quality data platforms enable analytics, machine learning, generative AI, and agentic experiences.

Compensation at Avanade varies depending on a wide array of factors, which may include but are not limited to the specific office location, role, skill set, and level of experience. As required by local law, Avanade provides a reasonable range of compensation, based on full‑time employment, for roles that may be hired as set forth below.

The recruiting efforts for this position are intended to fill a brand new position.

The base pay range shown below is intended as a guideline to reflect the majority of offers for this role.

It does not represent a maximum limit — in some cases, actual compensation may exceed the range where appropriate.

See more information on our benefits here: Canada Employee Benefits | Avanade

British Columbia/Ontario/ New Brunswick- CAD96,700 - CAD115,000