Senior Data Engineer – 6 month contract

Jobtailor; Vancouver; On-site; CAD 110,000 - 140,000; Full time

Job summary

Jobtailor in Vancouver, Canada seeks a Senior Data Engineer to design, build and maintain data pipelines using Microsoft Fabric and Azure Data Factory, ensuring security and regulatory compliance.

You will collaborate with data governance stakeholders, develop monitoring solutions with Azure-native services, and manage CI/CD pipelines with Azure DevOps, while producing comprehensive documentation in Confluence and adhering to ITIL processes.

Qualifications

• Bachelor's degree in a relevant field.
• 6+ years of experience in data engineering.
• Hands-on with Microsoft Fabric and Azure data technologies.
• Proficient in SQL and Python/PySpark for data workflows.
• Experience with ETL/ELT concepts and data pipeline design.
• Experience with financial systems and handling PII per regulatory standards.
• Experience with Jira, Confluence, and Azure DevOps.

Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric and ADF.
• Ensure data security and compliance by implementing best practices.
• Collaborate with data governance stakeholders to enforce data quality standards.
• Design and implement monitoring solutions using Azure-native services.
• Deliver data solutions aligned with approved architecture.
• Collaborate cross-functionally with Data Architects, Business Stakeholders, and data teams.
• Develop, configure, and maintain CI/CD pipelines using Azure DevOps.
• Produce and maintain documentation in Confluence.
• Adhere to ITIL-based incident and change management processes.
• Proactively drive operational excellence by identifying recurring issues.
• Conduct peer code reviews through pull requests.
• Deliver against project commitments.

Skills

Microsoft Fabric

Azure Data Factory (ADF)

SQL

Python / PySpark

CI/CD Pipelines

Data Pipeline Design

ETL/ELT Concepts

Data Governance & Security

ITIL Process Understanding

Git

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Tools

Jira

Confluence

Azure DevOps

Git

Azure Storage Services

Job description

• Design, develop, and maintain data pipelines using Microsoft Fabric and Azure Data Factory (ADF)
• Ensure data security and compliance by implementing best practices
• Collaborate with data governance stakeholders to enforce data quality standards
• Design and implement monitoring solutions using Azure-native services
• Deliver data solutions in alignment with approved architecture
• Collaborate cross-functionally with Data Architects, Business Stakeholders, and data teams
• Develop, configure, and maintain CI/CD pipelines using Azure DevOps
• Produce and maintain comprehensive documentation in Confluence
• Ensure adherence to ITIL-based processes for incident and change management
• Proactively drive operational excellence by identifying recurring issues
• Conduct peer code reviews through pull requests
• Deliver against project commitments

Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field
• 6+ years of experience in data engineering roles
• Hands-on experience in Microsoft Fabric and Azure data technologies
• Strong proficiency in Azure Data Factory (ADF), Microsoft Fabric, SQL, and Azure Storage services
• Proficiency in SQL and Python\PySpark for developing data transformation and processing workflows
• Strong understanding of ETL/ELT concepts, data pipeline design, and orchestration patterns
• Experience integrating financial systems and handling sensitive data (e.g., PII) in compliance with regulatory and security standards
• Experience with collaboration and delivery tools such as Jira, Confluence, and Azure DevOps
• Strong proficiency with Git and Azure DevOps, including repository management, branching strategies, pull requests, peer reviews, merge conflict resolution, release management, and CI/CD deployment practices supporting enterprise data engineering solutions

Core Competencies

Demonstrates expertise in designing and maintaining data pipelines using Microsoft Fabric and Azure Data Factory, with a strong focus on data security, compliance, and operational excellence. Proficient in SQL, Python, and CI/CD practices to deliver high-quality data solutions aligned with architectural standards.

Highest-signal resume keywords

• Microsoft Fabric
• Azure Data Factory (ADF)
• SQL
• Python/PySpark
• CI/CD Pipelines

ATS Optimization Keywords

Hard Skills

• Data Pipeline Design
• ETL/ELT Concepts
• Data Transformation
• Data Processing Workflows
• Data Quality Standards
• Monitoring Solutions
• Incident Management
• Change Management
• Data Governance
• Data Security Compliance

Soft Skills

• Collaboration
• Problem-Solving
• Documentation

Industry Keywords

• Data Engineering
• Financial Systems Integration
• Sensitive Data Handling
• Regulatory Standards
• ITIL Processes

Tools & Technologies

• Azure DevOps
• Confluence
• Jira
• Azure Storage Services
• Git