Data Engineer (Intermediate)

Vantix Systems Inc.; Edmonton; On-site; CAD 85,000 - 110,000; Full time

Job summary

Vantix Systems Inc. is seeking an Intermediate Data Engineer to design and build scalable data pipelines and platforms on Azure, enabling evidence-based decisions and regulatory excellence.

You will work with Azure Data Factory, Databricks, Synapse and Delta Lake to ingest, transform, and govern data from diverse sources, including APIs. Strong Python, SQL, and ETL/ELT skills are essential for creating analytics-ready data and secure data APIs.

Qualifications

• Post-secondary degree in Computer Science or related field.
• Experience building scalable data pipelines with Azure Databricks, Delta Lake, and related tools.
• Strong knowledge of Python (including PySpark), SQL, and ETL/ELT in large-scale cloud environments.
• Familiarity with Azure Storage, SQL, Synapse, networking and authentication.
• Experience with data governance, security, and metadata management.
• Hands-on experience with version control tools like Git.

Responsibilities

• Design and build secure, scalable data architectures on Microsoft Azure.
• Develop data ingestion, transformation, and integration pipelines using Azure tools.
• Manage data lakes and storage for quick, governed access.
• Integrate data from diverse sources via APIs and scripting.
• Build data models and semantic layers for analytics and ML.
• Develop secure data APIs with Azure API Management.
• Ensure data governance and regulatory compliance.
• Monitor pipelines for reliability and performance.
• Leverage AI and automation to streamline workflows and improve code quality.

Skills

Azure Databricks

Python (PySpark)

SQL

ETL/ELT workflows

Data governance

Education

Bachelor's degree in Computer Science

Tools

Azure Data Factory

Azure Synapse Analytics

Delta Lake

Git

Job description

Intermediate Data Engineer

Our Client is seeking an Intermediate Data Engineerto design and build high-impact, scalable data pipelines and platforms that drive evidence-based decision-making and regulatory excellence. Be part of a meaningful mission where your expertise ensures data is trusted, accessible, and ready for the future—helping shape policies that matter most.

Responsibilities

• Design and implement secure, scalable data architecture on Microsoft Azure supporting cloud-native and hybrid needs.
• Develop data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics.
• Manage data lakes and structured storage with Azure Data Lake Storage Gen2, ensuring quick and governed access.
• Integrate data from diverse sources including ServiceNow and geospatial systems using APIs and custom scripting.
• Build and optimize data models and semantic layers for analytics, reporting, and machine learning.
• Develop secure data APIs with Azure API Management for seamless data sharing.
• Enforce data governance, metadata management, and compliance standards, including privacy regulations.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Leverage AI tools and automation to streamline workflows and improve code quality.

Qualifications

• Post-secondary degree, diploma, or certificate in Computer Science or related field.
• Proven experience building scalable data pipelines with Azure Databricks, Delta Lake, and related tools.
• Strong knowledge of Python (including PySpark), SQL, and ETL/ELT workflows in a large-scale cloud environment.
• Familiarity with Azure services like Storage, SQL, Synapse, networking, and authentication methods.
• Experience with data governance, security, and metadata management.
• Hands-on experience with version control tools like Github or Git.

Nice to Have Skills

• Business requirements analysis related to data manipulation and cleansing.
• Strong technical knowledge of Microsoft SQL Server.
• Experience extending solutions to Synapse Analytics and Microsoft Fabric.
• Experience with government cloud environments, Talend, RESTful APIs, and message queuing technologies.
• Familiarity with ServiceNow and enterprise data management platforms.

To be considered, applicants must be legally entitled to work in Canada, including holding any required permits.

We believe diverse teams build stronger companies, and we welcome applicants from all backgrounds, experiences, and perspectives.