Data Engineer

VySystems

Canada

On-site

CAD 110,000 - 150,000

Full time

13 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

VySystems is seeking a seasoned software engineer in Canada to drive data-intensive projects using Python, PySpark, and real-time streaming architectures. The role focuses on building scalable data pipelines with Spark SQL/DataFrames/Datasets, leveraging Azure Databricks and Delta tables, and integrating Azure services for ingestion.

Strong SQL, collaboration, and agile delivery skills are essential. The candidate will participate in SDLC activities, conduct code reviews, and communicate complex

Qualifications

  • 5-8 years of hands-on experience in software development.
  • Experience in AI and Claude code.
  • Strong PySpark expertise for scalable data pipelines.
  • Design and implementation of real-time data streaming using Spark SQL, DataFrames, and Datasets.
  • Proficiency with Azure Databricks, Delta tables, workflows, and Python scripting.
  • Familiar with Azure Data Lake, Data Factory, and EventHub or Kafka for streaming data ingestion.
  • Ability to write complex SQL queries and create views across multiple tables.
  • Experience across the Software Development Lifecycle with Agile Scrum methodologies.
  • Proficiency with Jira, Confluence, and GitHub for project management, documentation, and CI/CD.
  • Strong collaboration, problem-solving, and communication skills.
  • Proactive, responsive during business hours for ad-hoc calls or meetings.
  • Ability to prioritize, think creatively, and adapt to new technologies.

Skills

Python programming
AI
Claude code
PySpark
Spark SQL
DataFrames
DataSets
Azure Databricks
Delta tables
Azure Data Lake
Azure Data Factory
EventHub
Kafka
SQL
SDLC
Agile Scrum
Jira
Confluence
GitHub
Collaboration
Mobbing sessions
Code review
communication
problem-solving
prioritization
adaptability

Tools

Jira
Confluence
GitHub

Job description

  • 5-8 years of hands-on experience in software development, with a strong emphasis on Python programming.
  • Experinec in AI (Artificial Intelligence) & Claude code.
  • Deep expertise in PySpark for building and optimizing scalable data pipelines.
  • Proficient in designing and implementing real-time data streaming solutions using Spark SQL, DataFrames, and Datasets.
  • Solid experience with Azure Databricks, including working with Delta tables, workflows, and scripting in Python.
  • Familiar with Azure cloud services, especially Azure Data Lake, Azure Data Factory, and EventHub or Kafka for streaming data ingestion.
  • Skilled in writing complex SQL queries and building views involving joins across multiple tables.
  • Experience across the Software Development Lifecycle (SDLC), with a strong grasp of Agile Scrum methodologies.
  • Proficient in tools like Jira (project management), Confluence (documentation), and GitHub (version control and CI/CD pipelines).
  • Strong collaboration mindset with enthusiasm for mobbing sessions and cross-team coordination.
  • Excellent problem-solving and code review skills.
  • Strong communication skills with the ability to understand business requirements and translate them into technical solutions.
  • Proactive and responsive during business hours for any ad-hoc calls or meetings.
  • Demonstrated ability to prioritize effectively, think creatively, and adapt quickly to new technologies and feedback.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Cloud Data Engineer
Azure Cloud Data Engineer

Compunnel Inc. • Mississauga

On-site
CAD 100,000 - 130,000
Senior Python PySpark Data Engineer – Databricks
Senior Python PySpark Data Engineer – Databricks

Compunnel Inc. • Mississauga

Remote
CAD 90,000 - 120,000
Python/PySpark Developer
Python/PySpark Developer

Compunnel Inc. • Mississauga

Remote
CAD 90,000 - 120,000
Databricks Engineer
Databricks Engineer

Compunnel Inc. • Mississauga

On-site
CAD 120,000 - 150,000
Python Pyspark Developer
Python Pyspark Developer

Lancesoft • Montreal

On-site
CAD 90,000 - 130,000
Data Engineer
Data Engineer

Kumaran Systems • Toronto

On-site
CAD 70,000 - 90,000
Azure Data Engineer - ETL, SQL
Azure Data Engineer - ETL, SQL

Astra-North Infoteck Inc. • Toronto

On-site
CAD 80,000 - 110,000
Azure Data Engineer
Azure Data Engineer

Astra-North Infoteck Inc. • Toronto

Hybrid
CAD 100,000 - 130,000
Data Engineering Tech Lead
Data Engineering Tech Lead

Vooban • Quebec

On-site
CAD 120,000 - 150,000
Data Science Developer - Senior JP210
Data Science Developer - Senior JP210

P@thlion Staffing Careers • Fredericton

On-site
CAD 70,000 - 110,000