Senior Data Engineer

NearSource; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading software consulting firm in Toronto seeks a Senior Data Engineer to architect and scale data pipelines supporting analytics. The ideal candidate has 5+ years of experience in big data systems, with strong expertise in Python, Spark, and SQL. This hybrid role offers a collaborative environment focused on delivering insights for a Fortune 500 client.

Qualifications

• 5 years of experience in big data systems, data processing, and SQL databases.
• Strong proficiency with Spark data frames, Spark SQL, and PySpark.
• Hands-on programming expertise in Python and SQL with modular, maintainable code.

Responsibilities

• Architect and scale data infrastructure for processing billions of records.
• Automate cloud infrastructure services for resilient data platforms.
• Partner with teams to understand requirements and promote best practices.

Skills

Python

Spark

SQL

Snowflake

ETL tools (Airflow)

Power BI

Tableau

Jupyter Notebooks

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Hive

AWS

Git

Jenkins

Job description

Overview

Senior Data Engineer (Python Spark Snowflake)

Hybrid (3 days remote) Toronto Ontario Canada

Experience : 5 Years

NearSource is looking for a Senior Data Engineer with expertise in Python Spark and Snowflake to join our engineering team in Toronto. The selected candidate will architect and scale data pipelines enable analytics and support critical business insights for a Fortune 500 client.

Responsibilities

• Architect and scale data infrastructure to support batch and real-time processing of billions of records
• Break down complex problems document technical solutions and deliver iterative improvements
• Automate cloud infrastructure services and observability for resilient data platforms
• Develop and maintain CI / CD pipelines with robust testing automation
• Partner with data engineers scientists and product managers to understand requirements and promote best practices
• Design and optimize SQL-based solutions for analytics and business intelligence
• Build reports dashboards and analytics to deliver actionable insights to stakeholders
• Support analytics initiatives including funnel metrics campaign performance segmentation and revenue growth
• Deliver clear presentations translating complex data problems into strategic insights

Required Qualifications

• 5 years of experience in big data systems data processing and SQL databases
• Strong proficiency with Spark data frames Spark SQL and PySpark
• Hands-on programming expertise in Python and SQL writing modular and maintainable code
• Solid understanding of SQL dimensional modeling and analytical data warehouses (Hive Snowflake)
• Experience with ETL workflow management tools such as Airflow
• Proficiency in BI and dashboarding tools including Power BI Tableau or Qlik
• Experience with version control and CI / CD pipelines (Git Jenkins)
• Proficiency with notebook solutions such as Jupyter EMR Notebooks or Apache Zeppelin

Nice-to-Have Skills

• Familiarity with Presto and AWS cloud services
• Knowledge of Looker for BI and dashboard development
• Experience in distributed systems reliability and resiliency engineering
• Exposure to observability and monitoring frameworks

Certifications / Education

Bachelors degree in Computer Science Engineering or related field (or equivalent training and experience)

Apply now or share your resume with salary expectations at Thank you for considering a career with us! Once you submit your application our Talent Acquisition team will review your resume thoroughly. If theres a strong match well reach out to discuss your experience role details benefits compensation and next steps. While we strive for transparency we may not be able to respond to every applicant due to high volume but we genuinely appreciate your time and interest.

About NearSource

NearSource Technologies is a trusted partner for future-ready software consulting enabling Fortune 500 enterprises to accelerate digital transformation. Our global engineering teams build and deploy impactful technology for some of the worlds most admired brands working directly on long-term client initiatives.

Equal Opportunity Statement : NearSource is an equal opportunity employer committed to fostering an inclusive and respectful environment. We celebrate diversity and do not discriminate based on race gender religion sexual orientation age disability or background. Innovation thrives when everyone feels empowered to contribute.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type

Full Time

Experience

5 Years

Vacancy

1