Sr Python Developer with PySpark and AWS

C.G. Consulting Group; Toronto; Hybrid; CAD 103,000 - 138,000; Full time

Job summary

Senior Python Developer with PySpark and AWS is sought by C.G. Consulting Group in downtown Toronto for a 6-month contract. The role is hybrid, requiring 4 days in office weekly, with a focus on data engineering and cloud-based data solutions using AWS EMR and PySpark.

Ideal candidates have 8+ years of hands-on Python/PySpark, strong code quality tooling (Pylint, Pytest), and experience with Jenkins/Urban Code. Strong collaboration with end users to translate complex requirements is essential.

Qualifications

• University degree in Engineering or Computer Science is preferred.
• 7+ years experience in data-oriented field.
• Proven experience with AWS cloud technologies and AWS EMR for big data.
• Advanced proficiency in Python and PySpark (8+ years).
• Experience with Pylint and Pytest for code quality and testing (2+ years).
• Experience with CI/CD pipelines using Jenkins and Urban Code (2+ years).
• Strong communication skills and ability to discuss complex requirements with end users.

Responsibilities

• Integrate large datasets into the research ecosystem via the resource platform.
• Collaborate with stakeholders to design and implement data solutions in cloud environments.

Skills

Python Core

PySpark

AWS

Big Data

Pylint

Pytest

Gulp

Jenkins

Urban Code

Communication

Education

University degree in Engineering or Computer Science

Tools

AWS EMR

Jenkins

Urban Code

Gulp

PyPI

JupiterLab

React

Job description

Senior Python Developer with PySpark and AWS

This is with a global IT services firm for a leading investment/wealth management services firm.

Client Location is downtown Toronto Ontario, close to TTC and GO service.

Hybrid - In Office 4 days per week - mandatory

Contract - 6 months, possible renewal

Target rate range: $75-100hr on B2B

Project description

The project involves the data engineering organization’s Analytical Work Bench , which is an integrated development environment. The objective is to rationalize and integrate AWB with another internally developed application. Additionally, the project includes creating an IDE based on the Jupyter Lab environment using custom code developed by Client.

Responsibilities

• Integrate large datasets into the research ecosystem via the resource platform.

Skills

• A university degree in Engineering or Computer Science is preferred.
• 7+ years experience working related data oriented field
• Proven experience working with cloud-based technologies, specifically AWS.
• Solid expertise in Big Data solutions utilizing AWS EMR.
• Advanced proficiency in Python Core and PySpark, with over 8 years of hands-on experience.
• Practical knowledge of Pylint and Pytest for code quality and testing, with at least two years of experience.
• Extensive experience with package management and automation tools such as PyPI and Gulp for over five years.
• Familiarity with continuous integration and continuous delivery pipelines using Jenkins and Urban Code, with more than two years of experience.
• Excellent communication skills demonstrated through collaboration with end users to gather and discuss complex business requirements effectively.

Nice to have

• UI development with React: Familiarity with building user interfaces using React is advantageous.
• JupiterLab: Experience working with JupiterLab is a beneficial asset.
• Data Engineering and/or Data Science experience: Having skills or experience in data engineering or data science is a plus.

NOTE

End Client requires final on-site in-person interview.