Data Engineer - Python & AWS

CG Consulting Group; Toronto; Hybrid; CAD 85,000 - 110,000; Full time

Job summary

A leading consulting firm in Downtown Toronto is looking for a Data Engineer with strong skills in Python and AWS. You'll design scalable applications and collaborate with cross-functional teams. Ideal candidates have 5-10 years' experience in software design and data engineering. This is a 6-month contract with the possibility of renewal, requiring in-office work four days a week.

Qualifications

• 5 - 10 years experience in Python in an enterprise environment.
• Proven expertise in software design, data engineering and data analysis.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop, and maintain applications using Python, Java and AWS.
• Collaborate to analyze requirements and architect effective solutions.
• Write clean, efficient, and well-documented code.

Skills

Python

AWS

Software design

Data engineering

Data analysis

Tools

Databricks

AWS services

Terraform

Jupyter notebooks

Job description

Overview

Data Engineer - Python & AWS
Location: Downtown Toronto – work in office 4 days / week
Contract: 6 months, possible renewal
Project: Data Engineer with strong Python and AWS expertise to join a technology team for a leading pension / investment management services firm. A background in capital markets and proficiency in Python are advantageous.

Responsibilities

• Design, develop, and maintain robust and scalable applications using Python, Java and AWS services.
• Collaborate with cross-functional teams to analyze requirements and architect effective solutions.
• Write clean, efficient, and well-documented code with a focus on performance and maintainability.
• Participate in code reviews and provide constructive feedback.
• Stay updated with the latest trends and best practices in software development and cloud technologies.
• Required daily participation in highly loaded data transformations.
• Manage timelines/deliverables within the team towards the successful delivery of projects.
• Design software solutions by interacting with portfolio managers, traders, operations staff and peers to understand requirements.
• Develop solutions that align with client technology biases, deliver efficiency and scalability, and enable new trading activities.
• Provide knowledge transfer to team members and support staff through application demos, walkthroughs, and documentation.

Skills

Must have

• 5 - 10 years experience in Python in an enterprise environment, and AWS technologies.
• Proven expertise in software design, data engineering and data analysis.
• Demonstrated ability to write high-quality, maintainable code.
• Excellent problem-solving and communication skills.

Nice to have

• Capital market experience
• Databricks experience
• BI Tools
• AWS services: Amazon S3, AWS Lake Formation, Glue Catalog, Amazon EMR/EC2/Serverless, Spark, Athena
• Amazon NeptuneDB
• AWS EventBridge, SNS, SQS, API Gateway, AWS Lambda
• Terraform, AWS CloudFormation, IAM
• Jupyter notebooks for data analysis and reporting