Data Engineer - Python & AWS
This is with a global IT services firm for a leading pension / investment management services firm.
Location: Downtown Toronto - work in office 4 days /week
Contract - 6 months, possible renewal
Project description
We are seeking a skilled and passionate Data Engineer with strong expertise in Python and AWS to join our technology team. The ideal candidate will have extensive hands-on experience in software development and architecture, with a keen ability to design and analyze complex systems. A background in capital markets and proficiency in Python are considered advantageous.
Responsibilities
Design, develop, and maintain robust and scalable applications using Python, Java and AWS services.
Collaborate with cross-functional teams to analyze requirements and architect effective solutions.
Write clean, efficient, and well-documented code with a focus on performance and maintainability.
Participate in code reviews and provide constructive feedback.
Stay updated with the latest trends and best practices in software development and cloud technologies.
Required daily participation in highly loaded data transformations.
Manage timelines/deliverables within the team towards the successful delivery of projects.
Design software solutions by interacting with portfolio managers, traders, operations staff and peers to understand requirements.
Develop solutions that are in line with client's technology biases, deliver efficiency and scalability, and enable new trading activities.
Provide knowledge transfer to team members and support staff through application demos, walkthroughs, and documentation.
Skills
Must have
5 -10 years experience in Python in an enterprise environment, and AWS technologies.
Proven expertise in software design, data engineering and data analysis.
Demonstrated ability to write high-quality, maintainable code.
Excellent problem-solving and communication skills.
Nice to have
Capital market experience
Databricks experience
BI Tools
Amazon S3, AWS Lake Formation, Glue Catalog, Amazon
EMR/EC2/Serverless, Spark, Athena
Amazon NeptuneDB
Amazon EventBridge, SNS, SQS, API Gateway, AWS Lambda
Terraform, AWS CloudFormation, IAM
Jupyter notebooks for data analysis and reporting.