Big Data Engineer

TMX Group; Toronto; Hybrid; CAD 130,000 - 140,000; Full time

Job summary

TMX Group is seeking a seasoned Big Data Engineer to design and build enterprise data systems for Canada’s premier financial market infrastructure. You will craft robust data pipelines, optimize performance, and manage AWS-based infrastructure across S3, EMR, and EC2. Proficiency in Python/Scala/Java and data modeling is essential.

This hybrid role is based in Toronto with 2-3 days in the office. You will collaborate with cross-functional teams, mentor junior staff, and contribute to scalable,

Qualifications

• 7+ years in IT with 4+ years in Big Data technologies (Spark, Hive, Presto).
• Strong AWS cloud proficiency (S3, EC2, EMR).
• Experience with Snowflake data platforms.
• Proficient in Python, Scala, Shell or Java.
• Solid data warehousing and modeling skills.
• Agile delivery experience and strong collaboration.

Responsibilities

• Design, construct, and manage large-scale data pipelines.
• Automate data delivery and optimize infrastructure for scale.
• Administer AWS services and data platforms (S3, EMR, VPC).
• Develop ETL for bulk and streaming data sources.
• Ensure code quality, Git workflows, and on-call support.
• Mentor junior staff and manage stakeholder expectations.

Skills

Spark

Hive

Presto

Python

Scala

Shell Scripting

Java

Data Warehousing

Data Modeling

Spark Tuning

Agile Delivery

AWS Cloud

Snowflake

GIT

Education

University degree in CS/Stats/Math

Equivalent experience

Tools

AWS (S3, EC2, EMR)

Terraform

Ansible

Kafka

Snowflake

Job description

Venture outside the ordinary - TMX Careers The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations enhancing capital markets. United as a global team, we’re connecting cross-functionally, traversing industries and geographies, moving opportunity into action, advancing global economic growth, and propelling progress. Through a rich exchange of ideas, meaningful collaboration, and a nimble operating model, we're powering some of the nation's most critical systems, fueling capital formation and innovation, bringing increased opportunity to business visionaries, product ingenuity to consumers, and career exploration to our team.

Ready to be part of the action?

Architect and build mission-critical, enterprise big data systems from scratch for Canada’s premier financial market infrastructure.

We are seeking a seasoned and motivated Big Data Engineer to join our growing Enterprise Data and Advanced Analytics Platform team. The ideal candidate is an expert data pipeline builder and data wrangler who thrives on optimizing data systems and architecting them from the ground up. You are a self-directed professional, comfortable supporting the diverse data needs of multiple teams, systems, and products across a full spectrum of cutting-edge technologies.

Job Location: Hybrid (2-3 days in office) - based in Toronto, ON.

Key Accountabilities

• Architect & Maintain Pipelines: Design, construct, and manage robust, large-scale, and efficient data pipeline architectures to meet complex functional and non-functional business requirements.
• Process Optimization: Drive continuous internal process improvements by automating manual tasks, optimizing data delivery, and re-designing infrastructure for enhanced scalability and performance.
• Cloud Infrastructure Management: Administer and manage a comprehensive suite of AWS services, including S3, RDS, EC2, EMR, VPC, Security Groups, CloudFormation, CloudWatch, Managed Airflow, and SNS.
• Data Ingestion & ETL: Develop optimal infrastructure for Extract, Transform, and Load (ETL) operations from disparate data sources using SQL and AWS ‘big data’ technologies, with a focus on both bulk and streaming data.
• Engineering Excellence: Adhere to development best practices, ensuring meticulous code management, branching, and merging within GIT repositories.
• Operational Support: Provide on-call and off-business hours support on a rotational basis to ensure system reliability.
• Collaboration & Mentorship: Act as an effective team player and mentor to junior staff through technical reviews and brainstorming sessions, while expertly managing stakeholder expectations and inquiries.

Must Have(s)

• Education: University degree, College diploma, or equivalent experience in Computer Science, Statistics, or Mathematics.
• Experience: 7+ years of overall IT experience, with 4+ years specifically focused on Big Data technologies (Spark, Hive, Presto, etc.).
• AWS Expertise: Strong technical proficiency in AWS cloud technologies, specifically S3, EC2, and EMR.
• Data Platforms: Proven experience working with Snowflake.
• Programming: Proficiency in Python, Scala, Shell Scripting, or Java.
• Data Modeling: Solid understanding of data warehousing and data modeling techniques.
• Performance Tuning: Hands-on experience in performance tuning for Spark jobs and Hive tables.
• Agile Delivery: Experience working within Agile development methodologies.
• Soft Skills: Meticulous attention to detail, excellent analytical problem-solving skills, and superior interpersonal communication abilities.

Nice to Have(s)

• Domain Knowledge: Good understanding of the Equity Markets business.
• DevOps Tools: Experience with Terraform or Ansible.
• Streaming: Experience with Kafka.
• Machine Learning: Experience designing technology stacks tailored for machine learning.
• Strategy: A strategic mindset with the ability to multitask in a fast‑paced environment.

Salary Range

Salary Range: 130,000/year - 140,000/year CAD. Please note that the salary range included is a guideline only. The salary offered may vary based on factors, including, but not limited to, the successful candidate’s relevant knowledge, skills, and experience.

The recruiting efforts for this role are intended to fill a vacant position.

Our Culture:

The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations enhancing capital markets. United as a global team, we’re connecting cross-functionally, traversing industries and geographies, moving opportunity into action, advancing global economic growth, and propelling progress. Through a rich exchange of ideas, meaningful collaboration, and a nimble operating model, we're powering some of the nation's most critical systems, fueling capital formation and innovation, bringing increased opportunity to business visionaries, product ingenuity to consumers, and career exploration to our team.

Ready to be part of the action?

Excitement - Explore emerging technology and innovation, as well as ventures and digital finance that shape the future of global markets! Experience the movement of the market while grounded in the stability of close to 200 years of success.

Connection - With site hubs in some of the world’s most multicultural cities, we leverage our size and structure to create rich connections and belonging while experiencing powerful global impact through our work.

Impact - More than a platform, we use our talents to power mission‑critical systems that drive global economic advancement, innovation, and growth. As well, our employee‑led Team Impact spreads social good via our giving strategy.

Wellness - From empathetic leadership to a culture of flexibility and balance, we believe wellness at work creates the maximum yield and a stronger "we". Plus, with a cloud-first and hybrid workstyle, as well as generous time-off and leaves, we support a life well lived!

Growth - From a growth mindset in our work, to expansion in our business, TMX is home to action‑takers energized by the achievement of ambitious growth.

Ready to enrich your career with impactful work, leaders who truly care, and the flexibility and programs to help you thrive as part of #TeamTMX ?

Please note that our company is not currently sponsoring work permit applications and the applicant must be authorized to work in the country where this position is located.

TMX is committed to creating and sustaining a collegial work environment in which all individuals are treated with dignity and respect and one which reflects the diversity of the community in which we operate. We provide accommodations for applicants and employees who require it.

Our Business:

TMX Group operates global markets, and builds digital communities and analytic solutions that facilitate the funding, growth and success of businesses, traders and investors. TMX Group's key operations include Toronto Stock Exchange, TSX Venture Exchange, TSX Alpha Exchange, The Canadian Depository for Securities, Montréal Exchange, Canadian Derivatives Clearing Corporation Trayport and VettaFi, which provide listing markets, trading markets, clearing facilities, depository services, technology solutions, data products and other services to the global financial community. TMX Group is headquartered in Toronto and operates offices across North America (Montréal, Calgary, Vancouver and New York), as well as in key international markets including London, Singapore and Vienna. For more information about TMX Group, visit www.tmx.com.

Follow TMX Group on Twitter: @TMXGroup.