Senior Real-Time AI Infrastructure Engineer

IBM Computing; Markham; On-site; CAD 110,000 - 150,000; Full time

Job summary

IBM Software in Markham, Canada, is seeking a Software Developer to own infrastructure for in-place, at-scale AI value on real-time data streams. You will design and operate backend systems that run AI agents directly on streaming data, avoiding external stacks.

You’ll tackle hard infrastructure challenges across networking, compute, and security, ensuring reliability across AWS, Azure, and GCP. This role offers high ownership and opportunities to advance in a fast-paced, collaborative

Qualifications

• 2–5 years of industry experience designing, building, and supporting backend systems in production.
• Strong fundamentals in distributed systems, cloud infrastructure, and networking.
• Experience in building and operating large-scale, high-availability systems.
• Good understanding of cloud platforms (AWS, Azure, or GCP) and their services.
• Proficiency in Java, Scala, C++, Go, or other statically typed languages.
• A self-starter with strong problem-solving skills and the ability to work in a fast-paced environment.
• BS, MS, or PhD in computer science or a related field, or equivalent work experience.

Responsibilities

• Design, develop, and operate large-scale, high-performance backend infrastructure for AI-powered cloud services.
• Improve reliability, scalability, and efficiency across cloud environments.
• Address distributed systems challenges such as consensus algorithms, failover strategies, and resource allocation.
• Collaborate with teams across IBM to optimize infrastructure for real-time data streaming.
• Troubleshoot and improve system reliability, observability, and performance across cloud providers (AWS, Azure, GCP).

Skills

Distributed systems

Cloud infrastructure

Backend software development

Java/Scala/C++/Go

Networking fundamentals

Problem-solving

Education

BS, MS, or PhD in computer science or related field

Tools

AWS

Azure

GCP

Linux

Job description

IBM Software in Markham, Canada, is seeking a Software Developer to own infrastructure for in-place, at-scale AI value on real-time data streams. You will design and operate backend systems that run AI agents directly on streaming data, avoiding external stacks.

You’ll tackle hard infrastructure challenges across networking, compute, and security, ensuring reliability across AWS, Azure, and GCP. This role offers high ownership and opportunities to advance in a fast-paced, collaborative