Senior AI Infrastructure Engineer

IBM; Markham; On-site; GBP 70,000 - 110,000; Full time

Job summary

IBM Software is seeking a Software Engineer on the AI team to own infrastructure enabling in-place, at-scale AI value. You’ll architect systems that run inference and AI agents on streaming data, avoiding data movement to external stacks.

You will tackle challenges in large-scale distributed systems, cloud infrastructure, and networking, delivering reliable, cost-efficient serving layers that power Confluent's real-time data platform across AWS/Azure/GCP.

Qualifications

• 2–5 years of industry experience designing, building, and supporting backend systems in production.
• Strong fundamentals in distributed systems, cloud infrastructure, and networking.
• Experience in building and operating large-scale, high-availability systems.
• Good understanding of cloud platforms (AWS, Azure, or GCP) and their services.
• Proficiency in Java, Scala, C++, Go, or other statically typed languages.
• A self-starter with strong problem-solving skills and the ability to work in a fast-paced environment.
• BS, MS, or PhD in computer science or a related field, or equivalent work experience.

Responsibilities

• Design, build, and operate large-scale, high-performance infrastructure that powers Confluent Cloud.
• Build foundational software to improve reliability, scalability, and efficiency across cloud environments.
• Work on distributed systems challenges such as consensus algorithms, failover strategies, and resource allocation.
• Collaborate with teams across Confluent to optimize and enhance infrastructure for real-time data streaming use cases.
• Troubleshoot and improve system reliability, observability, and performance across multiple cloud providers (AWS, Azure, GCP).

Skills

Distributed systems

Cloud infrastructure

Networking

High-availability

Java

Scala

C++

Go

Problem solving

Education

BS/MS/PhD in Computer Science

Job description

IBM Software is seeking a Software Engineer on the AI team to own infrastructure enabling in-place, at-scale AI value. You’ll architect systems that run inference and AI agents on streaming data, avoiding data movement to external stacks.

You will tackle challenges in large-scale distributed systems, cloud infrastructure, and networking, delivering reliable, cost-efficient serving layers that power Confluent's real-time data platform across AWS/Azure/GCP.