Staff Engineer: Real-Time AI & Stream Processing

IBM; Armonk (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

IBM Software is seeking an experienced senior backend engineer to own delivery of large-scale AI platform capabilities. You will design and ship backend services, collaborating across teams to drive architectural decisions spanning data, model lifecycle, and inference.

You will work with Go, Java, and Python, apply Kubernetes patterns, and mentor peers while ensuring reliability and operability of live inference at scale.

Qualifications

• 10+ years of significant experience designing, building, and operating distributed systems or cloud-native backend infrastructure in production.
• Strong working knowledge of Kubernetes and distributed-systems patterns (control loops, API servers, high-scale control planes).
• Proficiency in Go, Java, or Python, and willingness to work across all three.

Responsibilities

• Design and build backend services that run AI and model inference on real-time data.
• Own features end-to-end, aligning stakeholders and driving decisions to a conclusion.
• Make cross-team technical decisions affecting model lifecycle, inference routing, and agent execution.
• Ensure code quality, test coverage, documentation, and operability for live inference at scale.
• Mentor peers, perform design reviews, and contribute to healthy team processes.

Skills

Distributed systems design

Backend engineering

Go

Java

Python

Kubernetes

Cross-team collaboration

Education

Master's Degree

Tools

Go

Java

Python

Job description

IBM Software is seeking an experienced senior backend engineer to own delivery of large-scale AI platform capabilities. You will design and ship backend services, collaborating across teams to drive architectural decisions spanning data, model lifecycle, and inference.

You will work with Go, Java, and Python, apply Kubernetes patterns, and mentor peers while ensuring reliability and operability of live inference at scale.