Senior Stream Processing Engineer - Flink & Cloud

IBM; Lowell (MA); On-site; USD 120,000 - 190,000; Full time

Job summary

IBM is seeking a skilled Stream Processing Engineer to join the SPA team. You will work on the Flink-based engine for Confluent Cloud, building user-defined functions and interfaces while collaborating with the community to shape open source foundations.

You will implement production-grade cloud-scale runtime, contribute to scalable, reliable services, and participate in on-call rotations across AWS, Azure, and GCP regions.

Qualifications

• BS/MS/PhD in computer science or related field or equivalent work experience.
• 4+ years of relevant stream processing experience.
• Strong fundamentals in distributed systems design and development.
• Experience running production services in the cloud and being part of on-call rotation.
• Proficiency in Java, and comfortable working with Go and Python.

Responsibilities

• Work on Flink user-defined functions to provide a great experience for customers with sophisticated use-cases.
• Design, develop and operationalize critical user-facing interfaces as well as the backing cloud infrastructure.
• Collaborate with the Apache Flink community to establish standards and improve open source foundations.
• Independently drive execution of software projects to deliver complex projects in production with a focus on quality.
• Evaluate and enhance the efficiency of our platform's technology stack, keeping pace with industry trends and adopting state-of-the-art solutions.
• Develop, manage, and maintain a mission-critical service with a 99.99 SLA across 88+ AWS, GCP, and Azure regions.
• Enhance stability, performance, scalability, and operational excellence across multiple systems.

Skills

Java

Python

Go

Distributed systems

Cloud platforms (AWS/Azure/GCP)

Kubernetes

Flink

On-call rotation

Education

Master's Degree

BS/MS/PhD in CS or related field

Tools

Kubernetes operators

Job description

IBM is seeking a skilled Stream Processing Engineer to join the SPA team. You will work on the Flink-based engine for Confluent Cloud, building user-defined functions and interfaces while collaborating with the community to shape open source foundations.

You will implement production-grade cloud-scale runtime, contribute to scalable, reliable services, and participate in on-call rotations across AWS, Azure, and GCP regions.