Senior Stream Processing Engineer (Flink & Cloud)

IBM; Armonk (NY); On-site; USD 140,000 - 170,000; Full time

Job summary

IBM Software’s SPA group is building an elastic, durable stream processing engine based on Apache Flink for Confluent Cloud. You will empower customers to create custom functions and apps in Confluent Cloud, extending the runtime to meet diverse use cases and integrating with cloud infrastructure across multiple regions.

You will champion a best-in-class SDLC, working with Java and Python to deliver high-performance, production-grade services while collaborating with the Flink community and

Qualifications

• 4+ years of relevant stream processing experience.
• Master's Degree or higher in a related field is preferred.
• Strong fundamentals in distributed systems design and development.
• Experience running production services in the cloud and being part of on-call rotation.
• Proficiency in Java; comfortable with Go and Python.

Responsibilities

• Work on Flink user-defined functions to provide a great experience for customers with sophisticated use-cases.
• Design, develop, and operationalize critical user-facing interfaces and the backing cloud infrastructure.
• Collaborate with the Apache Flink community to establish standards and improve open source foundations.
• Independently drive execution of software projects to deliver complex features in production with a focus on quality.
• Evaluate and enhance the platform's technology stack, embracing state-of-the-art solutions.
• Maintain a mission-critical service with a 99.99 SLA across 88+ AWS, GCP, and Azure regions.
• Enhance stability, performance, and scalability across multiple systems.

Skills

Java

Go

Python

Distributed systems

Cloud production services

On-call rotation

Education

Master's Degree

Tools

Apache Flink

Kubernetes

AWS

GCP

Azure

Confluent Cloud

Job description

IBM Software’s SPA group is building an elastic, durable stream processing engine based on Apache Flink for Confluent Cloud. You will empower customers to create custom functions and apps in Confluent Cloud, extending the runtime to meet diverse use cases and integrating with cloud infrastructure across multiple regions.

You will champion a best-in-class SDLC, working with Java and Python to deliver high-performance, production-grade services while collaborating with the Flink community and