Senior Flink Stream Processing Engineer, Cloud

IBM; San Diego (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

IBM Software’s Stream Processing & Analytics team is building an elastic, durable, cost-effective stream processing engine based on Apache Flink for Confluent Cloud. You will enable customers to run custom functions and apps, extend the runtime to meet diverse use-cases, and contribute to a best-in-class SDLC and cloud-scale operations.

Join a team delivering high-throughput, low-latency processing across 88+ regions on AWS, GCP, and Azure, with on-call rotations and a strong culture of

Qualifications

• BS, MS, or PhD in computer science or a related field, or equivalent work experience.
• 4+ years of relevant stream processing experience.
• Strong fundamentals in distributed systems design and development.
• Experience running production services in the cloud and being part of oncall rotation.

Responsibilities

• Work on Flink user-defined functions to provide a great experience for customers with sophisticated use-cases.
• Play a crucial role in designing, developing and operationalizing critical user-facing interfaces as well as the backing cloud infrastructure.
• Collaborate with the Apache Flink community to establish standards and improve open source foundations.
• Independently drive execution of software projects to deliver complex projects in production with a focus on quality.
• Evaluate and enhance the efficiency of our platform's technology stack, keeping pace with industry trends and adopting state-of-the-art solutions.
• As a vital member of our team, take responsibility for developing, managing, and maintaining a mission-critical service with a 99.99 SLA running on 88+ AWS, GCP, and Azure regions.
• Enhance the stability, performance, scalability, and operational excellence across multiple critical systems.

Skills

Java

Python

Go

Distributed systems

Cloud platforms

On-call

Teamwork

Education

Master's degree in CS

Bachelor's degree in CS

Tools

Apache Flink

AWS

GCP

Azure

Kubernetes

Confluent Cloud

Job description

IBM Software’s Stream Processing & Analytics team is building an elastic, durable, cost-effective stream processing engine based on Apache Flink for Confluent Cloud. You will enable customers to run custom functions and apps, extend the runtime to meet diverse use-cases, and contribute to a best-in-class SDLC and cloud-scale operations.

Join a team delivering high-throughput, low-latency processing across 88+ regions on AWS, GCP, and Azure, with on-call rotations and a strong culture of