Senior Staff Software Engineer - Confluent Kafka Storage (Remote)

International Business Machines Corporation

Poughkeepsie (AR)

On-site

USD 140,000 - 190,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IBM Software is seeking a Senior Staff Software Engineer for the Kora Storage team. You will architect a highly available, multi-tenant storage engine, drive technical standards, and collaborate with product, design, and other engineering teams to deliver scalable data solutions.

You will mentor engineers, shape the core roadmap, and tackle deep systems challenges across state management, disk/network I/O, and fault tolerance in a fast-paced, cloud-native environment.

Qualifications

  • 10+ years of backend and/or infrastructure development experience.
  • BS, MS, or PhD in computer science or related field, or equivalent work experience.
  • Expertise in Java, Scala, C/C++, Go or other statically typed languages.
  • Proven experience designing and building large-scale distributed storage systems.
  • Deep knowledge of distributed systems concepts, including fault tolerance, consistency, and scalability.
  • Solid understanding at a systems level (disk, network, OS, etc).
  • Strong leadership skills with ability to mentor engineers.

Responsibilities

  • Storage Engine Development: design a highly available, scalable storage engine for Kora.
  • Engineering Leadership: set the standard for engineering excellence and drive end-to-end solutions.
  • Cross-Functional Collaboration: work with product, design, and other engineering teams to integrate features.
  • Mentoring: guide engineers and shape the long-term technical direction.

Skills

Backend development
Distributed systems
Leadership
Mentoring
Systems level
Java/Scala/C/C++/Go

Education

Master's Degree
BS/MS/PhD in CS

Tools

Kafka
Iceberg
Flink

Job description

Introduction

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.

Introduction

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.

Your Role And Responsibilities

Our team is composed of passionate distributed systems and infrastructure engineers dedicated to solving some of the hardest problems in cloud computing. We are building Kora from the ground-up to be a true managed service for clients who demand high levels of availability and performance at the lowest cost of ownership. Our mission is to deliver bulletproof data durability, high throughput, and ultra-low latency while maximizing multi-tenant efficiency and minimizing the total cost of ownership for enterprise data streams.

As a Senior Staff Software Engineer on the Kora Storage team, you will serve as a key technical authority and architectural anchor. In this role, you will tackle deep systems-level challenges across state management, hardware optimization, disk/network I/O, and fault tolerance. Beyond architecting and implementing critical storage components, you will set technical standards, partner with leaders across the broader organization to shape our core roadmap, and mentor senior and junior engineers to foster a culture of technical excellence.

What You Will Do
  • Storage Engine Development: Design and develop a highly available, performant, reliable, durable, scalable, and multi-tenant storage engine for Kora.
  • Engineering Leadership: Set the standard for engineering excellence. Be instrumental in driving the technical solutions end-to-end, working closely with the team and key stakeholders to design, architect, and develop top-notch solutions.
  • Cross-Functional Collaboration: Collaborate with product management, design, and other engineering teams to ensure seamless integration of storage features and infrastructure with the broader organization. Act as a trusted advisor for both internal and cross-functional teams, providing guidance on complex technical problems and contributing to high-level decision-making processes.
  • Mentoring: Mentor engineers across the team and help shape the long-term technical direction.
Preferred Education

Master's Degree

Required Technical And Professional Expertise
  • 10+ years of relevant backend and/or infrastructure development experience.
  • BS, MS, or PhD in computer science or a related field, or equivalent work experience
  • Expertise in Java, Scala, C/C++, Go or other statically typed languages
  • Proven experience designing and building large-scale, distributed storage systems.
  • Deep knowledge of distributed systems concepts, including fault tolerance, consistency, and scalability.
  • Solid understanding at a systems level (disk, network, operating systems, etc).
  • Strong leadership skills with a demonstrated ability to mentor and guide engineers to success.
Preferred Technical And Professional Experience
  • A strong background in distributed storage systems or databases
  • Expertise in building and operating modern cloud-based infrastructure and multi-tenant environments
  • Experience developing SaaS services on public cloud providers (AWS, Azure or GCP)
  • Familiarity with or has experience contributing to the following open-source technologies: Apache Kafka, Apache Iceberg, Apache Flink
  • Interest in evangelism (giving talks at tech conferences, writing blog posts evangelizing your work)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Software Engineer - Confluent Kafka Storage (Remote)
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)

International Business Machines Corporation • California

On-site
USD 210,000 - 260,000
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)

International Business Machines Corporation • Tucson (AZ)

On-site
USD 140,000 - 180,000
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)

International Business Machines Corporation • Lowell (MA)

On-site
USD 180,000 - 230,000
Confluent Staff Software Engineer - Kafka
Confluent Staff Software Engineer - Kafka

International Business Machines Corporation • San Diego (CA)

On-site
USD 180,000 - 260,000
Confluent Staff Software Engineer - Kafka
Confluent Staff Software Engineer - Kafka

International Business Machines Corporation • City of Poughkeepsie (NY)

On-site
USD 130,000 - 170,000
Senior Staff Storage Architect for High-Throughput Kafka
Senior Staff Storage Architect for High-Throughput Kafka

International Business Machines Corporation • California

On-site
USD 210,000 - 260,000
Senior Storage Engineer – Distributed Systems Lead
Senior Storage Engineer – Distributed Systems Lead

HITEC • City of Poughkeepsie (NY)

Remote
USD 180,000 - 260,000
Staff Software Engineer - Distributed Storage and Analytics
Staff Software Engineer - Distributed Storage and Analytics

International Business Machines Corporation • City of Poughkeepsie (NY)

On-site
USD 130,000 - 170,000
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)
Senior Staff Software Engineer - Confluent Kafka Storage (Remote)

HITEC • City of Poughkeepsie (NY)

Remote
USD 180,000 - 260,000
Confluent Staff Software Engineer - Kafka
Confluent Staff Software Engineer - Kafka

IBM • Durham (NC)

On-site
USD 150,000 - 210,000
Health & wellness
401(k) & stock plan
Paid time off
+1