Senior Software Engineer – Kafka & Real-Time Engine

International Business Machines Corporation; San Jose (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

IBM Software is seeking a Senior Software Engineer to advance the Realtime Context Engine and related database technologies. The role emphasizes scalable, multi-tenant infrastructure, high availability, and efficient query execution for Confluent Cloud services.

You will collaborate with product, design, and engineering teams to align storage features with overall platform goals, contributing to a robust, scalable cloud-native product stack.

Qualifications

• Expertise in C++ and/or Rust.
• 3-5 years of demonstrated professional work experience building database technologies.
• Experience in building and operating large-scale database systems.
• Distributed Systems domain experience.
• Excellent communication and collaboration skills, with the ability to influence and guide stakeholders at all levels.

Responsibilities

• Query Engine Development: Design and implement innovative strategies for query execution, planning, and caching at massive scale.
• Platform Engineering: Build and maintain multi-tenant, highly available infrastructure that powers computational tasks for Lightning tables and the realtime context engine.
• Cross-Functional Collaboration: Collaborate with product management, design, and other engineering teams to ensure seamless integration of storage features and infrastructure with the broader organization.

Skills

C++

Rust

Database systems

Distributed Systems

Communication skills

Education

Computer Science Degree with Specialization in Database Technologies

Tools

Apache Iceberg

Velox

Substrait

AWS

Azure

GCP

Job description

IBM Software is seeking a Senior Software Engineer to advance the Realtime Context Engine and related database technologies. The role emphasizes scalable, multi-tenant infrastructure, high availability, and efficient query execution for Confluent Cloud services.

You will collaborate with product, design, and engineering teams to align storage features with overall platform goals, contributing to a robust, scalable cloud-native product stack.