Senior Software Engineer, Real-Time Kafka Platform (Remote)

International Business Machines Corporation; Boston (MA); Remote; USD 207,000 - 315,000; Full time

Job summary

International Business Machines Corporation (IBM) is hiring a Senior Software Engineer for the Confluent team. You will advance the Realtime Context Engine, focusing on multi-tenant compute infrastructure, query execution, and background materialization, tackling scalability at massive scale across Confluent Cloud.

You will develop query engine strategies, build scalable, multi-tenant platform infrastructure, and collaborate across product, design, and engineering teams to integrate storage

Qualifications

• Expertise in C++ and/or Rust.
• 3-5 years of demonstrated professional work experience building database technologies.
• Experience in building and operating large-scale database systems.
• Excellent communication and collaboration skills, with the ability to influence and guide stakeholders at all levels.

Responsibilities

• Query Engine Development: Design and implement innovative strategies for query execution, planning, and caching at massive scale.
• Platform Engineering: Build and maintain multi-tenant, highly available infrastructure that powers computational tasks for Lightning tables and the realtime context engine.
• Cross-Functional Collaboration: Collaborate with product management, design, and other engineering teams to ensure seamless integration of storage features and infrastructure with the broader organization.

Skills

C++

Rust

Database tech

Education

Bachelor's Degree in CS or related field

Master's Degree in relevant field

Tools

Apache Iceberg

Velox

Substrait

AWS

Azure

GCP

Job description

International Business Machines Corporation (IBM) is hiring a Senior Software Engineer for the Confluent team. You will advance the Realtime Context Engine, focusing on multi-tenant compute infrastructure, query execution, and background materialization, tackling scalability at massive scale across Confluent Cloud.

You will develop query engine strategies, build scalable, multi-tenant platform infrastructure, and collaborate across product, design, and engineering teams to integrate storage