Staff Software Engineer - Distributed Storage and Analytics

International Business Machines Corporation; City of Poughkeepsie (NY, AR); On-site; USD 130,000 - 170,000; Full time

Job summary

IBM Software is seeking a Staff Software Engineer to advance storage and query systems for Kora's data layer, enabling streaming data as both table and stream with fast analytics. You will contribute to a scalable, multi-tenant compute platform essential for reliable background tasks and query serving across Confluent Cloud.

Join a team of engineers passionate about solving complex distributed storage and query challenges, collaborating across product, design, and other engineering groups to

Qualifications

• BS, MS, or PhD in computer science or a related field, or equivalent work experience.
• Excellent communication and collaboration skills to influence stakeholders at all levels.
• Experience with large-scale storage and query systems.

Responsibilities

• Design and implement storage schema, materialization, and maintenance for large-scale data.
• Develop and optimize the query engine for analytical workloads.
• Build and maintain multi-tenant, highly available infrastructure for storage and query tasks.
• Collaborate with product, design, and other engineering teams to integrate features with the broader organization.

Skills

Storage engine development

Query engine development

Platform engineering

Cross-functional collaboration

Communication

Education

Master's degree in computer science

BS/MS/PhD in computer science or related field

Tools

Apache Kafka

Apache Iceberg

Apache Flink

Apache Fluss

Presto/Trino

Spark SQL

DuckDB

ClickHouse

AWS

Azure

GCP

Job description

IBM Software is seeking a Staff Software Engineer to advance storage and query systems for Kora's data layer, enabling streaming data as both table and stream with fast analytics. You will contribute to a scalable, multi-tenant compute platform essential for reliable background tasks and query serving across Confluent Cloud.

Join a team of engineers passionate about solving complex distributed storage and query challenges, collaborating across product, design, and other engineering groups to