Confluent - Senior Software Engineer - Kafka

International Business Machines Corporation; City of Poughkeepsie (NY); Sur place; USD 130 000 - 180 000; Plein temps

Résumé du poste

International Business Machines Corporation (IBM) is seeking a Senior Software Engineer to advance the Realtime Context Engine and its multi-tenant, scalable compute infrastructure within IBM Software. You will tackle query execution strategies and platform engineering to deliver reliable, scalable cloud-native solutions.

The role emphasizes collaboration with product and design teams, strong communication, and a Master's degree in a database-related CS field.

Qualifications

• 3–5 years of professional experience building database technologies.
• Experience designing and operating large-scale database systems.
• Distributed systems experience with strong communication skills.

Responsabilités

• Design and implement query execution strategies for massive scale.
• Develop multi-tenant, highly available infrastructure for the context engine.
• Collaborate with product, design and other engineering teams to integrate storage features.

Connaissances

C++

Rust

Distributed systems

Database technologies

Communication skills

Formation

Master's Degree in Computer Science (Database specialisation)

Outils

Apache Iceberg

Velox

Substrait

Description du poste

Introduction

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.

Introduction

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.

Your Role And Responsibilities

As a Senior Software Engineer on the team, you will focus on advancing key layers of the Realtime Context Engine project, including its multi-tenant, highly available compute infrastructure, and the core components responsible for query execution and background materialization. You will tackle challenges such as developing strategies for efficient execution and at massive scale across all of Confluent Cloud, ensuring high availability and scalability.

What You Will Do

Query Engine Development

Design and implement innovative strategies for query execution, planning, and caching at massive scale.

Platform Engineering

Build and maintain multi-tenant, highly available infrastructure that powers computational tasks for Lightning tables and the realtime context engine. Ensure that the platform is optimized for scalability, reliability, and resilience, in alignment with organizational objectives.

Cross-Functional Collaboration

Collaborate with product management, design, and other engineering teams to ensure seamless integration of storage features and infrastructure with the broader organization.

Preferred Education

Master's Degree

Required Technical And Professional Expertise

• Expertise in C++ and/or Rust
• 3-5 years of demonstrated professional work experience building database technologies
• Experience in building and operating large-scale database systems
• Distributed Systems domain experience
• Excellent communication and collaboration skills, with the ability to influence and guide stakeholders at all levels.

Preferred Technical And Professional Experience

• Familiarity with or has experience contributing to the following open-source technologies: Apache Iceberg, Velox, Substrait
• Experience/knowledge with public clouds (AWS, Azure or GCP)
• Computer Science Degree with Specialization in Database Technologies