Confluent - Principal Software Developer

International Business Machines Corporation

San Jose (CA)

On-site

USD 180,000 - 240,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IBM is seeking a Principal Software Engineer for the Cloud Architecture and Reliability (CAR) team. You will be a technical authority ensuring a large-scale, multi-cloud data streaming platform stays up, recoverable, and well instrumented.

You will shape system architecture, collaborate across Confluent R&D, and deliver production tooling. Lead engineering efforts, advocate for reliability, and drive standards across teams while partnering with customers and leadership to translate regulatory

Qualifications

  • Experience designing, operating, and improving highly available distributed systems at cloud scale.
  • Ability to model interactions of many services and teams into scalable standards and guardrails.
  • Expertise in metrics, logs, traces, alerting, and SLOs across telemetry platforms.

Responsibilities

  • Resiliency: define architectural patterns for systemic resiliency in a multi-cloud platform.
  • Observability: shape architecture of scalable observability platform built on OpenTelemetry and Prometheus.
  • Agentic Operator Foundations: design tooling for AI-assisted triage and remediation.

Skills

Reliability engineering
Systems thinking
Observability
Technical leadership
Written communication
Software development

Tools

OpenTelemetry
Prometheus
Grafana
Apache Kafka

Job description

Introduction

At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM's product and technology landscape. Here, you'll have the tools and opportunities to advance your career while creating software that changes the world.

Your role and responsibilities

As a Principal Software Engineer for the Cloud Architecture and Reliability (CAR) team, you will be a technical authority on ensuring our large-scale, multi-cloud data streaming platform stays up, recovers fast, and has the right operator tools to keep data flowing. You will work across all Confluent R&D teams to shape the architecture of the systems and our own tooling. As a lead engineer within the CAR team you will work with and through other team members to deliver on our mission.

Primary Responsibilities:

  • Resiliency: Partner with peer teams and other leaders in CAR to define the architectural patterns and standards that create systemic resiliency for Confluent Cloud. Help teams reason about how services, dependencies, and failure domains compose end to end.

  • Observability: Shape the architecture of a large-scale internal observability platform (metrics, logs, and traces) built on open standards such as OpenTelemetry and Prometheus. Make deliberate tradeoffs on cost, cardinality, signal attribution, and platform self-protection (quotas, rate limits, regional isolation), and make sure the platform itself is exceptionally reliable.

  • Agentic Operator Foundations: Design and build agent-consumable operational data, tooling, and guardrails for AI-assisted triage and remediation.

Partner with Customers and Leadership: Serve as an engineering voice on reliability, resiliency, and observability requirements from regulated customers (for example financial services and public sector), and help translate regulatory and contractual expectations into engineering standards.

Required technical and professional expertise
  • Deep Expertise in Reliability Engineering: Proven track record of designing, operating, and improving highly available distributed systems at cloud scale, with a clear understanding of failure domains, recovery objectives (RTO/RPO), and graceful degradation.

  • Systems-Level Thinking: Established ability to model how many services and teams interact, find the structure underneath the complexity, and turn that into standards, guardrails, and architecture that scale beyond a single team.

  • Mastery of Observability Fundamentals: Expertise in metrics, logs, traces, alerting, and SLOs, including the economics and failure modes of telemetry platforms at high volume and cardinality.

  • Technical Leadership: Demonstrated ability to set direction, influence senior engineers and leaders across organizations, and drive adoption of standards you do not directly enforce.

  • Exceptional Written Communication: Ability to explain complex tradeoffs clearly, concisely, and with sound judgment.

  • Hands-On Software Development: Strong coding and design skills in one or more languages with a record of delivering production tools and software.

Preferred technical and professional experience
  • Resiliency and Recovery Design: Experience with business continuity and disaster recovery for large cloud services, including failover automation, multi-region and active-active architectures, and continuous recovery testing.

  • Open Source Observability Stack: Experience with Apache Druid, OpenTelemetry, Prometheus-compatible storage, Grafana, distributed tracing, etc.

  • Regulated Environments: Familiarity with operational resilience regimes and frameworks such as DORA, FedRAMP, and SOC 2, and with translating them into engineering practice.

  • Data Streaming and Distributed Systems: Experience with Apache Kafka, Apache Flink, or comparable platforms.

  • AI-Assisted Operations: Experience building or evaluating agentic tooling for operations (for example MCP-based tools, automated triage, and automated remediation), with a skeptic's eye for quality and safety.

  • Platform Economics: Experience reducing the cost of observability or infrastructure while improving capability.

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Confluent - Principal Software Developer
Confluent - Principal Software Developer

International Business Machines Corporation • Rochester (MN)

On-site
USD 180,000 - 260,000
Confluent Senior Software Engineer II, Secure Compute
Confluent Senior Software Engineer II, Secure Compute

International Business Machines Corporation • Bellevue (WA)

On-site
USD 140,000 - 190,000
Principal Software Engineer - Cloud Reliability
Principal Software Engineer - Cloud Reliability

International Business Machines Corporation • San Jose (CA)

On-site
USD 180,000 - 240,000
Confluent Senior Software Engineer II, Secure Compute
Confluent Senior Software Engineer II, Secure Compute

International Business Machines Corporation • San Jose (CA)

On-site
USD 140,000 - 210,000
Principal Cloud Reliability Architect
Principal Cloud Reliability Architect

International Business Machines Corporation • Rochester (MN)

On-site
USD 180,000 - 260,000
Confluent - Senior Software Engineer - Stream Processing & Analytics
Confluent - Senior Software Engineer - Stream Processing & Analytics

International Business Machines Corporation • Armonk (NY)

On-site
USD 140,000 - 210,000
Confluent - Principal Engineer
Confluent - Principal Engineer

International Business Machines Corporation • Armonk (NY)

On-site
USD 180,000 - 240,000
Confluent - Senior Software Engineer - Stream Processing & Analytics
Confluent - Senior Software Engineer - Stream Processing & Analytics

International Business Machines Corporation • United States

On-site
USD 140,000 - 190,000
Confluent - Senior Software Engineer - Stream Processing & Analytics
Confluent - Senior Software Engineer - Stream Processing & Analytics

International Business Machines Corporation • Lowell (MA)

On-site
USD 140,000 - 180,000
Confluent - Senior Principal Engineer
Confluent - Senior Principal Engineer

International Business Machines Corporation • Rochester (MN)

Remote
USD 180,000 - 240,000