Stream Governance Architect for Real-Time Data

IBM Computing; Boston (MA); On-site; USD 180,000 - 240,000; Full time

Job summary

IBM Software is seeking a Principal Engineer to shape the long-term architecture and reliability of Confluent's schema and metadata governance systems within the Confluent Streaming Platform. You will lead company-level initiatives, drive architectural decisions, and influence engineering practices across multiple teams.

You will own governance domains, design scalable multi-tenant infrastructure, and partner with executives to align technical direction with business outcomes.

Qualifications

• Deep experience leading architecture and delivery of large-scale distributed systems with company-level impact.
• Comprehensive knowledge of fault tolerance, consistency, scalability, and cloud-native platforms.
• Working depth with streaming or event-driven architectures and metadata/governance systems.

Responsibilities

• Define and drive company-level technical strategy for governance systems with a focus on schema and metadata infrastructure.
• Architect and evolve metadata management systems for low-latency lookups and strong consistency across engines.
• Design data protection capabilities including encryption and access control enforced platform-wide.
• Build and maintain highly available, multi-tenant infrastructure for governance services at scale.
• Establish engineering standards and architectural patterns adopted across the organization.
• Collaborate with executives, product management, and engineering leaders to align technical vision with business goals.
• Mentor senior and staff engineers to grow technical leadership and foster open-source contributions.

Skills

Technical Strategy

Metadata Architecture

Data Governance

Distributed Systems

Leadership

Cloud Native

Open Source

Job description

IBM Software is seeking a Principal Engineer to shape the long-term architecture and reliability of Confluent's schema and metadata governance systems within the Confluent Streaming Platform. You will lead company-level initiatives, drive architectural decisions, and influence engineering practices across multiple teams.

You will own governance domains, design scalable multi-tenant infrastructure, and partner with executives to align technical direction with business outcomes.