Senior Cloud Platform Engineer: Kafka & Automation

Pegasystems; Waltham (MA); On-site; USD 102,000 - 153,000; Full time

Benefits offered by this job

Employee equity

Annual bonus

Commission

Job summary

Pegasystems seeks a Kafka-focused Platform Engineer to shape Kafka delivery across Pega Cloud from US MA-remote. You’ll tackle distributed systems challenges, ensuring scalable, observable, secure platform capabilities for varying workloads.

You’ll drive automation, guardrails, diagnostics, and documentation, using AI-assisted engineering tools while applying sound judgment. This role emphasizes ownership and collaboration in Cloud Backing Services.

Qualifications

• Strong hands-on experience with Apache Kafka in large-scale environments.
• Solid understanding of Kafka architecture and behavior, including brokers/controllers, topics, partitions, replication, consumer groups, offsets, rebalancing, retention, and failure modes.
• Experience with at least one major public cloud platform, preferably AWS or Google Cloud.
• Experience with Infrastructure as Code and automated platform delivery, such as Terraform and CI/CD or GitOps workflows.
• Experience using Go, Python, Java, or another programming/scripting language to build automation, tooling, or platform capabilities.
• Good understanding of cloud networking, DNS, TLS, identity and access management, and observability concepts relevant to distributed services.
• Professional experience working with cross-functional engineering teams and communicating effectively in English.

Responsibilities

• Design and evolve Kafka-based cloud capabilities offered to engineering teams.
• Partner with application teams on architecture, sizing, rightsizing, capacity planning, partitioning, storage, retention, replication, and expected workload growth.
• Perform root‑cause analysis and turn difficult or recurring cases into improvements in automation, diagnostics, platform standards, and documentation.
• Use AI‑assisted engineering tools to accelerate log and configuration analysis, hypothesis exploration, code and automation development, documentation, and prototyping - and critically validate generated output.
• Identify opportunities to apply AI and automation to reduce repetitive work, shorten feedback loops, improve developer experience, and increase engineering leverage.
• Collaborate with cloud infrastructure, security, platform, and application engineering teams on cross‑cutting technical challenges and architectural decisions.
• Share knowledge, mentor other engineers, and help raise engineering standards across Cloud Backing Services.

Skills

Kafka expertise

Distributed systems

Automation

AI tooling

Go/Python/Java

Tools

Terraform

CI/CD

GitOps

AWS

Google Cloud

Job description

Pegasystems seeks a Kafka-focused Platform Engineer to shape Kafka delivery across Pega Cloud from US MA-remote. You’ll tackle distributed systems challenges, ensuring scalable, observable, secure platform capabilities for varying workloads.

You’ll drive automation, guardrails, diagnostics, and documentation, using AI-assisted engineering tools while applying sound judgment. This role emphasizes ownership and collaboration in Cloud Backing Services.