Confluent Kafka Platform Architect (Retail & Cloud)

BayOne Solutions; United States; In loco; USD 190.000 - 230.000; Tempo pieno

Descrizione del lavoro

BayOne Solutions seeks an Architect-level Kafka expert to own end-to-end Confluent Kafka platforms for a major retail client. You will optimize throughput, latency, and reliability while defining enterprise standards and leading migration from on- prem to cloud.

You will mentor a distributed team and collaborate with application teams on event-driven patterns, implementing robust DR and cross-cluster replication. Strong SDLC, security and monitoring skills are essential.

Competenze

• Architect-level, hands-on experience with Confluent Kafka (Confluent Platform and/or Confluent Cloud). Apache Kafka alone is not enough.
• Has designed, built or remediated Kafka at enterprise scale, ideally rescuing an underperforming setup.
• Retail enterprise experience is effectively mandatory. They should know how Kafka is typically set up in a large retailer.
• Experience with both on-prem and cloud Kafka deployments.
• Proven Kafka performance tuning and optimization in production.
• Strong SDLC background.

Mansioni

• Own the architecture of the Kafka platform end to end for the client.
• Assess current setup and fix configuration, performance and reliability gaps.
• Tune brokers, topics, partitions, producers and consumers for throughput and latency.
• Define enterprise standards for topic design, schema management, security, monitoring and DR.
• Design and lead migration of Kafka components from on-prem to cloud.
• Guide and upskill the Kafka team (1 onshore, 2 offshore) and review their work.
• Collaborate with application and platform teams on event-driven integration patterns for retail workloads.
• Follow SDLC practices: documentation, change management, testing and production support.
• Design, implement, and manage highly available Kafka/Confluent platforms on Azure, including security and upgrades.
• Develop and maintain Kafka connectors, streams, producers/consumers using Java, Python, or similar.
• Implement cross-cluster replication and DR solutions with failover/failback strategies.

Conoscenze

Confluent Kafka

Enterprise-scale Kafka

Retail experience

On-prem & cloud Kafka

Kafka performance tuning

SDLC

Strumenti

Terraform

Ansible

Kubernetes

Docker

Azure DevOps

Prometheus

Grafana

Descrizione del lavoro

BayOne Solutions seeks an Architect-level Kafka expert to own end-to-end Confluent Kafka platforms for a major retail client. You will optimize throughput, latency, and reliability while defining enterprise standards and leading migration from on- prem to cloud.

You will mentor a distributed team and collaborate with application teams on event-driven patterns, implementing robust DR and cross-cluster replication. Strong SDLC, security and monitoring skills are essential.