Kafka Infrastructure Engineer - Real-Time Pipelines (Hybrid)

Middle East Development Co. Ltd; Walnut Creek (CA); Hybrid; USD 109,970 - 176,300; Full time

Benefits offered by this job

Medical, Vision, Dental

401(k)

Tuition reimbursement

PTO 18 days

Paid holidays

Life insurance

Well-being programs

Job summary

The Cigna Group in Walnut Creek, CA is seeking an Infrastructure Engineering Advisor to design and develop Kafka-based data pipelines for real-time processing. This role emphasizes building scalable, secure messaging infrastructure and collaborating with application teams.

You will configure, deploy, monitor, and optimize Kafka clusters, while implementing automation to reduce manual work and ensure high availability in a hybrid work setting.

Qualifications

• Bachelor’s degree in CS/CE or related field with 3 years Kafka administration experience.
• Experience designing/building Kafka clusters with HA and DR.
• SSL/SASL/LDAP security and Kafka ACLs in Zookeeper.
• Kafka Connect and Schema Registry experience.
• Experience in On-Prem and AWS cloud environments.
• Automation using shell scripting, Ansible and Terraform.

Responsibilities

• Configure, deploy, and monitor Kafka clusters.
• Collaborate with application partners to define integration patterns.
• Optimize configurations for efficiency, reliability, and security.
• Use automation to reduce manual operations and workload.
• Diagnose and resolve errors quickly without impacting customers.
• Adhere to a hybrid work schedule.

Skills

Kafka administration

Security hardening

Automation scripting

Cloud integration

Cross-functional collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Kafka

Zookeeper

Kafka Connect

Schema Registry

SSL/TLS

SASL/LDAP

AWS

Azure

Ansible

Terraform

Shell scripting

Job description

The Cigna Group in Walnut Creek, CA is seeking an Infrastructure Engineering Advisor to design and develop Kafka-based data pipelines for real-time processing. This role emphasizes building scalable, secure messaging infrastructure and collaborating with application teams.

You will configure, deploy, monitor, and optimize Kafka clusters, while implementing automation to reduce manual work and ensure high availability in a hybrid work setting.