Kafka Infrastructure Engineer - Real-Time Pipelines

Cigna Healthcare; Walnut Creek (CA); Hybrid; USD 110,000 - 176,000; Full time

Benefits offered by this job

Annual bonus plan

Comprehensive benefits

Paid time off

Job summary

The Cigna Group is seeking an Infrastructure Engineering Advisor in Walnut Creek, CA, to design and develop Kafka-based data pipelines for real-time processing. You will configure, deploy, and monitor Kafka clusters and collaborate with partner teams to build scalable integration patterns.

The role requires a Bachelor’s degree and 3 years of Kafka experience, with Hybrid work. You will work with AWS/Azure, implement security, and automate operations using Terraform and Ansible.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering or related field with 3 years of Kafka systems administration experience.
• Experience building Kafka clusters with HA and DR.
• Experience with SSL, SASL/LDAP auth, and Kafka ACLs in Zookeeper.
• Creating Kafka Connect clusters and deployments.
• Knowledge of schemas and schema registry.
• Maintaining and upgrading Kafka clusters; performance tuning and monitoring.
• Experience with On-Prem and Cloud AWS deployments.
• Ability to provision resources in AWS or Azure and manage networking, load balancing, and security groups.
• Automation using shell scripting, Ansible and Terraform.

Responsibilities

• Configure, deploy, and monitor Kafka clusters.
• Collaborate with application partners to define integration patterns.
• Optimize configurations for efficiency and reliability with security measures.
• Use automation to reduce manual operations.
• Diagnose and resolve errors quickly without impacting customers.
• Operate in a hybrid work schedule.

Skills

Kafka administration

AWS

Terraform

Ansible

Shell scripting

Networking

Security (SSL/SASL/LDAP/Kafka ACLs)

Automation

Education

Bachelor’s degree in Computer Science/Engineering

Tools

Kafka

Zookeeper

Kafka Connect

Schema Registry

AWS

Azure

Okta

Terraform

Job description

The Cigna Group is seeking an Infrastructure Engineering Advisor in Walnut Creek, CA, to design and develop Kafka-based data pipelines for real-time processing. You will configure, deploy, and monitor Kafka clusters and collaborate with partner teams to build scalable integration patterns.

The role requires a Bachelor’s degree and 3 years of Kafka experience, with Hybrid work. You will work with AWS/Azure, implement security, and automate operations using Terraform and Ansible.