Kafka Infrastructure Engineer - Real-Time Data Pipelines

Living Well Health Center; California (MO); Hybrid; USD 109,970 - 176,300; Full time

Benefits offered by this job

Annual bonus plan

Medical, vision, dental

401(k)

Tuition reimbursement

Paid time off

Job summary

eviCore Healthcare MSI, LLC in Walnut Creek, CA is seeking an Infrastructure Engineering Advisor to design and develop Kafka-based data pipelines and messaging solutions to support real-time and near real-time data processing layer in the organization.

Responsibilities include configuring, deploying, and monitoring Kafka clusters; collaborating with application partners; optimizing configurations for efficiency and security; and using automation with Ansible and Terraform to reduce manual work.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering or related field with 3 years of Kafka systems administration experience.
• Experience with Kafka cluster build, design, HA and DR.
• SSL encryption, SASL/LDAP auth, and Kafka ACLs in Zookeeper implementation.
• Create Kafka Connect cluster and connector deployment; manage schema registry and upgrades.

Responsibilities

• Configure, deploy, and monitor Kafka clusters.
• Collaborate with application partners to define solutions and integration patterns.
• Optimize configurations for efficiency, security, and reliability; implement security measures.
• Use automation (Ansible, Terraform) to reduce day-to-day operations and workload.
• Diagnose and resolve errors promptly without impacting customers.
• Maintain on-premises and cloud Kafka environments (AWS) and hybrid setups.

Skills

Kafka systems administration

Security configurations

Automation scripting

Networking

Load balancing

Education

Bachelor’s degree in Computer Science/Engineering or related field

Tools

Kafka

Zookeeper

Kafka Connect

Schema Registry

AWS

Azure

EC2/EBS

Ansible

Terraform

Okta

Job description

eviCore Healthcare MSI, LLC in Walnut Creek, CA is seeking an Infrastructure Engineering Advisor to design and develop Kafka-based data pipelines and messaging solutions to support real-time and near real-time data processing layer in the organization.

Responsibilities include configuring, deploying, and monitoring Kafka clusters; collaborating with application partners; optimizing configurations for efficiency and security; and using automation with Ansible and Terraform to reduce manual work.