Senior Software Engineer – Cloudera Context Search

Jobtailor; California (MO); On-site; USD 150,000 - 190,000; Full time

Job summary

Jobtailor is seeking a Senior OpenSearch/Elasticsearch Engineer to design and operate large-scale search clusters across cloud providers. You will optimize performance, implement security, and contribute to Kubernetes operators and Helm charts for automated deployment and self-healing.

You will collaborate with cross-functional teams, work on advanced data-intensive features, and liaison with upstream communities to push improvements.

Qualifications

• Bachelor’s degree in Computer Science or equivalent.
• 5+ years of OpenSearch/Elasticsearch in production at scale.
• Strong understanding of distributed systems (CAP, replication, sharding).
• Proficiency in Java core OpenSearch development and/or Go/Python for automation.

Responsibilities

• Design and implement large-scale OpenSearch clusters with petabytes of data and low-latency performance.
• Integrate OpenSearch with CDP components (Iceberg, SDX, Ozone).
• Tune JVM, shards, and query DSL for throughput and stability.
• Implement enterprise-grade security including RBAC, TLS, and audit logging.
• Develop and maintain Kubernetes Operators and Helm charts for automated deployment, scaling, and self-healing.
• Collaborate with upstream OpenSearch community to contribute fixes and improvements.

Skills

Distributed systems concepts

Education

Bachelor’s degree in Computer Science or equivalent

Tools

OpenSearch

Elasticsearch

Java

Go

Python

Kubernetes

AWS

Azure

Google Cloud

Hadoop

Spark

Flink

Hive

Job description

Responsibilities

• Design and implement large-scale OpenSearch clusters capable of handling petabytes of data with low-latency indexing and query performance
• Deeply integrate OpenSearch with CDP components (e.g., Apache Iceberg, SDX, and Ozone)
• Optimize JVM settings, shard allocation strategies, and query DSL to ensure maximum throughput and stability
• Implement enterprise-grade security including RBAC, TLS, and audit logging
• Develop and maintain Kubernetes Operators and Helm charts for automated deployment, scaling, and self-healing of search services
• Act as a liaison to the upstream OpenSearch community, contributing bug fixes, features, and performance improvements

Requirements

• Bachelor’s degree in Computer Science or equivalent
• 5-6 years of related experience; OR Master’s degree and 3-5 years of related experience; OR PhD and 0-3 years of related experience
• 5+ years of experience working with OpenSearch or Elasticsearch in a production environment at scale
• Strong understanding of distributed system concepts (Consensus algorithms, CAP theorem, replication, and sharding)
• Proficiency in Java (core OpenSearch development) and/or Go/Python for automation and tooling
• Extensive experience with Kubernetes (K8s) and container orchestration
• Hands‑on experience deploying search workloads on AWS (EKS/AOSS), Azure (AKS), or Google Cloud (GKE)
• Familiarity with the Hadoop ecosystem or modern equivalents like Spark, Flink, and Hive is a major plus

Hard Skills

• OpenSearch
• Elasticsearch
• Java
• Go
• Python
• Kubernetes
• AWS
• Azure
• Google Cloud
• Distributed Systems