Elastic Observability Architect

Veriipro; Chicago (IL); On-site; USD 100,000 - 140,000; Full time

Job summary

Veriipro is seeking a skilled Elasticsearch Architect in Chicago, IL to architect, design, and manage enterprise-grade Elastic Stack environments. You will implement observability solutions and optimize Elasticsearch clusters ensuring high performance, availability, and security.

The ideal candidate has strong expertise in the Elastic Stack, with significant experience in performance tuning and the use of integration tools like Kafka. Familiarity with cloud platforms and containerization technologies such as Docker and Kubernetes is preferred.

Qualifications

• Hands-on expertise in Elasticsearch and Elastic Stack.
• Experience with large-scale log, metrics, and search data environments.
• Strong experience in Kibana dashboarding.

Responsibilities

• Architect and manage Elastic Stack environments.
• Implement observability solutions across systems.
• Design Elasticsearch clusters for performance optimization.

Skills

Elasticsearch expertise

Performance tuning

Docker

Kubernetes

Python

Logstash

Kibana

Cloud platforms (AWS, Azure, Google Cloud)

Tools

Elastic Stack

Kafka

Terraform

Ansible

Job description

Primary Responsibilities

• Architect, design, and manage enterprise-grade Elastic Stack (Elasticsearch, Logstash, Kibana) environments
• Implement scalable observability solutions for logging, metrics, and monitoring across multiple systems
• Design and optimize Elasticsearch clusters for performance, scalability, high availability, and disaster recovery
• Build and maintain data ingestion pipelines using Logstash, Beats, Kafka, or similar tools
• Develop advanced Kibana dashboards, visualizations, alerts, and reports for operational and business stakeholders
• Tune indexing strategies, shard allocation, and query performance for large-scale datasets
• Implement Index Lifecycle Management (ILM), data streams, and storage optimization strategies
• Ensure security best practices including RBAC, TLS encryption, and secure access controls
• Troubleshoot and resolve complex production issues including cluster health, latency, and garbage collection tuning
• Collaborate with infrastructure, DevOps, and application teams to define observability requirements
• Provide technical leadership, mentoring, and guidance on Elastic Stack best practices
• Participate in system design reviews and architectural governance for observability solutions

Required Skills & Experience

• Strong hands‑on expertise in Elasticsearch and the Elastic Stack (expert level)
• Deep understanding of distributed systems, cluster architecture, indexing, sharding, and Query DSL
• Experience with large‑scale log, metrics, and search data environments
• Strong expertise in performance tuning, optimization, and troubleshooting of Elasticsearch clusters
• Experience with high availability (HA) and disaster recovery (DR) architectures
• Proficiency in Logstash, Beats, and integration tools such as Kafka or similar streaming platforms
• Strong experience in Kibana dashboarding and observability solutions
• Cloud experience with AWS, Azure, or Google Cloud Platform
• Experience with Docker and Kubernetes in production environments
• Familiarity with CI/CD pipelines and Infrastructure as Code tools such as Terraform or Ansible
• Strong understanding of security frameworks including RBAC and TLS encryption
• Proficiency in scripting/programming languages such as Python or Java

Preferred Skills

• Experience building enterprise observability or APM solutions
• Exposure to SRE (Site Reliability Engineering) practices
• Experience in multi‑tenant or multi‑region Elasticsearch deployments
• Knowledge of hybrid cloud observability architectures