Site Reliability Engineer - AI Observability for LLM Apps

Appnovation Technologies; New York, Austin, Dallas, Miami (NY, TX, TX, FL); On-site; USD 130,000 - 180,000; Part time

Benefits offered by this job

Contractor role

Job summary

Appnovation Technologies is seeking a Site Reliability Engineer to build and run a shared observability platform for AI/LLM applications for a global life sciences client. The role focuses on reliability, monitoring, and incident readiness across the stack.

You will implement platform monitoring, service levels, and infrastructure as code using Kubernetes, AWS EKS, ClickHouse, PostgreSQL, Redis, Helm and Argo CD, while owning runbooks and onboarding for internal teams that depend on the platform.

Qualifications

• Hands-on Kubernetes on AWS (EKS) experience.
• Production ClickHouse with replication and Keeper quorum.
• Experience building monitoring and alerting from scratch.
• Safe upgrade practices with rollback plans.
• PostgreSQL and Redis operation knowledge.
• Strong runbooks and SOP writing ability.

Responsibilities

• Diagnose and resolve failures across the stack including ClickHouse, PostgreSQL, Redis and Kubernetes.
• Own ClickHouse topology, replication, and backups with an operator approach.
• Plan upgrades in lower environments with rollback strategies.
• Build end-to-end monitoring, with SLAs and alerting from scratch.
• Maintain IaC via Kubernetes manifests, Helm values and Argo CD.
• Create and maintain runbooks for on-call incidents.
• Own onboarding and support paths for internal teams.
• Automate recurring operational tasks and migrations.

Skills

Observability engineering

Incident response

Runbooks creation

SRE practices

OpenTelemetry

Automation

Client collaboration

Documentation writing

Tools

Kubernetes (AWS EKS)

Helm

Argo CD

ClickHouse

PostgreSQL

Redis

Langfuse / LangSmith

S3 storage

Job description

Appnovation Technologies is seeking a Site Reliability Engineer to build and run a shared observability platform for AI/LLM applications for a global life sciences client. The role focuses on reliability, monitoring, and incident readiness across the stack.

You will implement platform monitoring, service levels, and infrastructure as code using Kubernetes, AWS EKS, ClickHouse, PostgreSQL, Redis, Helm and Argo CD, while owning runbooks and onboarding for internal teams that depend on the platform.