Kubernetes & AI Infra Engineer — On-Prem & Cloud

Discernis; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

Discernis in New York is seeking an seasoned Infrastructure Engineer to own the platform infrastructure across cloud, customer managed cloud accounts and on-premises hardware, including air-gapped environments.

Responsibilities include packaging the platform as a reproducible Kubernetes-based bundle, operating GPU-enabled clusters, managing IaC and release processes, and building robust monitoring and security practices across diverse environments.

Qualifications

• Experience with infrastructure as code tools such as Helm, Terraform, or Pulumi.
• Hands on experience designing CI and CD workflows.
• Comfort with observability stacks and production monitoring.
• Strong networking and Linux fundamentals.
• Bonus: GPU and AI workloads in Kubernetes, NVIDIA drivers and CUDA on bare metal, or shipping software into air gapped or customer controlled environments.
• Bonus: Elasticsearch or similar distributed data systems.

Responsibilities

• Package and ship our platform as a reproducible Kubernetes based bundle that installs cleanly on customer controlled and on premises hardware
• Operate and improve Kubernetes clusters running both application services and GPU accelerated AI workloads
• Own our infrastructure as code and release process so environments are reproducible across cloud and on prem
• Build production grade monitoring, logging, and alerting that works even in restricted customer environments
• Support large scale search and data infrastructure running on Kubernetes
• Drive best practices in networking, secrets management, certificate handling, and security hardening

Skills

Helm

Terraform

Pulumi

CI/CD

Observability

Networking

Linux

GPU workloads

Elasticsearch

Tools

Kubernetes

Docker

NVIDIA drivers

Elasticsearch

K3s

Job description

Discernis in New York is seeking an seasoned Infrastructure Engineer to own the platform infrastructure across cloud, customer managed cloud accounts and on-premises hardware, including air-gapped environments.

Responsibilities include packaging the platform as a reproducible Kubernetes-based bundle, operating GPU-enabled clusters, managing IaC and release processes, and building robust monitoring and security practices across diverse environments.