Senior AI-Scale DevOps Engineer (Cloud & On-Prem)

Domyn; New York (NY); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Performance bonuses

Comprehensive benefits

Job summary

Domyn is seeking a Senior DevOps Engineer to lead deployment and scaling of AI solutions for financial workflows in the United States. You will drive secure, reliable infrastructure across cloud providers and on‑prem environments to support massive AI workloads.

You will collaborate with engineering, product, and customer teams to accelerate continuous delivery using Argo CD, GitHub Actions, and other modern tools while ensuring SLOs/SLIs, monitoring, and IAM security are in place.

Qualifications

• 6+ years of DevOps or SRE experience with distributed systems at scale.
• Expert-level Kubernetes and Docker knowledge with a major cloud (AWS, GCP or Azure) and hybrid/on-prem deployments.
• Advanced skills in Terraform or Ansible for reproducible infrastructure.
• Experience building CI/CD pipelines with Jenkins, Argo CD, or GitLab CI; strong Bash and Python.
• Experience with monitoring stacks (Datadog, ELK, Prometheus/Grafana) and distributed tracing.
• Solid understanding of network security, IAM, VPC peering, and encryption standards.

Responsibilities

• Infrastructure Leadership: Architect and maintain scalable, secure infra on cloud and on-prem.
• AI Operations: Build HPC clusters for model training and inference.
• Continuous Delivery: Design CI/CD pipelines (Argo CD, GitHub Actions) for AI models and apps.
• Reliability Engineering: Define SLOs/SLIs; implement monitoring and alerting.
• Security & Compliance: Enforce DevSecOps, IAM, network security, and compliance automation.
• Database Management: Oversee production databases (Postgres, Vector Stores, Graph DB).

Skills

Distributed systems

Kubernetes

Scripting (Bash, Python)

Cloud & on-prem

Security & IAM

Collaboration

Tools

Kubernetes (EKS, GKE, AKS)

Docker

Terraform

Ansible

Jenkins

Argo CD

GitHub Actions

Datadog

Prometheus/Grafana

Job description

Domyn is seeking a Senior DevOps Engineer to lead deployment and scaling of AI solutions for financial workflows in the United States. You will drive secure, reliable infrastructure across cloud providers and on‑prem environments to support massive AI workloads.

You will collaborate with engineering, product, and customer teams to accelerate continuous delivery using Argo CD, GitHub Actions, and other modern tools while ensuring SLOs/SLIs, monitoring, and IAM security are in place.