Senior AWS DevOps Engineer – MLOps Platform Lead

SoftServe; Town of Poland (NY); On-site; USD 120,000 - 190,000; Full time

Job summary

SoftServe is seeking an experienced MLOps Platform Engineer to operate and evolve a cloud-native, multi-tenant MLOps platform. You will work with engineering, data science, and infrastructure teams to ensure security, scalability, reliability, and cost efficiency.

You will manage Terraform-based infrastructure, implement GitOps workflows with ArgoCD and GitHub Actions, and optimize monitoring with Prometheus, Grafana, CloudWatch, and Datadog.

Qualifications

• Experience building and operating a Kubernetes-based MLOps platform.
• Proficient with Terraform, Terragrunt and Helm for IaC and deployment.
• Experience with GitOps and CI/CD tools (ArgoCD, GitHub Actions).
• Strong knowledge of AWS services (EKS, IAM, VPC, Route53, S3, ECR).
• Experience with monitoring and observability (Prometheus, Grafana, CloudWatch, Datadog).
• Proficient in Python and Bash scripting.

Responsibilities

• Operate, maintain, and improve a Kubernetes-based MLOps platform.
• Manage infrastructure using Terraform and GitOps practices.
• Support tenant onboarding, platform services, deployment pipelines, and ML workflows.
• Monitor platform health, respond to incidents, and improve operational processes.
• Optimize platform performance, reliability, security, and cloud costs.
• Collaborate with engineering, data science, and infrastructure teams to deliver a stable and scalable platform.

Skills

Kubernetes

AWS (EKS, IAM, VPC, Route53, S3, ECR)

Terraform

Terragrunt

Helm

GitOps

ArgoCD

GitHub Actions

Prometheus

Grafana

CloudWatch

Datadog

Python

Bash

Security best practices

Communication

Collaboration

NVIDIA GPU tech (nice to have)

Tools

AWS

Kubernetes

Terraform

Terragrunt

Helm

ArgoCD

GitHub Actions

Prometheus

Grafana

CloudWatch

Datadog

Python

Bash

GPU infrastructure

Job description

SoftServe is seeking an experienced MLOps Platform Engineer to operate and evolve a cloud-native, multi-tenant MLOps platform. You will work with engineering, data science, and infrastructure teams to ensure security, scalability, reliability, and cost efficiency.

You will manage Terraform-based infrastructure, implement GitOps workflows with ArgoCD and GitHub Actions, and optimize monitoring with Prometheus, Grafana, CloudWatch, and Datadog.