Senior AI Platform Engineer

Permhunt

United States

Remote

USD 170,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Permhunt is seeking a Senior AI Platform Engineer to operate, maintain, and improve production AI platforms on Kubernetes across on-premise, AWS, and GCP. The role blends AI platform engineering, MLOps, and production operations, mentoring team members and shaping the platform roadmap.

The candidate will deploy releases with GitOps, monitor health with observability tools, and drive reliability through automation while collaborating on incident response and improvements to engineering practices.

Qualifications

  • 3+ years of experience supporting production AI, ML, or data platforms using platforms like Kubeflow or SageMaker.
  • 5+ years across the AI/ML lifecycle including development, deployment, DevOps, or MLOps.
  • 5+ years of hands-on Python experience supporting AI/ML workflows or data pipelines.

Responsibilities

  • Deploy platform releases and configuration changes using GitOps and DevOps practices.
  • Monitor AI platform health through logs, metrics, monitoring, and observability tools.
  • Improve platform reliability through automation and tooling.
  • Participate in incident response, root cause analysis, and 24/7 rotations.
  • Investigate and resolve user, platform, integration, and configuration issues.
  • Promote standards across security, reliability, and operations.
  • Mentor junior engineers in Python and MLOps practices.
  • Drive adoption of MLOps across the team.
  • Identify tooling gaps to support production-grade AI systems.
  • Contribute to the technical direction and ongoing AI platform development.

Skills

Python
MLOps
Kubernetes
GitOps
Observability

Tools

Kubeflow
AWS SageMaker
Ray
Jupyter

Job description

Our client is a technology consulting company providing operational and engineering services to the high-tech sector. They support platform and infrastructure teams across cloud and distributed environments, helping operate scalable, reliable, and production-ready technology platforms.

The Role

Our client is looking for a Senior AI Platform Engineer to operate, maintain, and continuously improve production AI platforms running on Kubernetes across on-premise, AWS, and GCP environments. The role combines AI platform engineering, MLOps, Kubernetes, Python, observability, and production operations, working with environments similar to AI on EKS and Kubeflow-based machine learning platforms. You will also play a senior role in improving engineering practices, mentoring team members, and helping shape the platform roadmap.

Key Responsibilities
  • Deploy platform releases and configuration changes using GitOps and DevOps practices.
  • Monitor AI platform and service health through logs, metrics, monitoring, and observability tools.
  • Improve platform reliability through automation, operational tooling, observability, and self-service capabilities.
  • Participate in incident response, root cause analysis, and 24/7 operational rotations.
  • Investigate and resolve user, platform, integration, and configuration-related issues.
  • Promote strong standards across platform security, reliability, and operational engineering.
  • Mentor junior engineers in Python fundamentals and help develop their MLOps capabilities.
  • Drive the adoption of MLOps best practices across the engineering team.
  • Identify gaps in tooling, technical capabilities, and processes required to support production-grade AI systems.
  • Contribute to the technical direction and ongoing development of the AI platform.
Qualifications
  • 3+ years of experience supporting production AI, ML, or data platforms using technologies such as Ray, Jupyter, AWS SageMaker, Kubeflow, or similar platforms.
  • 5+ years of experience across the AI/ML lifecycle, including development, deployment, DevOps, or MLOps.
  • 5+ years of hands-on Python experience supporting AI/ML workflows, applications, or data engineering pipelines.
  • Strong practical experience with Kubernetes, including managed platforms such as AWS EKS or Google GKE.
  • Good understanding of microservices architectures and service communication patterns.
  • Strong troubleshooting skills across application crashes, resource contention, service latency, performance, and scaling issues.
  • Experience analysing logs, metrics, monitoring systems, and service-level KPIs within production environments.
Nice to Have
  • Exposure to additional AI and data platforms such as Flyte, Hugging Face, Vertex AI, LangChain, Claude Code, or other AI agent platforms.
  • Hands-on automation or scripting experience using Bash or Python.
  • Relevant Kubernetes or cloud certifications (such as CKAD or AWS certifications).
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
AI/ML Platform Engineer
AI/ML Platform Engineer

First Soft Solutions LLC • Baltimore (MD)

On-site
USD 150,000 - 230,000
Senior Kubernetes Platform Engineer - 620
Senior Kubernetes Platform Engineer - 620

DSM-H Consulting • Peoria (IL)

On-site
USD 120,000 - 170,000
AI Platform Engineer
AI Platform Engineer

BrothersTech • United States

On-site
USD 140,000 - 200,000
Senior AI Platform Engineer
Senior AI Platform Engineer

Code Metal, Inc. • Washington

Hybrid
USD 150,000 - 230,000
Health Insurance
Dental Insurance
Vision Insurance
+6
MLOps / AI Platform Engineer
MLOps / AI Platform Engineer

Neural Xpert • United States

Remote
USD 120,000 - 160,000
Lead Software Engineer - Python - GenAI
Lead Software Engineer - Python - GenAI

JPMorganChase • Plano (TX)

Hybrid
USD 150,000 - 190,000
Senior Platform Engineer
Senior Platform Engineer

EPAM Systems Inc • United States

Remote
USD 120,000 - 190,000
Senior Platform Engineer: AI-Driven Infra & Security
Senior Platform Engineer: AI-Driven Infra & Security

7AI • Boston (MA)

On-site
USD 120,000 - 160,000
Platform Cloud Engineer - REMOTE - 75/HR
Platform Cloud Engineer - REMOTE - 75/HR

ContractStaffingRecruiters.com • Norwalk (CT)

Remote
USD 130,000 - 190,000