AI DevOps Engineer

RIA Advisory LLC.; Pune District; Hybrid; INR 1,000,000 - 1,500,000; Full time

Job summary

RIA Advisory LLC. is looking for a skilled AI DevOps Engineer to design and manage scalable infrastructure for AI applications. The ideal candidate will possess deep expertise in Kubernetes and CI/CD tools, with a strong background in deploying LLM-based systems. The role can be performed remotely within India, with a requirement for 5 to 9 years of relevant experience. This is an excellent opportunity to work on innovative AI-driven projects utilizing modern cloud technologies.

Qualifications

• 5 – 9 years of experience in DevOps roles.
• Strong expertise in Kubernetes and cloud platforms.
• Proficiency in CI/CD practices.

Responsibilities

• Design, deploy, and manage scalable infrastructure for AI applications.
• Build and maintain Kubernetes clusters focusing on performance.
• Develop and manage Helm charts and optimize networking configurations.
• Implement CI/CD pipelines using Jenkins and ArgoCD.
• Optimize GPU resource allocation in containerized environments.

Skills

Kubernetes (EKS/OKE)

CI/CD tools (Jenkins, ArgoCD)

AWS

Terraform

LLM-based systems (vLLM, Ollama, Open WebUI)

Containerization and orchestration (Docker, Kubernetes)

Monitoring and logging tools (Prometheus, Grafana, Loki)

Security practices (Veracode, Trivy)

Education

Bachelor’s degree in computer science, IT, Data Science

Job description

• Role: AI DevOps Engineer
• Experience: 5 – 9 years
• Qualification: Bachelor’s degree in computer science, computer engineering, IT, Data Science
• Location: Pune or Remote India only

Role Overview

We are seeking a skilled and proactive AI DevOps Engineer to design, implement, and manage scalable infrastructure and deployment pipelines for AI-driven applications. The ideal candidate will have strong expertise in Kubernetes, cloud platforms, and CI/CD practices, along with hands‑on experience in managing LLM‑based workloads and GPU‑enabled environments.

Key Responsibilities

• Design, deploy, and manage highly available and scalable infrastructure for AI/ML applications.
• Build and maintain Kubernetes clusters (EKS/OKE) with a focus on performance, scalability, and reliability.
• Develop and manage Helm charts, ingress controllers, and optimize networking configurations.
• Implement and manage CI/CD pipelines using Jenkins, ArgoCD, and GitOps methodologies.
• Deploy and manage LLM serving frameworks such as vLLM, Ollama, and Open WebUI.
• Optimize GPU resource allocation and utilization in containerized environments.
• Automate infrastructure provisioning using Terraform and manage cloud-native services.
• Integrate security best practices into DevOps workflows, including automated vulnerability scanning and remediation.
• Monitor system performance and reliability using Prometheus, Grafana, Loki, and Alertmanager.
• Collaborate with development and AI teams to build developer-friendly automation tools and workflows.

Required Skills & Qualifications

• Deep expertise in Kubernetes (EKS/OKE) including cluster management, networking, and scaling.
• Strong experience with CI/CD tools such as Jenkins and ArgoCD.
• Proficiency in AWS (mandatory); experience with OCI is a plus.
• Hands‑on experience with Infrastructure as Code tools like Terraform.
• Experience in deploying and managing LLM-based systems (vLLM, Ollama, Open WebUI).
• Strong understanding of containerization and orchestration (Docker, Kubernetes).
• Experience with monitoring and logging tools like Prometheus, Grafana, Loki.
• Solid understanding of security practices including vulnerability management tools like Veracode and Trivy.