DevOps Engineer

KnowledgeWorks Global Ltd.

Mumbai

On-site

INR 1,000,000 - 1,800,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

KnowledgeWorks Global Ltd. is seeking a senior DevOps/Infra engineer to design and implement a holistic observability stack for web applications and AI/ML services.

You will build tooling with Prometheus, Grafana, ELK/OpenSearch, Datadog, and contribute AI-specific signals like model latency and GPU utilization. You will design scalable infrastructure across on-prem and cloud, implement IaC (Terraform/Ansible), and lead CI/CD pipelines with Jenkins, GitHub Actions, and ArgoCD/Flux.

Qualifications

  • 3+ years of hands-on DevOps/SRE/Infrastructure engineering experience
  • Strong background in cloud platforms (AWS, Azure, and/or GCP) and on-premise/hybrid infrastructure
  • Expert-level skills with Infrastructure as Code (Terraform, Ansible, CloudFormation, or Pulumi)
  • Hands-on with Git-based workflows and repository management at scale (GitHub/GitLab/Bitbucket)
  • Containerize and orchestrate applications using Docker and Kubernetes
  • Design, build, and maintain CI/CD pipelines end to end including security checks

Responsibilities

  • Design and implement end-to-end observability & alert stack for web apps and AI/ML services
  • Develop tooling such as Prometheus, Grafana, ELK/OpenSearch, Datadog
  • Build AI-specific observability signals: model latency, GPU utilization, token usage, drift detection
  • Design and manage scalable infrastructure across on-prem and cloud
  • Own capacity planning, load testing, auto-scaling, and cost optimization
  • Implement IaC to ensure reproducibility and auditable environments
  • Lead disaster recovery, backup, and high-availability strategies
  • Establish CI/CD pipelines; integrate DevSecOps checks
  • Containerize and orchestrate with Docker and Kubernetes, including Helm
  • Deploy and monitor ML/LLM models in production
  • Optimize GPU utilization and multi-tenant workloads; manage CUDA/toolkit
  • Collaborate with data science teams on MLOps pipelines

Skills

DevOps/SRE/Infra
Git-based workflows
Cloud platforms (AWS/Azure/GCP)
Kubernetes
Docker
CI/CD pipelines
Terraform/Ansible
ArgoCD/Flux
Helm
Security in CI/CD
Python/Bash/Go scripting
Networking & Load balancing

Tools

Jenkins
GitHub Actions
ArgoCD
Flux
Helm
Terraform
Ansible

Job description

Observability Strategy (Web & AI Applications)

  • Design and implement an end-to-end observability & alert stack covering both traditional web applications and AI/ML services.
  • Develop and maintain tooling such as Prometheus, Grafana, ELK/OpenSearch, Datadog, or equivalent
  • Build AI-specific observability: model latency/throughput tracking, GPU utilization, token usage, drift detection, and inference quality signals.

Infrastructure Scaling & Reliability:

  • Design and manage infrastructure capable of scaling across on-premise data centers and public cloud
  • Own capacity planning, load testing, auto-scaling, and cost-optimization initiatives across compute, storage, and networking.
  • Implement Infrastructure as Code (Terraform, Ansible, or equivalent) to ensure environments are reproducible, version-controlled, and auditable.
  • Lead disaster recovery, backup, and high-availability strategy for critical systems.

DevOps & CI/CD Delivery :

  • Partner closely with Solution Architects to translate project and system designs into concrete DevOps execution plans.
  • Design, build, and maintain CI/CD pipelines (Jenkins, GitHub Actions or
  • ArgoCD/Flux for GitOps) across multiple projects and teams.
  • Containerize and orchestrate applications using Docker and Kubernetes, including Helm chart and manifest management.
  • Embed security and compliance checks (SAST/DAST, secrets scanning, image scanning) directly into the delivery pipeline (DevSecOps).
  • Provision, configure, and manage GPU infrastructure (on-prem clusters and cloud GPU instances) for model
  • Deploy, scale, and monitor ML/LLM models in production using tools such as Triton Inference Server, vLLM,
  • Optimize GPU utilization, cost, and throughput across multi-tenant workloads; manage CUDA/driver/toolkit
  • Collaborate with data science/ML engineering teams on MLOps pipelines — model versioning, experiment
  • 3+ years of hands-on DevOps/SRE/Infrastructure engineering experience, including at least 1+ years in a senior or lead capacity.
  • Deep expertise in Git-based workflows and repository management at scale (GitHub/GitLab/Bitbucket).
  • Strong background in cloud platforms (AWS, Azure, and/or GCP) and on-premise/hybrid infrastructure.
  • Expert-level skills with Infrastructure as Code (Terraform, Ansible, CloudFormation, or Pulumi).
  • Strong Kubernetes and Docker experience, including multi-cluster and multi-environment management.
  • Hands-on experience building and maintaining CI/CD pipelines end to end.
  • Working knowledge of GPU infrastructure (NVIDIA CUDA, drivers, NCCL) and experience deploying ML/AI models to production.
  • Proficiency in scripting/automation languages: Python, Bash, and/or Go.
  • Solid understanding of networking, load balancing, DNS, and security fundamentals in distributed systems.
  • Experience partnering with architects and engineering leads to translate designs into infrastructure and delivery plans.
  • Hands-on with SAST, DAST, and SCA tooling (e.g., SonarQube, Snyk, Checkmarx, OWASP DependencyCheck) integrated directly into CI/CD pipelines.
  • Container and image security: vulnerability scanning (Trivy, Grype, Clair), minimal/hardened base images, and signed/verified image provenance (Cosign/Sigstore).
  • Familiarity with Secrets management and credential hygiene using tools such as HashiCorp Vault, AWS Secrets Manager, or Azure Key Vault
  • Excellent communication skills and comfort operating cross-functionally with development, data science, and product teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

DevOps Engineer
DevOps Engineer

Auric AI Labs • Bengaluru

On-site
INR 1,200,000 - 2,400,000
MLOPs Engineer
MLOPs Engineer

National e-Governance Division (NeGD), Digital India Corporation • Delhi, New Delhi, Dadri

On-site
INR 1,800,000 - 3,400,000
DevOps Engineer
DevOps Engineer

NAVVYASA CONSULTING PRIVATE LIMITED • Gurugram District

On-site
INR 800,000 - 1,200,000
MLOps Engineer
MLOps Engineer

Bounteous • Gurugram District, Chennai, Bengaluru

Hybrid
INR 4,000,000 - 7,000,000
Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure)
Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure)

Annova Solutions Corp. • Indore District

On-site
INR 2,400,000 - 4,200,000
DevOps Engineer
DevOps Engineer

Conqr • India

Remote
INR 1,000,000 - 1,800,000
Devops Engineer
Devops Engineer

Larsen & Toubro Limited • Chennai District

On-site
INR 900,000 - 1,400,000
Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure)
Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure)

Annova Solutions • Indore District

On-site
INR 2,800,000 - 4,200,000
Senior GCP DevOps & LLMOps Engineer
Senior GCP DevOps & LLMOps Engineer

Tredence Inc. • Bengaluru

On-site
INR 4,200,000 - 6,600,000
Senior GCP DevOps Engineer
Senior GCP DevOps Engineer

Tredence Inc. • Pune District, Chennai, Bengaluru

Hybrid
INR 3,000,000 - 6,000,000