DevOps

Proto

Karachi Division

Remote

PKR 1,800,000 - 2,400,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote-first team
GPU infrastructure ownership

Job summary

Proto | DevOps Engineer is responsible for building and securing our cloud infrastructure and GPU environments for AI workloads. You will own IaC, CI/CD pipelines, and SRE practices from day one, supporting on‑premise and private cloud deployments while enabling high availability across environments.

The role emphasizes automating deployments, optimizing performance, and collaborating with security to uphold best practices in regulated environments.

Qualifications

  • 3+ years in DevOps, Cloud/SRE or similar roles.
  • Hands-on with Terraform and Kubernetes in production.
  • Experience with CI/CD pipelines and IaC.

Responsibilities

  • Design, build, and maintain scalable cloud infra using IaC.
  • Develop and optimize CI/CD pipelines for high availability.
  • Manage Kubernetes clusters across cloud and on‑prem environments.
  • Deploy GPU-backed AI workloads and GPU infra with CUDA drivers.
  • Support on‑premise and private cloud deployments for clients.
  • Implement monitoring and alerting with Prometheus, Grafana, and Datadog.
  • Lead SRE practices, incident response, and automated recovery.
  • Collaborate with security, dev, and QA teams to enforce DevSecOps.

Skills

Terraform
Kubernetes
Docker
Python
Bash
Linux administration
Cloud engineering (AWS)
SRE practices
DevSecOps
CI/CD automation

Education

Bachelor's degree or equivalent in CS/IT

Tools

Terraform
Kubernetes
Docker
Prometheus
Grafana
Datadog
ELK/Logging

Job description

The role

Proto is hiring a DevOps Engineer to manage, scale, and secure the cloud and infrastructure powering our AI agent platform – products that put AI agents in the hands of governments, regulators, and businesses across emerging markets.

You will own infrastructure as code, automated CI/CD pipelines, cloud infrastructure, and site reliability from day one. You will also play an important role in deploying and managing GPU infrastructure for AI workloads, supporting LLM and other AI model deployments, and helping enterprise clients implement Proto's platform within their own on-premise environments.

You will work in a lean, remote-first team where infrastructure improvements, AI deployments, and customer implementations happen in days, not quarters.

What you will do

You will build and maintain resilient cloud infrastructure, GPU environments, and automated release pipelines while supporting enterprise and on-premise deployments.

  • Design, build, and maintain scalable cloud infrastructure using Infrastructure as Code (IaC) tools like Terraform.
  • Develop, automate, and optimize robust CI/CD deployment pipelines for high availability and zero-downtime releases.
  • Manage Kubernetes clusters, container orchestration, and microservices deployment across cloud and on-premise environments.
  • Deploy, configure, and optimize GPU infrastructure for AI workloads, including GPU-enabled servers, NVIDIA GPUs, CUDA, and GPU drivers.
  • Support deployment and operation of AI models, LLM inference services, and GPU-accelerated applications.
  • Assist with infrastructure sizing, GPU resource allocation, and performance optimization for AI model serving and inference workloads.
  • Lead and support customer deployments in on-premise and private cloud environments, including restricted or air-gapped networks.
  • Package, configure, and deploy containerized applications using Docker and Docker Compose, including Kubernetes-based deployments.
  • Work with customer IT and infrastructure teams to troubleshoot deployment issues involving networking, firewalls, proxies, storage, and system dependencies.
  • Implement monitoring, logging, tracing, and alerting systems to ensure high service uptime and performance.
  • Drive Site Reliability Engineering (SRE) practices, incident management, and automated failover and recovery processes.
  • Collaborate with development, security, and QA teams to enforce DevSecOps best practices and infrastructure security standards.

Proto | DevOps Engineer

What you bring

You are an infrastructure expert who excels in cloud architecture, automation, system reliability, and deploying production workloads across different environments.

  • 3+ years' professional experience in DevOps, Cloud Engineering, Infrastructure Engineering, or Site Reliability Engineering (SRE).
  • Deep expertise with cloud providers (AWS), Kubernetes container orchestration, and Docker containers.
  • Proven track record implementing Infrastructure as Code (Terraform) and maintaining automated CI/CD pipelines.
  • Hands-on experience managing Linux servers and production infrastructure.
  • Experience deploying and maintaining applications across cloud, private cloud, or on-premise environments.
  • Strong troubleshooting skills across infrastructure, networking, storage, and application deployment environments.
Core Technical Skills
  • Strong scripting abilities in Python and Bash for infrastructure automation and tooling.
  • Expertise in Docker, Kubernetes, container orchestration, and deployment automation.
  • Strong understanding of AWS infrastructure, networking, IAM, security groups, VPCs, load balancing, and storage services.
  • Experience managing and tuning relational databases (PostgreSQL, MySQL) and cache layers (Redis).
  • Proficiency with monitoring, observability, and log aggregation tools (Prometheus, Grafana, Datadog, ELK).
  • Hands‑on experience with service mesh, ingress control, and networking fundamentals (DNS, VPN, load balancing, firewalls, and reverse proxies).
  • Familiarity with Linux administration, system performance tuning, and resource management.
Nice to have

None of these is essential, but each will help you hit the ground running.

  • Hands‑on experience deploying and managing GPU infrastructure, particularly NVIDIA GPUs (L4, T4, A10, A100, H100, H200, or similar).
  • Familiarity with NVIDIA CUDA, NVIDIA Container Toolkit, GPU drivers, and GPU monitoring tools such as DCGM.
  • Experience deploying AI/ML models and LLM inference frameworks such as vLLM, Ollama, Triton Inference Server, or Hugging Face TGI.
  • Experience with GPU resource scheduling, multi‑GPU deployments, and optimizing GPU utilization.
  • Previous experience supporting enterprise on‑premise deployments, private cloud environments, or air‑gapped infrastructure.
  • Familiarity with Linux GPU server configuration and troubleshooting, including CUDA compatibility and driver management.
  • Experience with VMware, Proxmox, or other virtualization platforms.
  • Understanding of security hardening, network isolation, and deployment requirements for regulated environments.
  • Background in natural language processing or computational linguistics.
  • Previous experience at a SaaS or AI company.
  • Previous experience deploying AI models.
  • Fluency in multiple languages.

Proto | DevOps Engineer

Why Proto

Proto is a Canadian-registered AI communication platform company deploying AI agents for governments, regulators, and private sector organisations across emerging markets. The work is real, the impact is public, and the team is small enough that you will shape what we build.

  • Real-world impact: Your code serves citizens, institutions, and businesses in markets where good technology changes daily life.
  • Ownership: A lean team means broad scope, fast decisions, and visible results.
  • Global reach: Work with clients and colleagues across multiple countries and regions.
  • Growth: Learn from the frontier of applied AI, with room to grow into technical leadership.
  • Remote-first: We have worked remotely since the start, with a tested process for team collaboration that maximises productivity.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Engineer
Product Engineer

Proto • Karachi Division

Remote
PKR 1,800,000 - 3,000,000
Remote DevOps Engineer - Cloud, Kubernetes & GPU AI
Remote DevOps Engineer - Cloud, Kubernetes & GPU AI

Proto • Karachi Division

Remote
PKR 1,800,000 - 2,400,000
Remote-first team
GPU infrastructure ownership
DevOps Engineer
DevOps Engineer

Pison3 • Lahore

On-site
PKR 2,790,000 - 4,687,000
DevOps Engineer
DevOps Engineer

Dlytics • Islamabad

Hybrid
PKR 1,800,000 - 3,000,000
Flexible working options (office / rem
Learning and development support
Competitive compensation
+1
Senior AI DevOps / Platform Engineer (AI Agents & MCP)
Senior AI DevOps / Platform Engineer (AI Agents & MCP)

Convo • Islamabad Capital Territory

On-site
PKR 3,500,000 - 6,000,000
Medical benefits
Free lunch
Annual increments
+3
Remote Product Engineer — End-to-End AI Platform
Remote Product Engineer — End-to-End AI Platform

Proto • Karachi Division

Remote
PKR 1,800,000 - 3,000,000
AI Platform Engineering Manager — Build & Scale Internal AI
AI Platform Engineering Manager — Build & Scale Internal AI

Creativechaos • Islamabad

Hybrid
PKR 9,773,806 - 16,755,096
Senior AI DevOps / Platform Engineer (AI Agents & MCP)
Senior AI DevOps / Platform Engineer (AI Agents & MCP)

Convo • Islamabad

On-site
PKR 4,200,000 - 9,000,000
Medical benefits for you and family
Free lunch
Annual performance increments
+1
Senior AI/Backend Engineer (Python, ML & DevOps)
Senior AI/Backend Engineer (Python, ML & DevOps)

Volante • Lahore

Remote
PKR 24,910,000 - 41,517,000
Remote work
Paid annual leave & holidays
Hardware/workspace setup allowance
+1
Forward Deployed Engineer
Forward Deployed Engineer

Mammoth-AI • Lahore

On-site
PKR 3,000,000 - 6,000,000
Top locations