LLM Production & Cost-Optimized Engineer

Systems Limited; Karachi Division; On-site; PKR 3,000,000 - 5,000,000; Full time

Job summary

Systems Limited is seeking an experienced MLOps engineer to own production serving and scaling for LLM/agentic workloads, including inference infrastructure, load balancing, and caching. You will drive cost awareness and implement observability for failure modes.

Collaborate with GenAI Engineers on rollout strategies, model versioning, canaries, and fallbacks. You will explain token-cost dynamics to clients and help set governance for LLM workloads.

Qualifications

• 4–6 years in platform/MLOps with hands-on LLM/GenAI production experience.
• Strong understanding of token costs, batching, caching, and model routing.
• Experience with LLM observability tooling (tracing, eval pipelines, version management).
• Familiar with Azure AI Foundry, AWS Bedrock, Google Vertex AI, and open-source options like vLLM/TGI.
• Experience creating canary/rollback strategies for probabilistic systems.
• Able to explain token-cost changes to client stakeholders.
• Collaborative with GenAI Engineers to balance build/run responsibilities.

Responsibilities

• Own production serving and scaling for LLM/agentic workloads (inference infra, load balancing, caching)
• Monitor and control inference cost — token usage, retry/loop cost, model routing decisions
• Build observability for LLM-specific failure modes: hallucination rate, latency spikes, prompt drift
• Manage model/version rollout strategy (canary releases, fallback models, A/B testing)
• Own incident response for LLM/agent production issues
• Partner with GenAI Engineers and Agentic AI Architects on production-readiness reviews
• Explain token-cost dynamics to client finance/business stakeholders
• Collaborate closely with GenAI Engineers without a hard line between build and run
• Support the practice in setting cost governance policy for LLM workloads

Skills

MLOps engineering

LLM economics

Observability tooling

Hosting platforms

Canary/rollback

Agentic workloads

Token-cost explainability

Build/run collaboration

Job description

Systems Limited is seeking an experienced MLOps engineer to own production serving and scaling for LLM/agentic workloads, including inference infrastructure, load balancing, and caching. You will drive cost awareness and implement observability for failure modes.

Collaborate with GenAI Engineers on rollout strategies, model versioning, canaries, and fallbacks. You will explain token-cost dynamics to clients and help set governance for LLM workloads.