AI Systems Engineer — On-Prem LLMs & Agent Tools

Sierra Ventures; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Sierra Ventures is seeking an experienced ML/AI Engineer to build agent systems and open-weight models for on-premise deployments. You will design tools, orchestrate models, and own context engineering from prompts to retrieval.

You will fine-tune open-weight models, deploy with Docker, and evaluate reliability across evolving agent and model versions, delivering robust, production-ready solutions.

Qualifications

• 2–5 years of production ML or LLM system experience.
• Strong Python, with solid engineering practices (testing, Git, APIs).
• Hands-on agent development: tool calls, structured outputs, prompts, context.
• Hands-on fine-tuning of open-weight models (PyTorch, HF libs).
• Experience deploying models with Docker and GPU inference.
• Experience designing objective evaluations for models/agents.

Responsibilities

• Design and build agent tools and skills for planning scans and generating robot programs.
• Orchestrate multi-model routing to balance accuracy, latency, and cost.
• Own context engineering: prompts, tool schemas, and retrieval over knowledge.
• Develop deterministic evaluation harnesses and benchmarks.
• Versioning experiments and release workflows; build logs for debugging.

Skills

Python

ML system design

Fine-tuning models

Docker

Agent development

Education

CS degree (optional)

Tools

PyTorch

Hugging Face

vLLM

Job description

Sierra Ventures is seeking an experienced ML/AI Engineer to build agent systems and open-weight models for on-premise deployments. You will design tools, orchestrate models, and own context engineering from prompts to retrieval.

You will fine-tune open-weight models, deploy with Docker, and evaluate reliability across evolving agent and model versions, delivering robust, production-ready solutions.