Senior ML Systems Engineer - Inference Platforms

Defence Science and Technology Agency; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Defence Science and Technology Agency seeks a highly technical ML Systems Engineer to architect and build scalable AI inference capabilities across heterogeneous environments. You will work at the intersection of machine learning, systems engineering, and software engineering to create platforms and tooling that standardise and simplify AI model serving in production.

You will design abstractions for model inference, integrate across formats and environments, and optimize latency, throughput,

Qualifications

• Degree required in Computer Science, Computer Engineering, or related field.
• 2–3 years of relevant experience in ML systems, inference engineering, platform engineering, or performance‑critical software systems.
• Hands‑on experience with at least one inference stack (Traditional AI, NVIDIA Triton, Generative AI, vLLM, Dynamo/LLM-D).
• Strong ability to profile, diagnose, and optimise performance bottlenecks.
• Proficiency in at least one programming language (e.g. Python, C++, Go, Rust).
• Good understanding of Linux systems, distributed systems concepts, and system‑level debugging.
• Familiarity with containers and orchestration platforms such as Docker and Kubernetes/OpenShift.

Responsibilities

• Inference Systems Engineering: design abstractions and components to support model inference across environments.
• Model Handling: optimize loading strategies and lifecycle management for diverse models (LLMs, CV, NLP).
• Benchmarking & Evaluation: develop benchmarks for latency, throughput, and hardware performance.
• Platform Integration & Developer Experience: build APIs, libraries, and services for simplified deployment and observability.

Skills

Inference stacks

Performance profiling

Programming languages

Linux & distributed

Containers & orchestration

Education

Degree in CS/CE or related

Tools

NVIDIA Triton Inference Server

vLLM

SGLang

Dynamo/LLM-D

Docker

Kubernetes/OpenShift

Job description

Defence Science and Technology Agency seeks a highly technical ML Systems Engineer to architect and build scalable AI inference capabilities across heterogeneous environments. You will work at the intersection of machine learning, systems engineering, and software engineering to create platforms and tooling that standardise and simplify AI model serving in production.

You will design abstractions for model inference, integrate across formats and environments, and optimize latency, throughput,