AI Engineer, Platforms

Nanyang Technological University Singapore; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

NTU (Nanyang Technological University Singapore) hosts the AI Engineer role within the AISG Platform team to design and optimize LLM inference workflows and support the deployment of customized AI solutions. You will contribute to production-grade AI infrastructure, including GPU-enabled systems and RAG services, collaborating with internal teams across NTU and AISG.

The role emphasizes managing multi-cloud platforms, building scalable API services, and maintaining observability and automation

Qualifications

• Requires a degree in Computer Science, Information Technology, or equivalent.
• 1–3 years of DevOps, SRE, or platform engineering experience with production-scale systems.
• Hands-on experience with IaC (Terraform), containers and orchestration (Docker, Kubernetes), and managed compute/storage networks.

Responsibilities

• Own day-to-day operations of SEA-LION API Farm across multi-cloud environments, monitoring health, GPU capacity, performance and security posture.
• Optimize LLM inference across modalities to deliver business value and meet production goals.
• Diagnose and troubleshoot performance and reliability issues in API Farm and related services.
• Build new API services such as batch API services and MCP-based services.

Skills

Python

Bash

Strong communication

CI/CD fundamentals

Education

Bachelor’s degree in Computer Science, Information Technology, or equivalent

Tools

Terraform

Docker

Kubernetes

Job description

AI Singapore (AISG) is a national AI programme launched by the National Research Foundation (NRF), Singapore, to build and anchor deep national capabilities in AI. AISG is supported through a government-wide partnership including the NRF, Ministry of Digital Development and Information (MDDI), Infocomm Media Development Authority (IMDA), Economic Development Board (EDB) and Enterprise Singapore (ESG). We bring together research institutions and the vibrant ecosystem of AI start-ups and companies to support impactful research, develop talent, and power Singapore's AI efforts.

This position will be hosted at the Nanyang Technological University (NTU) under VP (Artificial Intelligence & Digital Economy)’s office and we welcome you to join our community.

We're looking for an AI Engineer to join the Platform team within AI Products at AISG. In this role, you will be collaborating with different internal teams to design and implement optimized inference workflows and support the team to build customized LLM-based solutions.

Your work will directly contribute to the deployment, optimisation and management of large language models (LLMs) in production, retrieval-augmented generation (RAG) services, AI agent orchestration platforms and GPU-enabled AI infrastructure.

Responsibilities

• Own day-to-day operations of SEA-LION API Farm, our multi-cloud LLM inference platform — monitoring environment health, GPU capacity, performance, cost, and security posture.
• Optimise LLM inference across various modalities to drive business value and support production goals.
• Diagnose and troubleshoot performance and reliability issues on API Farm.
• Build new API services such as batch API services, MCP services.

Infrastructure, CI/CD, and automation

• Manage high performance AI clusters and storage systems using infrastructure-as-code (e.g. Terraform) across different cloud providers.
• Develop and maintain CI/CD pipelines, container build/registry workflows, and deployment automation so teams can ship safely and frequently.
• Strengthen observability across the stack including logs, metrics, traces, and dashboards, and reduce toil by automating repetitive operational tasks.

AI-assisted ops and continuous improvement

• Use AI tools (e.g. Claude, Copilot, Cursor) appropriately in your daily work responsibilities.
• Build internal tools leveraging AI to reduce manual effort in day-to-day operations.

Requirements

• A degree in Computer Science, Information Technology, or equivalent.
• 1–3 years of DevOps, SRE, or platform engineering experience, with a track record of operating production systems at scale.
• Hands-on experience operating workloads on different cloud providers including IaC (e.g. Terraform), containers and orchestration (e.g. Docker, Kubernetes), and managed services for compute, storage, and networking.
• Strong knowledge on Inference frameworks and libraries (e.g., vLLM, SGLang, TensorRT-LLM, Transformers).
• Hands‑on experience deploying and serving LLMs in production — model serving, GPU scheduling, autoscaling, latency/throughput optimisation, and inference cost management.
• REST API design, model context protocol (MCP), Internet authentication patterns (e.g. OAuth).Strong fundamentals in CI/CD, observability (logs/metrics/traces), and incident response.
• Demonstrated use of AI tools (e.g. Claude, Copilot, Cursor) in your day-to‑day engineering — for code generation, review, debugging, and documentation — with a clear sense of where they help and where they don't.
• Solid scripting/programming skills (e.g. Python, Bash) and comfortable reading other people's code across the stack.
• Strong communication skills with the ability to explain technical concepts.

Good To Have

• Experience with multimodal AI models (e.g. vision language models, audio language models).
• C/C++/Rust/Go or other relevant programming languages.
• Contributions to open-source AI/ML projects.

We regret that only shortlisted candidates will be notified.

Hiring Institution: NTU