Senior AI Platform Engineer: Agentic & LLM Systems

Randstad Malaysia; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Benefits offered by this job

Excellent Benefits

Public Transport Accessible

Career Growth

Job summary

Randstad Malaysia is seeking an experienced Software Engineer focused on AI systems to design autonomous Agentic AI workflows and robust LLM integration. You will build scalable API layers, routing, and middleware to productionize OpenAI, Anthropic, and LLaMA-based solutions.

The role emphasizes guardrails, memory management, and efficient model evaluation, with strong collaboration across product and data science teams in a high-availability environment.

Qualifications

• 5+ years of professional software engineering experience.
• Deep expertise in distributed systems, microservices, CI/CD, automated testing, scalable architecture.
• Hands-on experience building production AI applications using LLMs, RAG, vector databases, evaluation techniques.
• Experience building Agentic AI systems with autonomous tool use, planning, and memory management.
• Familiarity with proprietary and open-source models (Hugging Face); deployment, quantization, and efficient interaction.

Responsibilities

• Design and implement autonomous Agentic AI workflows including multi-agent orchestration and tool-calling interfaces.
• Build scalable API layers, routing, and middleware to integrate LLMs into production applications.
• Develop strict input/output guardrails, fallback mechanisms, and validation schemas for secure enterprise use.
• Optimize latency, throughput, and costs of LLM inferences with caching, semantic routing, and context management.
• Apply software engineering principles to AI system design ensuring high availability, fault tolerance and observability.
• Collaborate with Product Managers, Data Scientists, and Frontend Engineers to translate requirements into AI-driven features.

Skills

Agentic AI

LLM

AI Development

AI Harness

Software Development

Education

College/Pre-University

Tools

Python

Go

Rust

TypeScript/Node.js

Job description

Randstad Malaysia is seeking an experienced Software Engineer focused on AI systems to design autonomous Agentic AI workflows and robust LLM integration. You will build scalable API layers, routing, and middleware to productionize OpenAI, Anthropic, and LLaMA-based solutions.

The role emphasizes guardrails, memory management, and efficient model evaluation, with strong collaboration across product and data science teams in a high-availability environment.