Senior AI Product Engineer: Build National-Scale AI Systems

YTL AI Labs; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Job summary

YTL AI Labs is seeking a Senior AI Product Engineer to design, build, and operate production-grade AI systems. You will work at the crossroads of applied AI, backend engineering, and platform reliability, delivering scalable, cost-efficient solutions for real-world applications.

You will collaborate with product, platform, and infrastructure teams to turn research into reliable AI capabilities, owning engineering decisions that ensure performance, safety, and cost efficiency at scale.

Qualifications

• 4+ years of software engineering experience with AI/ML or LLM-based systems.
• Strong backend engineering skills (Python, Node.js, or similar) with production experience.
• Practical experience working with LLMs, prompts, tools, and agent-style architectures.
• Solid understanding of system design trade-offs: latency, cost, reliability, and scalability.
• Comfortable operating in fast-moving, exploratory environments with evolving requirements.

Responsibilities

• Design and implement end-to-end AI systems including inference pipelines, agent workflows, and tool-calling architectures.
• Build and manage context orchestration for LLMs (system prompts, memory, retrieval, and structured inputs).
• Engineer latency-aware and cost-efficient fallback strategies across models and providers.
• Develop backend services for prompt routing, response handling, and tool execution (Python / Node.js or similar).
• Integrate and optimise RAG pipelines, memory stores, and evaluation workflows.
• Implement observability for AI systems: logging, metrics, tracing, and quality monitoring.
• Maintain CI/CD pipelines for AI services and ensure safe, repeatable deployments.
• Collaborate with product and platform teams on system design, risk assessment, and scaling strategies.
• Continuously refine system performance using telemetry, offline evaluation, and real user feedback.
• Contribute reusable abstractions, internal libraries, and engineering best practices across the AI stack.

Skills

4+ years

Backend engineering

LLM prompts and tools

System design trade-offs

Fast-moving environments

Tools

LLM APIs (OpenAI/Claude)

Job description

YTL AI Labs is seeking a Senior AI Product Engineer to design, build, and operate production-grade AI systems. You will work at the crossroads of applied AI, backend engineering, and platform reliability, delivering scalable, cost-efficient solutions for real-world applications.

You will collaborate with product, platform, and infrastructure teams to turn research into reliable AI capabilities, owning engineering decisions that ensure performance, safety, and cost efficiency at scale.