Senior AI Engineer

EPAM Systems; Kuala Lumpur; On-site; MYR 150,000 - 240,000; Full time

Job summary

EPAM Malaysia is seeking a Senior AI Engineer to lead the development of cutting‑edge AI solutions. You will design scalable ML pipelines, deploy them on cloud platforms, and collaborate with cross‑functional teams to translate business challenges into data‑driven products.

You will apply Python, SQL and MLOps practices to build robust AI architectures, including inference pipelines, vector databases and RAG approaches, while maintaining quality and governance standards.

Qualifications

• Bachelor's or Master's in Computer Science, Data Science or related field.
• Strong Python expertise and SQL/NoSQL experience.
• Proven experience with LLM-based solution development and NLP.

Responsibilities

• Design end-to-end AI systems including inference pipelines and tool-calling architectures.
• Build context orchestration for LLMs including memory, prompts and retrieval.
• Develop backend services for prompt routing and tool execution in Python/Node.js.

Skills

Python

LLM/NLP

Cloud platforms

CI/CD

Docker

Kubernetes

SQL/NoSQL

REST APIs

Education

Bachelor's degree in CS/DS

Master's degree in CS/DS

Tools

Spark

ML frameworks

Data platforms

Job description

Join EPAM Malaysia as a Senior AI Engineer and lead the charge in creating cutting-edge AI solutions that solve complex, real-world problems. You’ll design and deploy scalable ML pipelines using ML frameworks and data platforms while harnessing the power of cloud platforms. Collaborate with cross-functional teams to transform business challenges into innovative data-driven solutions, leveraging your expertise in Python, SQL and MLOps frameworks.

Responsibilities

• Design and implement end-to-end AI systems including inference pipelines, agent workflows and tool-calling architectures
• Build and manage context orchestration for LLMs, covering system prompts, memory, retrieval and structured inputs
• Engineer latency-aware and cost-efficient fallback strategies across models and providers
• Develop backend services for prompt routing, response handling and tool execution using Python or Node.js
• Implement observability for AI systems including logging, metrics, tracing and quality monitoring
• Maintain CI/CD pipelines for safe, repeatable deployments of AI services
• Integrate and deploy AI-powered software solutions into scalable enterprise environments, translating business requirements into robust system designs
• Collaborate with cross-functional teams, ensure compliance with data protection and AI governance and document architectures and implementation decisions

Requirements

• Solid software engineering experience with hands-on work with AI/ML or LLM systems, and a Bachelor’s or Master’s degree in Computer Science, Data Science or a related field
• Proficient in Python, with experience in SQL or NoSQL databases, REST APIs and backend integration
• Demonstrated expertise in LLM-based solution development, prompt engineering, NLP, semantic models and agent-style architectures
• Skilled in fine-tuning and evaluating LLMs, building automated AI pipelines for training, testing, deployment and monitoring
• Experience with the Spark or Apache ecosystem, scalable data and AI architectures and cloud computing platforms
• Proficient in containerization technologies such as Docker and Kubernetes with experience in GPU orchestration and cost optimization
• Familiarity with CI/CD pipelines, DevOps tooling and enterprise-scale architectures
• Strong analytical thinker and communicator, results-driven, customer-focused and actively following new AI advancements and industry best practices

Nice to have

• Experience integrating with LLM APIs from providers like OpenAI, Claude, or comparable platforms
• Direct involvement in building or maintaining Retrieval-Augmented Generation (RAG) systems, including work with vector databases and embedding pipelines
• Familiarity with model safety measures, implementation of AI guardrails or responsible AI best practices

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us