Senior Solutions Architect

Rafay(Asia) Pte. Ltd.

Singapore

On-site

SGD 180,000 - 280,000

Full time

21 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rafay(Asia) Pte. Ltd. seeks a Senior Solutions Architect to drive AI/ML platform deployments on Kubernetes and GPU environments across APAC.

You will partner with platform engineering, MLOps, data science, and infra teams to design scalable AI infrastructure solutions and ensure production readiness. You will lead complex deployments, optimise workloads, and provide strategic technical guidance to enterprise customers while mentoring junior team members and driving platform best practices.

Qualifications

  • 8+ years in infrastructure, platform, or solutions engineering.
  • 3+ years focused on AI/ML infrastructure or MLOps.
  • Deep Kubernetes expertise — cluster lifecycle, workloads, operators, RBAC.
  • Hands-on experience with NVIDIA GPU infrastructure.
  • Experience with LLM inference serving and optimisation.
  • Proficiency in Python or Go.
  • Experience with AWS, Azure, or GCP, incl. networking and IAM.
  • Strong communication and customer-facing skills.
  • Proficiency in Mandarin to liaise with Mandarin-speaking customers.
  • Willingness to travel across APAC.

Responsibilities

  • Design end-to-end AI/ML platform architectures for inference, training, and data pipelines.
  • Develop reference architectures for GPU cluster deployment and multi-tenant ML infra.
  • Evaluate inference serving frameworks (vLLM, TGI, Triton, NIM).
  • Advise on GPU fabric topology for distributed training.
  • Design observability strategies using DCGM, OTel, and GPU metrics pipelines.
  • Translate infra needs into scalable platform designs.
  • Deliver technical presentations, workshops, and PoC engagements.
  • Advis e on AI infrastructure strategy, cost, and scaling.
  • Collaborate with customer stakeholders to translate workload requirements into architectures.
  • Architect networking, identity management, observability, and security integrations.
  • Monitor and troubleshoot production environments, GPU utilization, and cost efficiency.
  • Lead root cause analyses for complex customer issues.
  • Serve as primary technical advisor for APAC customers.
  • Provide feedback to Product/Engineering to improve platform capabilities.
  • Mentor junior team members and contribute to team growth.

Skills

Kubernetes
AI infrastructure
NVIDIA GPUs
Python
Go
Cloud platforms
Communication
Mandarin

Tools

Prometheus
Grafana
OpenTelemetry
NVIDIA GPU Operator

Job description

Join us as a Senior Solutions Architect.

We are seeking a Senior Solutions Architect to help customers successfully deploy, operate, and scale AI/ML workloads on our GPU Platform-as-a-Service (PaaS) offering. This customer-facing role will be required to work closely with platform engineering, MLOps, data science, and infrastructure teams to design and implement production-ready AI infrastructure solutions built on Kubernetes and GPU-accelerated environments.

As a Senior Solutions Architect, it will be required to serve as a trusted advisor to enterprise customers, lead complex deployments, drive architecture best practices, and help customers maximise the value of their AI infrastructure investments. Also, to help customers onboard to the platform, optimise workload performance, automate infrastructure, and ensure reliable operations while serving as a strategic technical partner throughout the customer lifecycle.

This role is based in Singapore and covers the APAC region.

Key Responsibilities
  • Design end-to-end AI/ML platform architectures spanning inference, training, and data pipelines.
  • Develop reference architectures for GPU cluster deployment, LLM serving, and multi-tenant ML infrastructure.
  • Evaluate and recommend inference serving frameworks (vLLM, TGI, Triton, NIM).
  • Advise on GPU fabric topology — NVLink, InfiniBand, RoCEv2 — for distributed training.
  • Design observability strategies across DCGM, OTel, eBPF, and GPU metrics pipelines.
  • Translate complex infrastructure requirements into actionable platform designs.
  • Deliver technical presentations, workshops, and proof-of-concept engagements.
  • Act as a trusted advisor on AI infrastructure strategy, cost, and scaling.
  • Partner with customer platform, MLOps, data science, and executive stakeholders to understand AI/ML workload requirements and translate them into scalable platform architectures.
  • Architect networking, identity management, observability, and security integrations with enterprise systems.
  • Monitor and troubleshoot production environments, including GPU utilization, workload performance, cluster health, and cost efficiency.
  • Lead root cause analysis and remediation efforts for complex customer issues.
  • Serve as the primary technical advisor and escalation point for assigned customers across the APAC region.
  • Provide technical leadership during customer engagements and drive adoption of platform best practices.
  • Document reference architectures, implementation guides, and best practices.
  • Provide feedback to Product and Engineering teams to improve platform capabilities and influence product roadmap decisions.
  • Collaborate with internal teams to ensure successful customer adoption, expansion, and long-term success.
  • Mentor junior team members and contribute to the growth of the Solutions Architecture organization.
Job Requirements
  • 8+ years of experience in infrastructure, platform, or solutions engineering.
  • 3+ years of experience focused on AI/ML infrastructure or MLOps.
  • Deep Kubernetes expertise — cluster lifecycle, workloads, operators, RBAC.
  • Hands‑on experience with NVIDIA GPU infrastructure (H100/H200/B200 preferred).
  • Proficiency with distributed training concepts — NCCL, tensor parallelism, pipeline parallelism.
  • Experience with LLM inference serving and optimisation (vLLM, NIM, TGI).
  • Familiarity with GPU Operator, MIG, SR‑IOV, and network fabrics (IB/RoCEv2).
  • Strong scripting and automation skills (Python, Bash, Go preferred).
  • Demonstrated ability to communicate complex technical concepts to diverse audiences.
  • Experience with at least one programming language such as Python or Go.
  • Experience with AWS, Azure, or GCP, including networking, IAM, and managed Kubernetes services.
  • Familiarity with monitoring and observability technologies including Prometheus, Grafana, OpenTelemetry, or similar.
  • Strong understanding of AI/ML infrastructure concepts including GPU‑based workloads, model serving, training pipelines, and resource optimisation.
  • Proven ability to troubleshoot and resolve complex infrastructure and platform issues.
  • Excellent communication, presentation, and customer‑facing skills.
  • Experience leading technical discussions with both engineering teams and executive stakeholders.
  • Proficiency in spoken Mandarin is required to liaise directly with Mandarin‑speaking customers.
  • Willingness to travel regularly across the APAC region.
Preferred Qualifications
  • Experience supporting enterprise customers in cloud‑native environments.
  • Familiarity with AI/ML frameworks such as PyTorch and TensorFlow.
  • Experience with Run:AI, Slurm,
  • Experience with GPU scheduling, autoscaling, and workload optimisation.
  • Understanding of multi‑tenant Kubernetes environments and platform operations.
  • Experience working with MLOps or AI infrastructure platforms.
  • Experience developing reference architectures and leading technical workshops.
  • Relevant certifications such as CKA, CKAD, AWS Solutions Architect, Azure Solutions Architect, or GCP Professional Cloud Architect.
  • Understanding of multi‑tenant GPU isolation (SR‑IOV VFs, DPU offload)
  • Experience covering Southeast Asia and/or Greater China enterprise accounts.
What We Offer
  • Competitive base salary with equity incentives and performance bonuses.
  • Comprehensive health, dental, and vision insurance.
  • Opportunity to work at the forefront of generative AI infrastructure scaling and cloud‑native systems.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Solution Architect - Hosting
AI Solution Architect - Hosting

Hamilton Barnes • Singapore

On-site
SGD 180,000 - 250,000
Equity
Health benefits
Senior Solutions Engineer
Senior Solutions Engineer

TOKENFAB AI PTE. LTD. • Singapore

On-site
SGD 120,000 - 210,000
Solutions Architect, NVIDIA Cloud Partners
Solutions Architect, NVIDIA Cloud Partners

NVIDIA Corporation • Singapore

On-site
SGD 180,000 - 240,000
Solutions Architect, NVIDIA Cloud Partners
Solutions Architect, NVIDIA Cloud Partners

NVIDIA Corporation • Singapore

On-site
SGD 150,000 - 190,000
Solutions Architect, Data Center Infrastructure
Solutions Architect, Data Center Infrastructure

NVIDIA Corporation • Singapore

On-site
SGD 120,000 - 180,000
Solutions Architect (opens in a new tab) Customer Experience Singapore
Solutions Architect (opens in a new tab) Customer Experience Singapore

Nebius Group • Singapore

Remote
SGD 120,000 - 180,000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Solutions Architect, Data Center Infrastructure
Solutions Architect, Data Center Infrastructure

NVIDIA Corporation • Singapore

On-site
SGD 140,000 - 210,000
Director, Partner Alliance & Product Development
Director, Partner Alliance & Product Development

SCITIX (SGP) TECH PTE. LTD. • Singapore

On-site
SGD 180,000 - 280,000
Senior AI Infrastructure Engineer, Observability
Senior AI Infrastructure Engineer, Observability

Firmus Technologies Pty Ltd. • Singapore

On-site
SGD 180,000 - 240,000
Project Manager (AI Infrastructure) - Hosting
Project Manager (AI Infrastructure) - Hosting

Hamilton Barnes • Singapore

On-site
SGD 120,000 - 180,000
Bonus 10%
Stock options