AI Engineer (ML Systems & Infrastructure)
SWAPETECH PTE. LTD.
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
SWAPETECH PTE. LTD. seeks exceptional AI Engineers to build the next generation of AI infrastructure and MLSys systems. You will focus on large-scale distributed systems, Kubernetes-based AI infrastructure, RDMA networking, KV Cache, GPUs, and CUDA kernel optimisation.
You will collaborate with AI researchers, infra architects, and platform teams to maximise efficiency, scalability, and reliability of AI workloads.
Qualifications
- Bachelor's degree or above in CS/SE/EE or related field.
- Strong software engineering and system design capability.
- Experience with distributed systems and GPU infrastructure.
Responsibilities
- Design, deploy, and operate large-scale Kubernetes-based AI infrastructure.
- Develop cluster governance, scheduling, resource isolation, and multi-tenancy.
- Build and optimize GPU orchestration platforms and high-speed networking.
- Improve cluster utilization, reliability, and operational efficiency.
- Develop observability platforms, dashboards, and SLO-driven ops.
Skills
Education
Tools
Job description
We are looking for exceptional AI Engineers to build the next generation of AI infrastructure and Machine Learning Systems(MLSys).
This role focuses on large-scale system infrastructure rather than model research. You will work on the core foundations that power large-scale AI training and inference systems, including Kubernetes cluster management, RDMA networking, unified KV Cache architecture, observability platforms, distributed systems, GPU orchestration, and CUDA kernel optimisation.
You will collaborate closely with AI researchers, infrastructure architects, networking engineers, and platform teams to maximize the efficiency, scalability, and reliability of AI systems.
- Design, deploy, and operate large-scale Kubernetes-based AI infrastructure.
- Develop cluster governance frameworks, scheduling policies, resource isolation, and multi-tenancy capabilities.
- Build and optimize GPU orchestration platforms using Kubernetes, Slurm, Volcano, Kueue, Ray, and related technologies.
- Improve cluster utilization, reliability, elasticity, and operational efficiency.
- Design and optimize RDMA, InfiniBand, RoCE, and high-speed Ethernet fabrics for distributed AI workloads.
- Optimize GPU-to-GPU and GPU-to-NIC communication paths.
- Improve distributed communication efficiency for large-scale training and inference.
- Analyze and eliminate networking bottlenecks across AI clusters.
- Design and implement unified KV Cache architecture across:
- GPU HBM
- CPU Memory
- RDMA-accessible Memory
- NVMe SSD
- Distributed Storage
- Develop efficient KV Cache sharing, migration, offloading, and scheduling mechanisms.
- Optimize latency and throughput for large-scale inference systems.
- Develop and optimize CUDA kernels for training and inference workloads.
- Profile and optimize GPU compute, memory, communication, and scheduling efficiency.
- Contribute to low-level optimization of AI frameworks and inference engines.
- Work on technologies such as FlashAttention, TensorRT, Triton, NCCL, CUTLASS, and custom operators.
- Build end-to-end observability platforms for AI infrastructure.
- Design monitoring, logging, tracing, alerting, and troubleshooting frameworks.
- Develop performance dashboards and SLO-driven operational systems.
- Improve maintainability, debuggability, and operational excellence of AI platforms.
- Build automation tools for deployment, provisioning, monitoring, and operations.
- Develop Infrastructure-as-Code (IaC) solutions using Terraform, Ansible, and related tools.
- Build CI/CD pipelines and engineering productivity platforms.
- Improve platform scalability and operational efficiency.
- Bachelor's degree or above in Computer Science, Software Engineering, Electrical Engineering, or related fields.
- Strong software engineering and programming skills.
- Excellent system design capability and strong engineering craftsmanship.
- Strong coding standards and code quality awareness.
- Strong sense of ownership, accountability, and execution.
Strong understanding of:
- Operating Systems
- Computer Networks
- Distributed Systems
- Data Structures and Algorithms
- Linux Internals
Proficiency in one or more of:
- C++
- Go
- Python
- Rust
Hands-on experience in one or more of:
- Kubernetes
- GPU Infrastructure
- Distributed Systems
- AI Infrastructure
- HPC (High Performance Computing)
- Cloud-Native Platforms
Experience with:
- RDMA
- InfiniBand
- RoCE/RoCEv2
- GPUDirect
- NCCL
- UCX
- High-Speed Ethernet
Experience with:
- CUDA
- GPU Performance Optimization
- Multi-GPU Systems
- Distributed Training
- Distributed Inference
- Experience building large-scale AI training or inference clusters.
- Experience with vLLM, SGLang, TensorRT-LLM, Triton, DeepSpeed, Megatron-LM, Ray, or similar frameworks.
- Experience with unified KV Cache systems, memory hierarchy optimisation, or distributed storage systems.
- Experience with Kubernetes GPU Operator and NVIDIA NetworkOperator.
- Experience with Prometheus, Grafana, Loki, OpenTelemetry, and observability platforms.
- Experience contributing to open-source projects such as: vLLM, FlashAttention, CUTLASS, TVM, MLIR, Triton, Kubernetes, NCCL
- Experience working across AI Infrastructure, HPC, Networking, and Silicon Systems is highly desirable.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
