Senior Machine Learning Engineer

Referrals Only; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A leading technology consultancy is seeking a Senior Machine Learning Engineer in Singapore. This role requires expertise in inference optimization techniques and a strong foundation in machine learning. The candidate will be responsible for optimizing AI models across diverse environments and collaborating with teams to enhance performance. Thoughtworks fosters a culture of continuous learning and provides resources for career development.

Benefits

Career development programs

Inclusive work culture

Qualifications

• Strong foundation in machine learning with expertise in optimization techniques.
• Hands-on experience with modern inference runtimes and compilers.
• Understanding of benchmarking to guide optimization decisions.

Responsibilities

• Implement and tune advanced model optimization techniques.
• Configure and optimize inference runtimes and serving frameworks.
• Enable high-throughput serving using continuous batching.

Skills

Inference optimization techniques

Modern inference runtimes (e.g., TensorRT, Triton)

Deep learning frameworks

Benchmarking and profiling

GPU/accelerator architectures

Performance tuning

Multiple model types (LLM, VLM, SLM)

Job description

Machine Learning Engineers specializing in Inference Optimization focus on maximizing the efficiency, speed, and cost-effectiveness of deploying AI models across diverse environments. They apply advanced techniques at every stage of the model lifecycle from training through runtime inference to application logic and observability. Their work ensures that clients can scale AI solutions sustainably, whether in the cloud, on-premises, or at the edge.

By combining deep expertise in model compression, runtime acceleration, and serving frameworks with an understanding of real‑world business needs, they directly influence system performance and operational cost. They design, implement, and benchmark cutting‑edge optimization strategies to deliver measurable gains in throughput, latency, and GPU utilization.

As a Senior Machine Learning Engineer at Thoughtworks, you’ll bring both engineering rigor and creative problem‑solving to one of AI’s fastest‑evolving domains.

Job responsibilities

• Implement and tune advanced model optimization techniques such as post‑training quantization, pruning, and knowledge distillation.
• Configure and optimize inference runtimes and serving frameworks (e.g., NVIDIA Triton, vLLM, TensorRT‑LLM, DeepSpeed, SGLang).
• Enable high‑throughput serving using continuous batching, KV caching, speculative decoding, and asynchronous scheduling.
• Apply kernel fusion strategies to reduce latency and memory overhead.
• Evaluate trade‑offs across accuracy, throughput, latency, and GPU/accelerator utilization for different hardware footprints (cloud, on‑prem, serverless, edge).
• Develop and maintain performance benchmarks using profiling tools (e.g., PyTorch/TensorFlow profilers, Nsight) to identify bottlenecks.
• Collaborate with AI delivery teams to embed inference best practices into application logic (e.g., prompt optimization, caching, model routing).
• Contribute to internal knowledge sharing, technical playbooks, and enablement material to uplift inference engineering capabilities across teams.

Job qualifications

Technical Skills

• Strong foundation in machine learning with expertise in inference optimization techniques (quantization, pruning, distillation, batching, KV caching, etc.).
• Hands‑on experience with modern inference runtimes and compilers (eg. TensorRT, ONNX Runtime, vLLM, Triton, DeepSpeed).
• Familiarity in deep learning frameworks with production‑ready engineering practices.
• Understanding of benchmarking and profiling workloads to guide optimization decisions.
• Familiarity with GPU/accelerator architectures and cloud inference APIs.
• Understanding of trade‑offs between model accuracy, performance, and cost, and ability to tune accordingly.
• Comfort working across multiple model types (eg. LLM, VLM, SLM) and deployment environments (cloud, on‑prem, edge).

Professional Skills

• Ability to translate technical optimizations into tangible business outcomes (e.g., lower cost per token).
• Comfortable in fast‑moving, ambiguous environments and motivated to explore new research directions.
• Good communication skills to explain performance trade‑offs and recommendations to both technical and non‑technical stakeholders.
• A mindset of continuous learning and sharing, eager to mentor peers and contribute to a culture of technical excellence.

Learning & Development

There is no one‑size‑fits‑all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.

About Thoughtworks

Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary.