Member of Technical Staff, ML Inference Engineering

Sanas

Bengaluru

Presencial

INR 4 200 000 - 6 400 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Sanas is pioneering real-time speech and language AI with on-premise deployment inside sovereign data centers. We are seeking a deeply hands-on senior engineer to shape core infrastructure and architecture, not just implement a spec, and to elevate the performance of the engineering team.

You will own performance optimization and reliability for large-scale inference and training, working across multi-node, multi-GPU environments with latency and privacy as top priorities.

Qualificações

  • 5+ years of experience writing high-performance code.
  • Familiarity with NVIDIA GPU architecture and CUDA.
  • Fluency in the LLM serving stack, from kernels to autoscaling.
  • Research-leaning or systems background in LLM, Speech-to-Text, Text-to-Speech, or Speech-to-Speech inference.
  • Record of shipping research or systems that others build on.

Responsabilidades

  • Optimize system and GPU performance for high-throughput AI workloads.
  • Analyze latency, throughput, memory usage and compute efficiency.
  • Profile performance to detect bottlenecks at GPU and kernel level.
  • Implement low-level optimizations using CUDA, Triton and related tools.
  • Own and evolve the inference engine for reliability and scale.

Conhecimentos

5+ yrs coding
NVIDIA CUDA
LLM serving stack
LLM/Speech inference
shipping research/systems

Ferramentas

Kubernetes
InfiniBand/RoCE
Bare-metal provisioning
CUDA

Descrição da oferta de emprego

Sanas is pioneering the future of human communication. Founded by a team of Stanford researchers and entrepreneurs with deep industry experience, Sanas has developed the world’s first real-time speech AI platform capable of accent translation, noise cancellation, speech enhancement, cross-language communication, and more.

Sanas makes conversations clearer, more inclusive, and more effective, removing barriers that prevent people from being understood, regardless of accent, background noise, or native language.

Sanas is currently one of the fastest growing startups in Silicon Valley, growing from $16M to $50M ARR in 2025. The company’s core business is profitable and is on track to end 2026 with >$120M ARR. Our team combines deep expertise in model innovation and systems engineering with a design-minded product engineering culture to build and ship cutting-edge AI models and experiences — entirely in-house.

Sanas is a 130 person team, established in 2020. In this short span, we’ve successfully secured over $100 million in funding. Our innovation has been supported by the industry’s leading investors, including Insight Partners, Google Ventures, Quadrille Capital, General Catalyst, Quiet Capital, and other influential investors. Our reputation is further solidified by collaborations with numerous Fortune 100 companies. With Sanas, you’re not just adopting a product; you’re investing in the future of communication.

If you’re looking to have a significant role in roadmapping and driving technical directions, if you’re looking to deploy challenging and big ideas without much overhead or slowness, if you’re looking to leave your mark on an ambitious, generational mission to change how the worlds thinks about speech + AI, then Sanas is a well-suited place for you.

About the Role

Sanas is bringing real-time speech and language models on‑premise — deployed at scale directly inside sovereign data centers, not served from behind a hosted cloud endpoint. It’s one of the most demanding environments in the industry: strict latency budgets, massive concurrency, and infrastructure that needs to be private and reliable.

We’re looking for a deeply hands‑on, senior engineer to help lead that build. This is someone who shapes core infrastructure and architecture decisions rather than just executing against a specification, and who naturally raises the level of the engineers working alongside them.

What You'll Do

Performance Optimization

  • Optimize system and GPU performance for high-throughtput AI workloads across multi-node training and inference
  • Analyze and improve latency, throughput, memory usage, and compute efficiency
  • Profile system performance to detect and resolve GPU- and kernel-level bottlenecks
  • Implement low-level optimizations using CUDA, Triton, and other performance tooling
  • Improve support for mixed precision, quantization, and model graph optimization
  • Build and maintain performance benchmarking and monitoring infrastructure
  • Scale inference and training systems across multi-GPU, multi-node environments

Inference Systems & Reliability

  • Own and evolve our inference engine, enabling reliability and performance at scale
  • Develop and optimize runtime inference services for large-scale AI applications
  • Implement robust, fault‑tolerant systems for data ingestion and processing
Requirements

Must-have:

  • 5+ years of experience writing high-quality, high-performance code
  • Familiarity with NVIDIA GPU architecture and CUDA
  • Fluency in the LLM serving stack, from kernels and quantization up to schedulers and autoscaling
  • A research‑leaning or systems background in LLM, Speech-to-Text, Text-to-Speech, or Speech-to-Speech inference, with work you can point to
  • A record of shipping research or systems that other people build on, whether in a lab or in industry

Nice-to-have:

  • Experience serving low‑precision (FP4/FP8) models, multiple LoRA adapters within one model instance (Multi-LoRA), or models distributed across several GPU nodes
  • Experience developing large-scale, high-load production systems
  • Experience maintaining or contributing to open-source ML projects
  • Experience managing machine learning workloads on Kubernetes clusters
  • Experience with InfiniBand or RoCE networking
  • Experience with bare-metal provisioning and lifecycle management
  • Experience operating large-scale AI training or inference clusters
  • Experience with hardware health monitoring and predictive failure detection
  • Experience with distributed storage systems
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Staff Software Engineer
Staff Software Engineer

Sanas • Bengaluru

Presencial
INR 5 000 000 - 9 000 000
Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization
Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization

OutcomesAI • Bengaluru

Presencial
INR 1 500 000 - 2 000 000
Senior System Software Engineer, Speech AI
Senior System Software Engineer, Speech AI

NVIDIA Corporation • Pune District

Presencial
INR 900 000 - 1 600 000
Senior Backend Engineer - Speech Platform
Senior Backend Engineer - Speech Platform

Rezo.AI • Dadri

Presencial
INR 1 400 000 - 2 400 000
Tech Lead — ASR / TTS / Speech LLM (IC + Mentor)
Tech Lead — ASR / TTS / Speech LLM (IC + Mentor)

OutcomesAI • Bengaluru

Presencial
INR 4 000 000 - 7 000 000
Lead DevOps Engineer
Lead DevOps Engineer

Skit • Índia

Presencial
PHP 1 500 000 - 2 600 000
Mindfire Solutions - Senior AI Research Scientist
Mindfire Solutions - Senior AI Research Scientist

Mindfire Solutions • Kolkata District

Presencial
INR 6 000 000 - 9 000 000
AI Scientist
AI Scientist

Beetexting • Hyderabad

Presencial
INR 4 500 000 - 8 000 000
Senior AI/ML Engineer/ Developer
Senior AI/ML Engineer/ Developer

RADcube • Hyderabad

Presencial
INR 2 500 000 - 3 500 000
Senior ML Engineer - Inference and Model Serving
Senior ML Engineer - Inference and Model Serving

YAL • Hyderabad

Presencial
INR 3 000 000 - 6 000 000