Senior AI/ML Engineer, SLM & Real-Time Inference (Remote)

Concentrix; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Concentrix is seeking a Senior AI/ML Engineer to design, fine-tune, and optimize small language models for domain-specific, production-ready applications. This role focuses on model training, real-time inference optimization, and low-latency audio pipelines using modern AI/ML engineering practices.

Location is remote in the United States. You will work with Alibaba Qwen, PyTorch, and PEFT techniques to push for high-throughput, low-latency deployment and measurable improvements in accuracy and

Qualifications

• Strong hands-on experience with PyTorch, Hugging Face Transformers, and LLM/SLM fine-tuning techniques (LoRA, QLoRA, PEFT).
• Practical experience with vLLM or SGLang for high-performance inference.
• Deep understanding of GPU utilization, CUDA fundamentals, KV caching, and memory optimization.
• Experience evaluating and improving model precision, recall, and inference performance.
• Strong Python programming and ML engineering skills.
• Experience fine-tuning and deploying Alibaba Qwen models.
• Experience with real-time audio AI, speech recognition (ASR), or audio classification.
• Experience optimizing AI models for high-throughput, low-latency production environments.

Responsibilities

• Fine-tune and optimize Small Language Models (SLMs), particularly Alibaba Qwen models, for domain-specific applications.
• Improve model accuracy, precision, recall, latency, and inference throughput.
• Optimize model serving using vLLM, SGLang, or similar inference engines.
• Implement GPU memory optimization, KV-cache management, quantization, and efficient batching.
• Develop and optimize real-time audio intelligence pipelines for low-latency processing.
• Benchmark and tune models for production-scale deployment.

Skills

PyTorch

Hugging Face Transformers

LoRA / PEFT

vLLM / SGLang

CUDA / GPU optimization

Python

SLM fine-tuning

Alibaba Qwen

ASR / audio processing

Tools

vLLM

SGLang

Job description

Concentrix is seeking a Senior AI/ML Engineer to design, fine-tune, and optimize small language models for domain-specific, production-ready applications. This role focuses on model training, real-time inference optimization, and low-latency audio pipelines using modern AI/ML engineering practices.

Location is remote in the United States. You will work with Alibaba Qwen, PyTorch, and PEFT techniques to push for high-throughput, low-latency deployment and measurable improvements in accuracy and