Senior AI/ML Engineer – SLM Optimization & Inference

Concentrix; United States; Remote; USD 145.000 - 171.000; Vollzeit

Benefits dieser Stelle

Medical, dental, and vision insurance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Zusammenfassung

Concentrix is seeking a hands-on Senior AI/ML Engineer to fine-tune, optimize, and deploy Small Language Models for production-grade inference, with a focus on Alibaba Qwen. The role emphasizes improving latency, throughput, and GPU efficiency in real-time audio intelligence pipelines.

You will work close to model, infrastructure, and performance benchmarks, building scalable ML systems ready for production and collaborating across engineering and data teams.

Qualifikationen

• Strong hands-on experience with PyTorch, Hugging Face Transformers, and SLM fine-tuning techniques such as LoRA, QLoRA, and PEFT.
• Practical experience using vLLM or SGLang for high-performance model inference.
• Deep understanding of GPU utilization, CUDA fundamentals, KV caching, and memory optimization.
• Experience evaluating and improving model precision, recall, latency, throughput, and inference performance.
• Strong Python programming and ML engineering skills.
• Proven ability to benchmark, debug, and optimize models for production environments.
• Experience fine-tuning and deploying Alibaba Qwen models is preferred.
• Experience with real-time audio AI, speech recognition, ASR, or audio classification is preferred.
• Experience optimizing AI models for high-throughput, low-latency production environments is preferred.
• Ability to work hands-on across both SLM model training/fine-tuning and GPU inference optimization.
• Strong collaboration skills with the ability to partner effectively across engineering and data teams.

Aufgaben

• Fine-tune and optimize Small Language Models, particularly Alibaba Qwen models, for domain-specific use cases.
• Improve model performance across key metrics, including accuracy, precision, recall, latency, and inference throughput.
• Optimize model serving using vLLM, SGLang, or similar high-performance inference engines.
• Implement advanced inference optimization techniques, including GPU memory optimization, KV-cache management, quantization, and efficient batching.
• Develop, enhance, and optimize real-time audio intelligence pipelines for low-latency processing.
• Benchmark, profile, and tune models for production-scale deployment.
• Collaborate with engineering and data teams to evaluate model behavior, identify bottlenecks, and improve end-to-end ML system performance.
• Build reliable, scalable ML workflows that support high-throughput, low-latency AI applications.
• Apply senior-level technical judgment to balance model quality, infrastructure efficiency, and production performance requirements.

Kenntnisse

PyTorch

Hugging Face Transformers

LoRA

QLoRA

PEFT

Python

ML Engineering

GPU Inference

vLLM

SGLang

Tools

vLLM

SGLang

CUDA

KV caching

Memory optimization

Jobbeschreibung

Job Title:

Senior AI/ML Engineer – SLM Optimization & Inference

Job Description

We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled.
The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent.
The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. We integrate world-class digital engineering, creativity, and a deep understanding of human behavior to find and unlock value through tech-powered and intelligence-fueled experiences. We combine human-centered design, powerful data, and strong tech to accelerate transformation at scale. You will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience. Within our professional services team, you will deliver strategic consulting, design, advisory services, market research, and contact center analytics that deliver insights to improve outcomes and value for our clients. Hence achieving our vision.
Our game-changers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year.
Join us and be part of this journey towards greater opportunities and brighter futures.

Position Summary

Senior AI/ML Engineer – SLM Optimization & Inference

We are looking for a hands-on Senior AI/ML Engineer to fine-tune, optimize, and deploy Small Language Models, with a focus on Alibaba Qwen models and production-ready inference performance. In this role, you will help improve model quality, latency, throughput, and GPU efficiency while contributing to real-time audio intelligence pipelines for high-performance, low-latency applications.

This is an opportunity for a senior‑level AI/ML engineer who enjoys working close to the model, the infrastructure, and the performance benchmarks—building scalable ML systems that are ready for production.

Responsibilities

• Fine-tune and optimize Small Language Models, particularly Alibaba Qwen models, for domain-specific use cases.
• Improve model performance across key metrics, including accuracy, precision, recall, latency, and inference throughput.
• Optimize model serving using vLLM, SGLang, or similar high-performance inference engines.
• Implement advanced inference optimization techniques, including GPU memory optimization, KV-cache management, quantization, and efficient batching.
• Develop, enhance, and optimize real-time audio intelligence pipelines for low-latency processing.
• Benchmark, profile, and tune models for production‑scale deployment.
• Collaborate with engineering and data teams to evaluate model behavior, identify bottlenecks, and improve end-to-end ML system performance.
• Build reliable, scalable ML workflows that support high‑throughput, low‑latency AI applications.
• Apply senior-level technical judgment to balance model quality, infrastructure efficiency, and production performance requirements.

Qualifications

• Strong hands‑on experience with PyTorch, Hugging Face Transformers, and LLM/SLM fine‑tuning techniques such as LoRA, QLoRA, and PEFT.
• Practical experience using vLLM or SGLang for high-performance model inference.
• Deep understanding of GPU utilization, CUDA fundamentals, KV caching, and memory optimization.
• Experience evaluating and improving model precision, recall, latency, throughput, and inference performance.
• Strong Python programming and ML engineering skills.
• Proven ability to benchmark, debug, and optimize models for production environments.
• Experience fine‑tuning and deploying Alibaba Qwen models is preferred.
• Experience with real-time audio AI, speech recognition, ASR, or audio classification is preferred.
• Experience optimizing AI models for high‑throughput, low‑latency production environments is preferred.
• Ability to work hands-on across both SLM model training/fine‑tuning and GPU inference optimization.
• Strong collaboration skills with the ability to partner effectively across engineering and data teams.

The base salary for this position is $ 144,964-$ 171,321 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.

The deadline to apply for this position is: 11/04/2026. This position is for an existing, immediate vacancy. We are currently seeking to fill this role with an individual who can start as soon as possible.

As part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Company will provide the legally required disclosures and obtain any required written consent prior to such collection, and will handle such information in accordance with applicable biometric privacy laws and Company policies.

#Concentrix

Location:

USA, NE, Work-at-Home

Language Requirements:

Time Type:

Full time

Physical and Mental Requirements:
The employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position. Work is generally sedentary in nature.

Equal Employment Opportunity:

Concentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.

For more information regarding your EEO rights as an applicant, please visit the following websites:

English

Spanish

Accommodation:

Concentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting . All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.

Artificial Intelligence:

As part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.

Work Authorization:

In accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence.

For further information on available work states and Equal Employment Opportunity as an applicant, please click HERE