General Summary
Join Qualcomm’s Multimedia Systems Group as a Voice AI Systems Test Engineer, responsible for end‑to‑end validation of Voice AI features, model evaluation, and quality KPIs sign‑off for on‑device Voice AI features for next‑generation multimedia platforms.
In this role, you will focus on validation, benchmarking, data‑driven evaluation, competitive analysis of Always‑On AI and Agentic AI voice use cases – including ASR, TTS, multilingual translation, and intelligent voice assistants. Your work will ensure Qualcomm’s Voice AI solutions meet and exceed market expectations, matching or outperforming reference implementations and competing solutions across performance, quality, latency, power, and robustness.
Responsibilities
- Perform system‑level validation and testing of Voice AI features, with emphasis on Always‑On AI and Agentic AI use cases.
- Design, execute, and maintain comprehensive test plans for Voice AI pipelines including ASR, TTS, NLP, Translation, Summarization, and Language Models.
- Validate functional correctness, latency, power, memory, and long‑run stability of Voice AI systems on embedded hardware (NPU, GPU, CPU).
- Maintain performance dashboard
- Detect regressions
- Identify quality gaps
- Predict performance trends across releases
- Compare performance and perceptual quality of Qualcomm Voice AI solutions against:
- Internal reference implementations
- Customer baselines
- Competing open‑source solutions in the market
- Conduct objective and subjective quality analysis for Voice AI features (accuracy, intelligibility, naturalness, latency perception, robustness).
- Drive validation to meet and beat market expectations, using measurable KPIs and user‑experience metrics.
- Perform competitive benchmarking of open‑source and proprietary models from a system‑level quality and performance standpoint.
- Validate AI acceleration paths, ensuring correct and efficient offload across NPU, GPU, CPU, and DSP.
- Evaluate end‑to‑end voice AI pipelines, including low power modes and real‑time inference behavior in batch and streaming modes.
- Verify correct interaction across application, framework, DSP, and hardware layers.
- Develop and maintain automated test suites, regression frameworks, and evaluation pipelines for Voice AI and Agentic AI workflows.
- Analyze logs, traces, metrics, and dumps to perform root‑cause analysis of functional, performance, or quality issues.
- Collaborate closely with R&D, Systems, Platform, Product, and Customer teams to drive fixes, improvements, and release readiness.
- Document test methodologies, KPIs, validation results, and competitive insights for internal and external stakeholders.
Requirements
- Strong programming and scripting skills in C/C++ and Python, focused on test automation, data analysis, and evaluation tooling.
- Experience in system‑level testing and validation of ML or AI workloads on embedded platforms.
- Solid understanding of Voice AI domains: ASR, TTS, NLP, multilingual translation, and voice assistants.
- Hands‑on experience validating ML inference performance and quality on NPU/GPU/CPU.
- Working knowledge of deep learning frameworks such as PyTorch, TensorFlow, and ONNX from a testing and inference evaluation perspective.
- Understanding of ML architectures (Transformers, LSTM, GRU, diffusion models) for validation, benchmarking, and analysis.
- Experience validating model quantization, compression, and hardware acceleration techniques.
- Strong debugging skills for embedded systems, DSP pipelines, and AI accelerators.
- Experience with AI‑assisted test data analysis, model‑based evaluation, and KPI‑driven benchmarking is a strong plus.
- Excellent communication and collaboration skills to work across global, cross‑disciplinary teams.
Behavioral & Professional Expectations
- Strong quality and customer‑experience mindset with attention to detail.
- Self‑driven engineer capable of handling complex system‑level validation challenges.
- Ability to translate test data and metrics into actionable insights.
- Excellent verbal and written communication for clear reporting and cross‑team alignment.
- Team player who collaborates effectively with R&D, platform, and product organizations.
- Commitment to engineering excellence, continuous learning, and innovation.
- Actively supports diversity and inclusion within the team and company.
Educational Qualification
- Bachelor’s or Master’s in Engineering, Electronics & Communication, Computer Science, or related fields.
- 2+ years of experience in Voice AI testing, Audio/AI system validation, ML inference evaluation, or related domains.
Minimum Qualifications
- Bachelor’s degree in Engineering, Information Systems, Computer Science, or related field AND 2+ years of Systems Test Engineering or related work experience.
- Master’s degree in Engineering, Information Systems, Computer Science, or related field AND 1+ year of Systems Test Engineering or related work experience.
- PhD in Engineering, Information Systems, Computer Science, or related field.
Preferred Qualifications
- 4+ years of Systems Test Engineering or related work experience.
Applicants: Qualcomm is an equal‑opportunity employer. If you are an individual with a disability and require an accommodation during the application/hiring process, Qualcomm is committed to providing an accessible process. For further information, please consult Qualcomm Careers.