AI Test Engineer (m/f/d)

HARMAN International; Garching bei München; Hybrid; EUR 90.000 - 130.000; Vollzeit

Benefits dieser Stelle

HARMAN employee discounts on JBL/AKG/S

HARMAN University programs

Zusammenfassung

HARMAN International seeks an AI Test Engineer to assure quality, safety, and reliability of AI-enabled software across devices and cloud services. You will work with AI tools and collaborate with software, ML, UX, hardware and product teams to validate AI-driven user journeys from input to device response.

The role emphasizes automated testing, structured evaluations of LLM behavior, test data and release pipelines, with hybrid in-person collaboration at the Garching location.

Qualifikationen

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Electrical Engineering or a related technical field.
• 5+ years of hands-on software quality engineering and test automation experience.
• Experience testing AI-enabled software products (LLM apps, conversational systems, ML features).
• Hands-on Python experience and automated testing frameworks.
• Experience with REST APIs, JSON, and schema/contract validation.
• Git-based development, PR reviews, and CI/CD.

Aufgaben

• Lead end-to-end quality engineering for AI-enabled applications, including conversational and agentic workflows, model integrations, orchestration layers, APIs, UIs, and connected-device experiences.
• Design and execute structured evaluations for LLM and agent-based behavior: functional correctness, instruction following, tool use, grounding, safety, consistency, failure handling, and regression risk.
• Prototype, build and maintain automated test solutions, test harnesses, API collections and release-validation pipelines.
• Translate product requirements and real user journeys into deterministic and exploratory test scenarios, acceptance criteria and quality signals.
• Validate multi-turn and multimodal interaction flows, including speech/text input and device controls.
• Test REST APIs and distributed services, including contracts, schemas, authentication, and telemetry.

Kenntnisse

Quality engineering

Test automation

Python

REST APIs

CI/CD

Troubleshooting

Documentation

Git

Ausbildung

Bachelor’s or Master’s degree in Computer Science/Software Engineering/Electrical Engineering or a related technical field

Tools

Git

CI/CD pipelines

Jobbeschreibung

Introduction: A Career at HARMAN Corporate

We’re a global, multi-disciplinary team that’s putting the innovative power of technology to work and transforming tomorrow. At HARMAN Corporate, you are integral to our company’s award-winning success.

• Enrich your managerial and organizational talents – from finance, quality, and supply chain to human resources, IT, sales, and strategy
• Augment your comprehensive skillset with expert training across decision-making, change management, leadership, and business development
• Obtain 360-degree support throughout your career life cycle, from early-stage to seasoned leader

What You’ll Be Part Of

We are looking for an AI Test Engineer to assure the quality, safety, and reliability of AI-enabled software used in connected product experiences. You will work at the intersection of AI application quality, automated testing, APIs, cloud and edge services, and connected devices. This is a hands‑on role for a specialist who can turn ambiguous product behavior into precise, repeatable evaluation scenarios and clear engineering feedback. You are an active and thoughtful user of modern generative AI tools. You understand their capabilities and limitations and use tools such as ChatGPT, OpenAI Codex, GitHub Copilot, or comparable solutions to accelerate test design, automation, debugging, analysis, and documentation – while critically validating their output. You will collaborate with software, machine learning, UX, hardware and product teams to validate AI-driven user journeys from prompt or voice input through orchestration, tools, services, and device responses. Your work will make prototypes and product demonstrations reproducible, observable, and ready for release decisions.

How You’ll Make An Impact

• Lead end-to-end quality engineering for AI-enabled applications, including conversational and agentic workflows, model integrations, orchestration layers, APIs, user interfaces, and connected-device experiences.
• Design and execute structured evaluations for LLM and agent-based behavior: functional correctness, instruction following, tool use, grounding, safety boundaries, consistency, failure handling, and regression risk.
• Prototype, build and maintain automated test solutions, including reusable test data, evaluation datasets, test harnesses, API collections and release-validation pipelines.
• Translate product requirements and real user journeys into deterministic and exploratory test scenarios, acceptance criteria and measurable quality signals.
• Validate multi-turn and multimodal interaction flows, including speech or text input, device controls, audio or media-related features and context‑aware personalization when applicable.
• Test REST APIs and distributed services, including request/response contracts, schemas, authentication, error handling, backward compatibility, telemetry and observability.
• Investigate defects using logs, traces, test results and system behavior; isolate root causes, create high-quality defect reports and verify fixes.
• Review code changes and collaborate with developers on testability, unit-test coverage, CI quality gates and practical release criteria.
• Prepare and validate integrated software-and-device environments across Linux, Windows, mobile platforms, cloud services, local services and networked hardware.
• Communicate quality risk, test evidence, known limitations and release readiness clearly to technical and non-technical stakeholders.
• Apply AI-assisted engineering tools in your daily work to generate and refine test scenarios, accelerate automation, analyze failures, explore edge cases and improve technical documentation. Critically review and validate all AI-generated output.

What Makes You A Strong Fit

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Electrical Engineering or a related technical field.
• 5+ years of hands‑on experience in software quality engineering, test automation, systems integration or software validation.
• Demonstrable experience testing AI-enabled software products, such as LLM applications, conversational systems, agentic workflows, recommendation systems or ML-powered features. General manual‑software‑testing experience alone is not sufficient.
• Strong understanding of how to evaluate non-deterministic AI behavior and convert it into repeatable, evidence-based quality checks.
• Hands‑on experience with Python and automated testing frameworks; confidence reading and contributing to production‑adjacent test code.
• Practical experience with REST APIs, JSON, schema/contract validation and test automation for distributed services.
• Experience with Git-based development, pull‑request review, issue tracking, CI/CD and technical documentation.
• Strong troubleshooting skills across application, service, network and device layers; comfortable working with logs, traces, and telemetry.
• Experience using AI‑assisted engineering tools responsibly to improve test design, automation, debugging and documentation.
• Ability to communicate defects and quality trade‑offs precisely, work independently and operate effectively when requirements evolve.

Bonus Points if You Have

• Experience with LLM evaluation frameworks, prompt testing, retrieval-augmented generation, tool/function calling, agents, or model-provider integration.
• Experience validating AI features in embedded, automotive, consumer-electronics, audio, mobile, or other connected-device environments.
• Experience with speech interfaces, text-to-speech, speech recognition, audio or media controls, personalization, or multimodal user experiences.
• Experience with cloud platforms and local/edge deployment, containers, service observability and test‑environment management.
• Experience with JavaScript or TypeScript, Bash, mobile‑app testing, or hardware‑in‑the‑loop/system‑integration testing.

What Success Looks Like

• AI-enabled user experiences are evaluated systematically before demos and releases, with clear evidence for expected and edge‑case behavior.
• High‑risk regressions in model behavior, prompt logic, orchestration, APIs and device integration are detected early.
• Test automation and evaluation assets become reusable, maintainable and part of delivery workflows.
• Engineering teams have an accurate, actionable view of quality risks, release readiness and known limitations.

Things To Know

• You have strong written and verbal communication skills in English.
• You can work at the Garching, Germany location.

What You Can Expect

• A hybrid work environment that balances flexibility with in‑person collaboration, with most office‑based roles onsite three days a week.
• Access to employee discounts on world‑class HARMAN and Samsung products (JBL, Harman Kardon, AKG and others).
• Learning and development opportunities through our award‑winning HARMAN University programs
• An inclusive and diverse work environment that fosters and encourages professional and personal development
• Work on best‑in‑class emerging technologies and an atmosphere that motivates you to give your best.

You Belong Here

HARMAN is committed to making every employee feel welcomed, valued, and empowered. No matter what role you play, we encourage you to share your ideas, voice your distinct perspective, and bring your whole self with you – all within a support‑minded culture that celebrates what makes each of us unique. We also recognize that learning is a lifelong pursuit and want you to flourish. We proudly offer added opportunities for training, development, and continuing education, further empowering you to live the career you want.

About HARMAN: Where Innovation Unleashes Next-Level Technology

Ever since the 1920s, we’ve been amplifying the sense of sound. Today, that legacy endures, with integrated technology platforms that make the world smarter, safer, and more connected.

Across automotive, lifestyle, and digital transformation solutions, we create innovative technologies that turn ordinary moments into extraordinary experiences. Our renowned automotive and lifestyle solutions can be found everywhere, from the music we play in our cars and homes to venues that feature today’s most sought‑after performers, while our digital transformation solutions serve humanity by addressing the world’s ever‑evolving needs and demands. Marketing our award‑winning portfolio under 16 iconic brands, such as JBL, Mark Levinson, and Revel, we set ourselves apart by exceeding the highest engineering and design standards for our customers, our partners and each other.

Important Notice: Recruitment Scams

Please be aware that HARMAN recruiters will always communicate with you from an '@harman.com', ‘@careers.harman.com’ or ‘harmanglobal.avature.net’ email address. We will never ask for payments, banking, credit card, personal financial information or access to your LinkedIn/email account during the screening, interview, or recruitment process. If you are asked for such information or receive communication from an email address not ending in one of the above email domains about a job with HARMAN, please cease communication immediately and report the incident to us through: [e-mail].

HARMAN is proud to be an Equal Opportunity employer. HARMAN strives to hire the best qualified candidates and is committed to building a workforce representative of the diverse marketplaces and communities of our global colleagues and customers. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. HARMAN attracts, hires, and develops employees based on merit, qualifications and job-related performance.(www.harman.com)