AI/LLM Test Engineer: Performance & Safety

OPPO; Palo Alto (CA); On-site; USD 100,000 - 200,000; Full time

Benefits offered by this job

Competitive salary

Bonus

Long-term incentives

Equal opportunity workplace

Job summary

A leading tech company is seeking a full-time AI/LLM Test Engineer to evaluate the performance and safety of Large Language Models. In this critical role, you will innovate testing methodologies, ensure AI-powered features meet rigorous standards, and collaborate with cross-functional teams. Candidates should have a Bachelor's degree in a technical field, 1+ years of relevant experience, and proficiency in Python and testing frameworks. The position offers a competitive salary range of $100,000–$200,000 plus bonuses and benefits.

Qualifications

• 1+ years of experience in software testing or ML validation, with exposure to AI/ML systems.
• Experience with automated evaluation tools or LLM-specific test suites.
• Familiarity with cloud platforms (GCP, Azure, or AWS) and MLOps tooling.

Responsibilities

• Evaluate performance, reliability, and safety of LLMs in real-world scenarios.
• Develop automated test frameworks to evaluate LLM outputs.
• Collaborate with teams to define test requirements and acceptance criteria.

Skills

Meticulous testing

Innovation in testing methodologies

Python proficiency

Collaboration with engineering teams

Analytical skills

Education

Bachelor's degree in a technical field

Master's degree in AI or Machine Learning

Tools

PyTest

Selenium

Jupyter

Postman

Job description

A leading tech company is seeking a full-time AI/LLM Test Engineer to evaluate the performance and safety of Large Language Models. In this critical role, you will innovate testing methodologies, ensure AI-powered features meet rigorous standards, and collaborate with cross-functional teams. Candidates should have a Bachelor's degree in a technical field, 1+ years of relevant experience, and proficiency in Python and testing frameworks. The position offers a competitive salary range of $100,000–$200,000 plus bonuses and benefits.