AI QA Engineer - LLM Testing & Debugging (Onsite, Plano)

Ektello; Plano (TX); On-site; USD 43,000 - 52,000; Full time

Job summary

We are seeking a detail-oriented AI Quality Assurance Engineer to drive end-to-end testing and validation of AI features and LLM integrations on-site in Plano, TX. Candidate must be proficient in English and Korean, with a BS in a technical field and 1–3 years QA experience.

You will design prompt-based tests, analyze logs, report defects, and collaborate with cross-functional teams to ensure high-quality user experiences in a fast-paced SDLC.

Qualifications

• BS in Computer Science, Computer Engineering, Data Science, or related technical field.
• 1–3 years of software QA experience with test plan creation, manual/automated test execution, defect tracking, and SDLC quality management lifecycles.
• Familiarity with AI systems, LLMs, and prompt engineering tools is highly desirable.
• Experience with automated prompt validation or scripting tools is a plus.
• Professional business proficiency in English and Korean (speaking, reading, writing).
• Desirable experience in Mobile/Telecom industry.

Responsibilities

• AI Feature Execution & Validation: Execute end-to-end testing and validation of new AI features to ensure functional accuracy, reliability, alignment with product requirements, and seamless UX integration prior to release.
• LLM & Prompt Testing: Design, run, and evaluate prompt-based test scenarios to ensure consistent language model outputs; automate prompt validation where possible.
• Defect Management & Debugging: Identify, document, and report performance, usability, and accessibility bugs with clear user-impact assessments; perform root-cause debugging and log analysis.
• Usability & Benchmarking: Conduct multi-platform usability testing to identify friction points and accessibility issues; support QA benchmarking and data-driven feedback.
• Project Execution & Collaboration: Manage and execute multiple projects under QA practices; build rapport with cross-functional teams.

Skills

Analytical thinking

Problem solving

Debugging

Log analysis

Communication skills

AI/LLM familiarity

Prompt engineering tools

Automation scripting

Education

BS in Computer Science/Engineering/Data Science

Tools

Prompt validation tooling

Scripting tools

Job description

We are seeking a detail-oriented AI Quality Assurance Engineer to drive end-to-end testing and validation of AI features and LLM integrations on-site in Plano, TX. Candidate must be proficient in English and Korean, with a BS in a technical field and 1–3 years QA experience.

You will design prompt-based tests, analyze logs, report defects, and collaborate with cross-functional teams to ensure high-quality user experiences in a fast-paced SDLC.