AI Automation Engineer L1

Wipro; Bellevue (WA); On-site; USD 100,000 - 180,000; Full time

Benefits offered by this job

Medical and dental benefits options

Disability insurance

Paid time off

Job summary

Wipro is seeking an AI testing engineer to design and build end-to-end testing frameworks and CI/CD pipelines for model validation.Responsibilities include performance testing under high concurrency and maintaining automated suites to verify agent behavior and API contracts after each release.

The role emphasizes building LLM evaluation pipelines for relevance, groundedness, and hallucination metrics, integrated into the CI/CD workflow, ensuring quality gates before deployments.

Qualifications

• Mandatory Skills: Enterprise Platform Engineering Python.
• Experience: 8-10 Years
• The compensation ranges from $100,000 to $180,000.

Responsibilities

• Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.

Skills

Enterprise Platform Engineering

Python

Job description

Job Description

• Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.

Job Description

• Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.

Mandatory Skills: Enterprise Platform Engineering Python.

Experience: 8-10 Years

The expected compensation for this role ranges from $100,000 to $180,000 .

Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience.

• Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.

Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.

Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.