AI Automation Engineer

Wipro; Bellevue (WA); On-site; USD 100,000 - 180,000; Full time

Benefits offered by this job

Medical and dental benefits

Paid time off

Disability insurance

Job summary

Wipro Bellevue, WA seeks an AI Automation Engineer to design end-to-end AI testing frameworks, focusing on model evaluation and reliability. You will build tests that cover unit, functional, integration, and regression scenarios across AI components.

Responsibilities include load and performance testing for high concurrency, developing LLM evaluation pipelines, and ensuring quality gates before deployments, in collaboration with global teams.

Qualifications

• LLM evaluation frameworks experience.
• Hands-on experience with AI automation frameworks using Python PyTest and Unittest.
• Experience with load and performance testing using Locust or JMeter.

Responsibilities

• Design end-to-end AI testing frameworks across unit, functional, and integration tests.
• Develop load testing to validate scalability and latency SLAs under peak load.
• Build LLM evaluation pipelines and integrate into CI/CD workflows.

Skills

LLM Evaluation frameworks

Python PyTest

Unittest

Tools

Locust

JMeter

Job description

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com.

Job Description

Job Title: AI Automation Engineer

Location: Bellevue (Seattle area), WA

Job Description:

• Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.

Must Have Skills:

• Experience with LLM Evaluation frameworks like Promptfoo, DeepEval, Ragas etc
• Handon experience with AI Automation frameworks using Python PyTest, Unittest
• Experience with Load and performance testing using Locust, Jmeter etc.

Good to have skills

• AIOps/MLOps knowledge
• Observability for AI
• Experience working on projects for Telecom operators like T-Mobile, AT&T, Verizon or OSS/BSS area,

Experience

• Overall IT experience: Minimum 10 years
• AI Experience- 3 Years

Soft Skills

• Ability to work in fast-paced, multi-disciplinary, data-driven environments.
• Work closely with offshore teams with some overlap with IST.
• Excellent stakeholder management

Mandatory Skills: Autonomous Network AI Engineering.Experience: 8-10 Years.

The expected compensation for this role ranges from $100,000 to $180,000 .Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.

Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, caste, creed, religion, gender, marital status, age, ethnic and national origin, gender identity, gender expression, sexual orientation, political orientation, disability status, protected veteran status, or any other characteristic protected by law.

Wipro is committed to creating an accessible, supportive, and inclusive workplace. Reasonable accommodation will be provided to all applicants including persons with disabilities, throughout the recruitment and selection process. Accommodations must be communicated in advance of the application, where possible, and will be reviewed on an individual basis. Wipro provides equal opportunities to all and values diversity.