AI Automation QA Engineer – Autonomous Testing Platform

Harvard University; Massachusetts; Hybrid; USD 110,000 - 170,000; Full time

Benefits offered by this job

Parental leave

Health insurance

Retirement plans

Wellbeing resources

Family support

Tuition assistance

Commuter benefits

Job summary

Harvard University seeks an AI Automation Quality Engineer to advance the my.harvard portal testing with intelligent, agent-based approaches. You will design and implement AI agents that generate test assets, analyze code, and improve test coverage across Django, FastAPI, and frontend stacks.

The role combines software testing expertise with modern AI concepts, including RAG pipelines, LLMs, and CI/CD integration, and requires collaboration with BAs, developers, and product owners to deliver

Qualifications

• 3+ years building automated test frameworks for enterprise web applications
• Strong Python development experience
• Experience testing Django and/or FastAPI applications
• Experience with Playwright, Selenium, Cypress, pytest, or similar frameworks
• Experience using Jira and Agile development processes
• Understanding of Git workflows and CI/CD pipelines
• Experience working with LLMs, prompt engineering, and AI-assisted software development
• Understanding of Retrieval-Augmented Generation (RAG) and vector databases

Responsibilities

• Lead AI Automation Quality Engineer for the my.harvard portal, designing intelligent, agent-based testing capabilities
• Develop AI agents that read Jira stories and architecture docs to generate comprehensive test scenarios
• Analyze Django, FastAPI, and frontend code to generate high-coverage reusable tests
• Create RAG pipelines leveraging Jira, Confluence, Git, and API specs to improve quality
• Coordinate with BAs, developers, and product owners to validate automation work before code is produced
• Produce maintainable automated tests with Playwright, Selenium, pytest, or equivalent
• Capture feedback and defects to improve prompts and testing patterns
• Maintain regression suites, API tests, UI automation, and CI/CD integration

Skills

Automated testing

Python

Django/FastAPI

Playwright/Selenium/pytest

Jira/Agile

Git/CI-CD

LLMs/prompt engineering

RAG/embeddings

Education

Two years post-secondary education

Tools

Jira

Git

Job description

Harvard University seeks an AI Automation Quality Engineer to advance the my.harvard portal testing with intelligent, agent-based approaches. You will design and implement AI agents that generate test assets, analyze code, and improve test coverage across Django, FastAPI, and frontend stacks.

The role combines software testing expertise with modern AI concepts, including RAG pipelines, LLMs, and CI/CD integration, and requires collaboration with BAs, developers, and product owners to deliver