AI-Powered QA Engineer for Autonomous Testing

Harvarduniversity; Cambridge (MA); On-site; USD 110,000 - 180,000; Full time

Job summary

Harvard University is seeking an AI Automation Quality Engineer to pioneer intelligent, autonomous QA for the my.harvard portal. You will design agents that read Jira stories, architecture docs, and business rules to generate comprehensive test scenarios across functional, API, and accessibility domains, while collaborating with analysts and developers.

Ideal candidates have strong Python and Django/FastAPI experience, along with hands-on familiarity with Playwright, Selenium, and CI/CD.

Qualifications

• 2+ years of post-secondary education or relevant work experience.
• Proficient Python development and automated testing experience.
• Experience with Django and FastAPI web applications.
• Familiar with Playwright, Selenium, Cypress, pytest, or similar tools.
• Strong Jira and Agile process knowledge.
• Understanding of Git workflows and CI/CD pipelines.
• Experience with LLMs, prompt engineering, and AI-assisted software development.
• Knowledge of retrieval-augmented generation (RAG), embeddings, and vector DBs.

Responsibilities

• Lead AI-driven QA strategy for the Harvard portal and beyond.
• Design AI agents to generate functional, integration, regression, accessibility, and API tests from requirements and docs.
• Build code-aware testing by analyzing Django/FastAPI/frontend codebases.
• Develop RAG pipelines leveraging Jira, Confluence, Git repos, API specs, and defect history.
• Establish human-in-the-loop validation with BAs and Product Owners before automation.
• Produce maintainable automated tests using Playwright, Selenium, pytest; prepare PRs.
• Capture feedback to improve prompts, testing patterns, and agent performance.

Skills

Python

Test automation

Django

FastAPI

Playwright

Selenium

pytest

Jira

CI/CD

LLMs

RAG

AI testing

Git

Agent frameworks

Education

Two years post-secondary education

Tools

GitHub Copilot

LangGraph

CrewAI

AutoGen

Semantic Kernel

Pinecone

pgvector

Chroma

Weaviate

OpenTelemetry

Job description

Harvard University is seeking an AI Automation Quality Engineer to pioneer intelligent, autonomous QA for the my.harvard portal. You will design agents that read Jira stories, architecture docs, and business rules to generate comprehensive test scenarios across functional, API, and accessibility domains, while collaborating with analysts and developers.

Ideal candidates have strong Python and Django/FastAPI experience, along with hands-on familiarity with Playwright, Selenium, and CI/CD.