GenAI Developer

Technology Ventures; McLean (VA); On-site; USD 140,000 - 180,000; Full time

Job summary

Technology Ventures seeks a seasoned AI-focused engineer to build agentic testing workflows and reference implementations that span UI, API, and service layers. You will define coverage standards, templates, and a scalable tagging strategy to support reporting and quality gates, while delivering GenAI-assisted reporting across multiple microservices.

You will integrate automated review gates into GitHub workflows and champion reusable, maintainable test code architecture with a strong emphasis

Qualifications

• 5+ years of experience with a strong AI development background.
• Hands-on experience building agentic workflows and automating testing using AI with tools such as GitHub Copilot and Claude.
• Ability to design agent workflows for requirements review and completeness validation, report generation, and quality gates.

Responsibilities

• Design and implement agentic testing patterns adopted by multiple teams.
• Create reference implementations (sample repos/templates) for test generation, maintenance, and failure analysis.
• Establish a standard architecture for test code organization across UI, API, and service layers.
• Define coverage standards, templates, and governance for test types and risk-based prioritization.
• Create scalable tagging/metadata strategy for reporting and quality gates.
• Build GenAI-assisted reporting across microservices and automate quality gates integrated into GitHub workflows.

Skills

GenAI / LLM + agentic development

Agentic testing

Prompting patterns

Structured outputs (JSON schemas)

Tools

GitHub Copilot

GitHub Actions

Playwright

GitHub APIs

Job description

Must Have Qualifications: Must have 5+ years of experience and a strong AI development background. Must have hands on experience building agentic workflows, automating testing using AI, and working with tools such as GitHub, Copilot, and Claude.

• Design and implement agentic testing patterns that can be adopted by multiple Underwriting teams (and later other domains).
• Create reference implementations (sample repos / templates) demonstrating:
  • Test generation assistance (from requirements, APIs, contracts, schemas)
  • Test maintenance assistance (auto-updating selectors/contracts, flaky test triage)
  • Failure analysis assistance (root cause suggestions, log correlation, defect drafting)
• Establish a standard architecture for test code organization, tagging, data management, and execution across UI + API + service layers.

2) Coverage standards, templates, and governance

• Define and publish coverage standards (what "good" looks like) including:
  • Minimum coverage expectations by service/component
  • Test type mix (unit vs API vs UI vs contract vs integration)
  • Risk-based prioritization and traceability to requirements
• Provide templates usable across teams:
  • Test case/spec templates (Gherkin-style or equivalent)
  • Definition of Ready / Definition of Done quality checklists
• Create a scalable tagging/metadata strategy (e.g., feature, service, risk, priority, data sensitivity) to support reporting and quality gates.

3) GenAI-assisted reporting and quality insights across microservices

• Build automated reporting that aggregates test + service data across multiple microservices, such as:
  • Service health signals (logs/metrics/traces if available)
  • Defect signals (issue tracker metadata if available)
  • Release readiness narratives
  • Failure clustering and trend analysis
  • "What changed?" insights (commit/PR correlation)
• Produce outputs consumable by engineering leadership and teams (dashboards, markdown summaries in PRs, artifacts in CI).

4) "Quality gates" via agents

• Build automated review agents that evaluate user stories/requirements for minimum required clarity and data before development/testing starts:
  • Required fields present (acceptance criteria, testable outcomes, data needs, dependencies)
  • Ambiguity detection and missing edge cases
  • Data/privacy considerations and environment needs
• Integrate gates into workflow (PR checks, issue templates, GitHub Actions) to reduce churn and rework.

Required Technical Skills (must-have)

GenAI / LLM + agentic development

• Hands-on experience building LLM-powered agents (tool-using, multi-step reasoning, guardrails).
• Experience with prompting patterns, structured outputs (JSON schemas), evaluation, and reducing hallucinations.
• Ability to design agent workflows for:
  • Requirements review and completeness validation
  • Report generation and summarization

GitHub platform + GHCP (Copilot) for engineering workflows

• Strong proficiency with GitHub Copilot in day-to-day development.
• Deep experience with GitHub platform capabilities:
  • GitHub Actions (CI/CD pipelines, reusable workflows, composite actions)
  • PR checks, branch protections, CODEOWNERS, templates
• Automation via GitHub APIs/webhooks (as needed)
• Advanced experience designing and implementing automation with:
  • Playwright (UI automation, selectors strategy, parallelization, trace/video artifacts)
• Strong understanding of test design and coverage:
  • Data setup/teardown strategies and test isolation

Cross-service reporting and data aggregation

• Proven ability to aggregate and normalize results from multiple microservices and multiple pipelines.
• Experience producing actionable automated reports (trend analysis, failure clustering, service correlation).

Automated requirements review agents

• Experience implementing automated checks that validate:
  • Required test data and environment dependencies
  • Non-functional requirements (performance, security, observability) when applicable

Deliverables / What success looks like (for the posting)

• A reusable agentic testing automation kit adopted by multiple teams.
• Published coverage standards + templates and onboarding documentation.
• A working GenAI-assisted reporting pipeline aggregating results across microservices.
• Automated quality gates integrated into GitHub workflows that measurably reduce story churn.