QA/Pilot Test Lead

imagineeer LLC; Washington (District of Columbia); On-site; USD 120,000 - 150,000; Full time

Job summary

Imagineeer is seeking a QA/Pilot Test Lead to design and run a comparative pilot of two commercial acquisition tools for a federal civilian department. Both tools are tested in parallel against common baselines, and your measurements will guide the client’s implementation decision.

You will work in a FedRAMP-authorized cloud environment with synthetic data and interfaces such as AMS/PRISM, FPDS-NG, and SAM.gov, and lead a pilot team through plan, execution, and reporting.

Qualifications

• Requires 6+ years in software testing or QA with test planning leadership.
• Experience designing baseline and performance measures for pilots or UAT.
• Experience testing commercial SaaS products and integrations.

Responsibilities

• Design baseline measures with Pilot Test Engineer.
• Author Pilot Test Plan by Day 105 and update within 10 business days of tool selection.
• Support vendor demonstrations using synthetic data and scoring rubric.
• Lead data collection and compare results to baseline.
• Validate configurations before and during the pilot and during implementation.
• Contribute pilot results to biweekly status reports and implementation recommendations.
• Work with sandbox in a FedRAMP-authorized cloud region and synthetic interfaces.

Skills

QA/testing leadership

Test planning

Baseline/perf measures

SaaS testing

Education

Bachelor's degree in CS/Engineering

Job description

Imagineeer is seeking a QA/Pilot Test Lead to design and run a comparative pilot of two commercial acquisition tools for a federal civilian department. Both tools are tested in parallel against common baselines, and your measurements will be the evidence behind the client's implementation decision.

Key Responsibilities

• Design baseline measures (e.g., cycle time, errors and rework, workforce burden) with the Pilot Test Engineer.
• Author the tool-agnostic Pilot Test Plan by Day 105 and update it with tool-specific content within 10 business days of tool selection.
• Support vendor capability demonstrations using a common synthetic dataset and scoring rubric.
• Lead quantitative and qualitative data collection for both tools and compare results to baseline.
• Validate configurations before and during the pilot and during implementation.
• Contribute pilot results to biweekly pilot status reports and the Pilot Results and Implementation Recommendations Report.
• Work with The contractor-provided sandbox in a FedRAMP-authorized cloud region, with mock AMS/PRISM, FPDS-NG, and SAM.gov interfaces and synthetic data

Qualifications and Skills

• Bachelor's degree in computer science, engineering, or a related field.
• 6 or more years of software testing or QA experience, including test planning and leading test teams.
• Experience designing baseline and performance measures for technology pilots or user acceptance testing.
• Experience testing commercial SaaS products and integrations.

Desired Skills and Competencies

• ISTQB Advanced Level Test Manager or equivalent certification.
• Experience with comparative or side-by-side product evaluations in federal settings.
• Experience testing acquisition or financial management systems.

Additional Information

Employment for this position is contingent upon the candidate being a United States citizen and having the ability to successfully obtain and maintain a Public Trust clearance, in accordance with applicable federal regulations. We use AI to review resumes. All hiring decisions will be made in compliance with applicable federal, state, and local laws and regulations

Equal Opportunity Employer

We are an Equal Opportunity Employer and do not discriminate in employment decisions on the basis of race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other status protected by applicable federal, state, or local laws. All employment decisions are based on business needs, job requirements, and individual qualifications.

Imagineeeris a fast-growing SBA 8(a) Small Disadvantaged Business headquartered in Arlington, VA, delivering federal AI modernization across health, defense, homeland security, and transportation. We design, test, and deploy secure, AI-ready systems that move agencies from pilots to production without breaking governance, compliance, or mission continuity. Our Mission Studio model creates shared environments where policy, data, security, and operations come together. We are capability-driven and competitive by design, not program-dependent. Our leadership hasoperatedinside the federal systems we now transform, bringing institutional knowledge that accelerates delivery and reduces risk. If real delivery motivates you more than slides, and you want your work to compound across programs and agencies,Imagineeeris growing and we are building the team to match.