Test & Evaluation AI SME

Systems Planning & Analysis; Washington (District of Columbia); On-site; USD 170,000 - 200,000; Full time

Job summary

Systems Planning and Analysis, Inc. (SPA) seeks a Testing and Evaluation AI SME to support DHS programs in Washington, DC, delivering hybrid advisory services across AI T&E.

The role focuses on reviewing TEMPs, assessment plans, and reports, and mentoring government staff on AI evaluation standards. The ideal candidate will have an advanced degree, 10+ years of relevant experience, and an active Secret clearance, with demonstrated ability to develop AI T&E strategies and integrate them

Qualifications

• Advanced Degree or equivalent credits/certifications.
• 10+ years of relevant experience.
• Active Secret clearance.

Responsibilities

• Review and comment on revisions of program T&E documents and provide Government advice.
• Support multiple DHS acquisition programs, especially in capabilities that involve AI.
• Provide AI T&E expertise to assist the Government with ensuring that DHS acquisition programs generate suitable, executable T&E approaches that adequately assess the effectiveness, suitability, reliability, robustness, security, explainability, and operational risks of AI technologies embedded in technical solutions.
• Provide support, guidance, recommendations, and mentoring to all Deputy Directors regarding AI T&E and the development of DHS standards for evaluating embedded AI technologies, including reviews of program TEMPs, Operational Assessment/Test Plans, Operational Assessment/Test Reports, and Letters of Assessment.
• Provide support to the instructional advisor regarding the inclusion of AI T&E within the T&E curriculum.
• Provide, as directed, focused training on AI T&E.
• Research Government and industry acquisition and T&E sources and analyze results for applicable AI evaluation standards, tools, metrics, plans, and procedures.

Education

Advanced Degree

10+ years of experience

Active Secret clearance

AI T&E implementation strategies

Tools

TEMPs

Operational Assessment Plans

Job description

Overview

Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth,we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producingResults that Matter. Come work with the best! We offer opportunity, unique challenges, and clear-sighted commitment to the mission. SPA: Objective. Responsive. Trusted.

The Joint, Office of the Secretary of Defense, Interagency Division (JOID) provides expert support services to a range of customers spanning across the Department of Defense, Federal Civilian, and international markets. JOID provides a diverse portfolio of analytical and programmatic capabilities to help our customers make informed decisions on their most challenging issues.

The Critical Infrastructure Group (CIG) within JOID provides technical, programmatic and analytical support to customers with missions in national security to include the Department of Homeland Security (DHS), Health and Human Services (HHS), and the Federal Aviation Administration (FAA). The Group brings technical and operational expertise in fields of countering weapons of mass destruction, critical infrastructure protection, emergency response, nuclear non-proliferation, weapons deployment programs, and transportation safety. In addition to management and advisory services, CIG staff collaborate closely with our clients to provide high-quality modeling, simulation, software, and analytical products to meet the most demanding government standards and timelines.

We have a near-term need for a Testing and Evaluation Artificial Intelligence SME to provide hybrid support for DHS customers located in Washington, DC.

Responsibilities

The T&E Analyst will review and comment on revisions of program T&E documents and provide the Government advice. Support multiple DHS acquisition programs, especially in capabilities that involve AI. Provide AI T&E expertise to assist the Government with ensuring that DHS acquisition programs generate suitable, executable T&E approaches that adequately assess the effectiveness, suitability, reliability, robustness, security, explainability, and operational risks of AI technologies embedded in technical solutions. Provide support, guidance, recommendations, and mentoring to all Deputy Directors regarding AI T&E and the development of DHS standards for evaluating embedded AI technologies, including reviews of program TEMPs, Operational Assessment/Test Plans, Operational Assessment/Test Reports, and Letters of Assessment. Provide support to the instructional advisor regarding the inclusion of AI T&E within the T&E curriculum. Provide, as directed, focused training on AI T&E. Research Government and industry acquisition and T&E sources and analyze results for applicable AI evaluation standards, tools, metrics, plans, and procedures.

Qualifications

• Advanced Degree or equivalent credits/certifications.
• 10+ years of relevant experience.
• Active Secret clearance .
• Demonstrated skills and abilities to develop and implement strategies, standards, and methods to integrate AI T&E activities—including, but not limited to, data quality and representativeness assessments, AI performance and robustness testing, bias assessments, human-AI interaction evaluations, adversarial testing, and post-deployment monitoring—in support of acquisition programs, including, but not limited to, aviation, detection equipment, cybersecurity, information technology, decision-support systems, and autonomous systems.

Desired

• DHS T&E Level 3 equivalent certification.

Pay Range Information

At SPA, we strive to deliver a robust total compensation package that will attract and retain top talent.

• competitive base pay
• variable compensation opportunities

SPA provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health insurance, flexible spending accounts, health savings accounts, retirement savings plans, life and disability insurance programs, and a number of programs that provide for both paid and unpaid time away from work.

• health insurance
• flexible spending accounts
• health savings accounts
• retirement savings plans
• life and disability insurance programs
• a number of programs that provide for both paid and unpaid time away from work

Washington, DC, Pay Transparency Salary range: USD $170,000.00/Yr. - USD $200,000.00/Yr.