AI/ML Quality Assurance Scientist – Data & Tradecraft Lead

Analytic Services Inc.; Washington (District of Columbia); On-site; USD 143,000 - 207,000; Full time

Job summary

ANSER is seeking a Senior Computer Scientist to support AI/ML Quality Assurance Framework (QAF) efforts by integrating mathematics, statistics, AI, and data science techniques to produce analytic insights from intelligence data.

The role focuses on reviewing QAF documentation, developing data mining algorithms, and providing guidance on best practices for AI system development, testing, and tradecraft compliance. A TS/SCI clearance is required.

Qualifications

• Active TS/SCI clearance with the ability to obtain and maintain a polygraph.
• Master’s degree in Data Science, Computer Science, Statistics, Mathematics, or related technical field.
• Twelve or more years of experience in data science, analytics, or machine learning.
• Proficiency in Python, R, and SQL, and experience with data visualization tools such as Power BI or Tableau.
• Strong experience with predictive modeling, data mining, statistical analysis, and ML algorithms.
• Experienced with knowledge graphs, semantic data modeling, and query languages (e.g., SPARQL, GraphQL).
• Experience developing, implementing, and evaluating AI/ML models for analytic efficiency and tradecraft compliance.

Responsibilities

• Review and evaluate QAF documentation submitted by AA owners to ensure compliance with tradecraft standards and best practices in AI system development and deployment.
• Assess QAF documentation for completeness, accuracy, and thoroughness, and provide detailed feedback to AA owners and developers.
• Develop and utilize data mining algorithms based on open-source capabilities. Integrates or codes algorithms to support Government intelligence search and discovery missions.
• Make best practice recommendations on managing data within hardware, software, storage, and bandwidth constraints.
• Assist in maintaining a repository of QAF documentation to facilitate knowledge sharing and best practices across the organization.
• Provide consultation and guidance to AA owners, developers, and stakeholders on the QAF process, including best practices for AI system development, testing, and deployment.
• Collaborate with AA owners and developers to identify and address potential issues or gaps in QAF documentation.
• Develop and deliver training materials and workshops to educate AA owners, developers, and stakeholders on the QAF process and its application in AI system development.
• Assist analytic methodologists and AA owners in translating technical documentation into analytic tradecraft compliant language.
• Collaborate with stakeholders to develop, implement, and refine best practices for translating technical documentation into tradecraft compliant language.
• Review and edit translated documentation to ensure accuracy, completeness, and adherence to tradecraft standards.
• Support capability development by contributing, editing, and storing code in Government owned/controlled source version control repositories.
• Employ data science techniques to support predictive analysis across the Defense Intelligence Enterprise (DIE).

Skills

Python

R

SQL

Power BI

Tableau

Predictive modeling

Data mining

Statistical analysis

ML algorithms

Knowledge graphs

SPARQL

GraphQL

Education

Master's degree in Data Science/CS/Statistics/Math

Tools

Power BI

Tableau

Job description

ANSER is seeking a Senior Computer Scientist to support AI/ML Quality Assurance Framework (QAF) efforts by integrating mathematics, statistics, AI, and data science techniques to produce analytic insights from intelligence data.

The role focuses on reviewing QAF documentation, developing data mining algorithms, and providing guidance on best practices for AI system development, testing, and tradecraft compliance. A TS/SCI clearance is required.