Training Manager / Computer Vision Annotation (Secret)

Figure Eight Federal Inc.; Arlington (VA); On-site; USD 80,000 - 110,000; Full time

Job summary

A leading company in AI training data is seeking a Training Manager to develop and optimize training programs for employees involved in the annotation of EO and SAR imagery. This role is crucial for ensuring compliance with U.S. regulations while improving the accuracy of AI-generated labels. Responsibilities include curriculum design, hands-on training, and the establishment of evaluation metrics. Applicants should possess at least a Bachelor's degree in a relevant field and have substantial experience in workforce development and AI technologies.

Benefits

Flexible working hours

Professional development opportunities

Comprehensive health benefits

Retirement plan with company matching

Qualifications

• 5-8 years of experience in quality control programs preferred.
• Expertise in performance assessment and continuous learning strategies.
• Ability to implement ethical labeling standards.

Responsibilities

• Lead training programs for data annotators on labeling techniques and accuracy.
• Coordinate with project managers to enhance automated validation scripts.
• Develop best practices for efficient annotation workflows following regulations.

Skills

Curriculum Development

Annotation Workflow Optimization

Training Program Management

Geospatial Analysis

Bias Mitigation Strategies

Education

Bachelor's degree in Geographic Information Science or related fields

Master’s degree in Geographic Information Science or related fields

Tools

Automated Annotation Tools

Deep Learning Segmentation Models

Job description

Figure Eight Federal (F8F): Leading the Future of AI Training Data

Figure Eight Federal (F8F) provides accurate and reliable human-annotated datasets that fuel AI and machine learning for some of the world’s biggest brands. With more than 25 years of industry knowledge, F8F’s technology powers many of the AI interactions we experience every day. Our solutions and expertise empower our clients to achieve their AI goals and make a significant impact in their industry.

The Training Manager will lead the development, implementation, and modernization of training programs for employees responsible for labeling and annotating EO and SAR imagery, including video formats. This role involves optimizing annotation workflows, developing best practices, maintaining high annotation accuracy, and ensuring compliance with project guidelines. The Training Manager will work closely with engineers, analysts, and policy experts to ensure that employees adhere to U.S. regulations and ethical standards governing AI-generated labels, including transparency, bias mitigation, and content authenticity.

Responsibilities:

1. Training & Development, providing structured training programs for data annotators, covering labeling techniques, accuracy improvement, and tool proficiency, using the latest F8F machine learning-powered annotation tools and automation platforms.
2. Design and modernize curricula for annotators to label and annotate EO/SAR imagery, including video formats.
3. Develop specialized training for machine-assisted automated object detection on SAR imagery, metadata tagging, and transparency labeling.
4. Coordinate with platform engineering, project managers, and specialists to improve automated validation scripts for bounding box, segmentation, and object classification tasks.
5. Provide hands-on training and mentorship to enhance workforce skills in automated image classification and AI-assisted video analysis.
6. Partner with analysts, pod leads, and data specialists to help design upskilling pathways based on review insights and align quality training with mission goals.
7. Implement continuous learning strategies, offering refresher courses on regulatory updates and technological advancements.
8. Establish evaluation metrics to measure employee proficiency in AI-assisted annotation techniques.
9. Ensure annotation approach is in compliance with President Biden’s Executive Order on AI (2023) and emerging federal/state laws governing AI-generated labels.
10. Implement watermarking and metadata requirements in training, following the 2024 bipartisan bill mandating AI-generated content disclosure.
11. Educate employees on bias mitigation, fairness in AI annotations, and consumer protection laws outlined by the FTC and customer requirements.
12. Process optimization to develop best practices for efficient annotation workflows and continuously refine labeling guidelines within conditions and standards.
13. Tool management and improvement, working alongside geospatial and AI experts to refine annotation guidelines and accuracy benchmarks, utilizing feedback loops on labeling tools and applications to enhance functionality.
14. Monitor industry trends and integrate advanced AI techniques for annotation into curriculum updates.
15. Stay informed on AI-driven innovations for video labeling and deepfake detection to enhance transparency.
16. Documentation & Reporting for audits and optimization, enhancing labeling procedures, generating reports on annotation performance metrics, and optimizing AI-assisted segmentation models for EO/SAR imagery.
17. Other duties as assigned.

Required Qualifications:

• Bachelor's degree in related fields like Geographic Information Science, Geospatial-Intelligence, Computer Vision, Artificial Intelligence, and 5 - 8 years of experience in quality control programs - or - HS Diploma or equivalent and 10+ years of experience in Geospatial Analysis, Geospatial Engineering, or Cartography.
• Proven ability to develop and modernize curriculum for annotators and/or AI-assisted labeling specialists.
• Strong background in workforce development and training program optimization.
• Deep understanding of EO/SAR imagery and geospatial analytics.
• Expertise in performance assessment and continuous learning strategies.
• Proficiency in automated annotation tools, deep learning segmentation models, and metadata tagging.
• Proficiency in reviewing labeled imagery, spatial annotation datasets, or structured data.
• Ability to implement ethical labeling and bias mitigation strategies in AI-based annotation.
• US Citizenship
• Active Secret clearance

Desired Qualifications:

• Master’s degree in related fields like Geographic Information Science, Geospatial-Intelligence, Computer Vision, Artificial Intelligence, and 15+ years of experience in Geospatial Engineering or GEOINT Operations - or - Bachelor's degree with 10+ years of relevant experience.
• Certifications in AI Ethics, Machine Learning, Geographic, Geospatial, or Regulatory Compliance (e.g., NIST AI Risk Management Framework, Certified GEOINT Professional, GIS Professional, ASPRS, GEOINT Professional).
• Extensive experience in AI-powered image and video annotation.
• Experience working with government agencies or defense-related AI imaging programs, IC data production standards, or government delivery workflows.
• Experience integrating FTC consumer protection laws and Biden’s AI Executive Order (2023) into training programs.
• Ability to incorporate AI advancements into training programs for image classification and video annotation.
• Familiarity with AI transparency laws at both federal and state levels.
• Knowledge of the 2024 bipartisan bill mandating watermarking and metadata embedding in AI-generated content.
• Engagement with NIST, MIT Media Lab, or AI ethics organizations to stay updated on best practices.
• Active TOP SECRET clearance

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.