Applied AI Engineer – Test & Evaluation (T&E)

Canvas II, LLC.; Tennessee; On-site; USD 120,000 - 150,000; Full time

Job summary

Canvas II, LLC. is seeking an AI-focused engineer to identify and improve T&E workflows with AI, build AI assistants, and prototype automation tools. The role involves testing planning, data readiness evaluation, and translating needs into concrete prototypes and implementation plans.

You will evaluate AI platforms, liaise with vendors, and support adoption through demos and training. A DoD Secret clearance is required or attainable, with on-site work at Arnold Air Force Base in Tennessee.

Qualifications

• Bachelor’s degree in a technical discipline or related field.
• 3+ years of experience in applied AI, ML, data engineering, software development, automation, analytics, knowledge management, or digital transformation.
• Experience with AI tools, large language models, retrieval-augmented generation, or similar technologies.
• Familiarity with data ingestion, database management, storage, metadata, search, retrieval, access control, and data-quality concepts.
• Experience developing or supporting AI assistants, agents, automated workflows, or knowledge-management tools.

Responsibilities

• Identify T&E and engineering workflows where AI, automation, analytics, or digital tools can improve efficiency or decision-making.
• Build and prototype AI assistants, agents, retrieval-based knowledge tools, and workflow automations.
• Support applications including test planning, procedure development, test-report drafting and review, insight extraction from test data and reports, and training/how-to development.
• Assess data and system readiness for ingesting, organizing, securing, searching, and analyzing large technical datasets and document collections.
• Translate user needs into technical requirements, prototypes, and implementation plans.
• Evaluate AI tools, platforms, vendors, and external development efforts for feasibility, scalability, security considerations, and mission fit.
• Serve as a technical point of contact for outsourced AI or digital-modernization work, including requirements development, deliverable review, and technical risk identification.
• Support user adoption through working groups, demonstrations, training materials, and clear communication with technical and nontechnical stakeholders.

Job description

Key Responsibilities

Identify T&E and engineering workflows where AI, automation, analytics, or digital tools can improve efficiency or decision-making. Build and prototype AI assistants, agents, retrieval-based knowledge tools, and workflow automations. Support applications including test planning, procedure development, test-report drafting and review, insight extraction from test data and reports, and training/how-to development. Assess data and system readiness for ingesting, organizing, securing, searching, and analyzing large technical datasets and document collections. Translate user needs into technical requirements, prototypes, and implementation plans. Evaluate AI tools, platforms, vendors, and external development efforts for feasibility, scalability, security considerations, and mission fit. Serve as a technical point of contact for outsourced AI or digital-modernization work, including requirements development, deliverable review, and technical risk identification. Support user adoption through working groups, demonstrations, training materials, and clear communication with technical and nontechnical stakeholders.

Minimum Qualifications

Bachelor’s degree in a technical discipline, such as computer science, engineering, data science, information systems, or mathematics; equivalent experience may be considered. 3+ years of relevant experience in applied AI, machine learning, data engineering, software development, automation, analytics, knowledge management, or digital transformation. Experience with AI tools, large language models, retrieval-augmented generation, intelligent automation, or similar technologies. Familiarity with data ingestion, database management, storage, metadata, search, retrieval, access control, and data-quality concepts. Experience developing or supporting AI assistants, agents, automated workflows, or knowledge-management tools. Ability to work on-site at or in support of Arnold Air Force Base, as required. Must be able to obtain a DoD Secret security clearance.

Preferred Qualifications

Experience supporting DoD, federal, aerospace, defense, laboratory, engineering, or test organizations. Familiarity with T&E processes, test planning, test execution, test-data management, engineering analysis, or technical reporting. Experience applying AI or automation to technical data, reports, procedures, requirements, or engineering workflows. Familiarity with Python, SQL, APIs, low-code/no-code automation tools, or system-integration approaches. Experience evaluating third-party technical solutions, managing vendors, or serving as a technical liaison for contracted development. Experience leading working groups, technology adoption efforts, digital-transformation initiatives, or user training. Has active DoD security clearance.

Canvas was founded by Jami Peyton in 2007 to deliver real-world engineering and technology solutions that strengthen national defense. Since then, we’ve been guided by technical excellence, operational insight, and a shared commitment to the warfighter. Teamwork drives everything we do, enabling close collaboration across programs, customers, and colleagues to solve complex challenges. Our work supports key national security priorities like missile defense, test and evaluation, digital transformation, and warfighter readiness. As an award-winning company built on integrity, agility, and innovation, Canvas continues to grow and deliver mission-critical solutions that support the future of national defense.