Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer

Penn State University; United States; On-site; USD 191,000 - 319,000; Full time

Job summary

Penn State University’s Applied Research Laboratory (ARL) in the All-Domain Analytics and Signatures Office seeks an AI/ML Engineer to lead IV&V and Data Curation Center of Excellence. You will guide data labeling, governance, and pipeline design across classified and open data, coordinating with researchers and sponsors in a DoD-aligned environment.

The role emphasizes scalable data workflows, automation, and collaboration within an agile research team, with offices in State College, PA or

Qualifications

• Bachelor’s degree in CS, Data Science, Information Science, Engineering or related field.
• Extensive experience designing and managing data curation, annotation, or IV&V workflows for AI/ML systems.
• Deep understanding of machine learning fundamentals and data quality impact on training, evaluation and deployment.
• Strong Python and SQL skills for data manipulation, pipeline development and analysis.
• Experience with data annotation tools (CVAT, Label Studio).
• Proven ability to work in cross-functional, collaborative environments.

Responsibilities

• Serve as technical lead for IV&V and Data Curation Center of Excellence, setting priorities and standards.
• Mentor and coordinate engineers performing data labeling, annotation, and IV&V across modalities.
• Establish data governance frameworks and QA processes for reproducibility at scale.
• Design and oversee data pipelines for ingestion, transformation, QC, and cataloging.
• Lead IV&V efforts on datasets and model outputs with acceptance criteria.
• Translate data needs into actionable plans for scientists and developers.
• Present findings and recommendations to leadership and sponsors.

Skills

Python

SQL

Data curation

IV&V workflows

Data labeling

Data governance

Education

Bachelor’s degree in CS/DS/IS/Engineering

Tools

CVAT

Label Studio

Docker

Kubernetes

AWS

Azure

DVC

LakeFS

Job description

Position specifics

We are searching for a talented, experienced, organized, and a highly motivated AI/ML Engineer to join the Visualization and Decision Support Division within the All-Domain Analytics and Signatures Office (A2SO) at the Applied Research Laboratory (ARL) at Penn State. You will lead our Independent Verification and Validation (IV&V) and Data Curation Center of Excellence.

This position can be filled in State College, PA or Reston, VA.

ARL is an authorized DoD SkillBridge partner and welcomes all transitioning military members to apply.

You will:

• Serve as the technical lead for the IV&V and Data Curation Center of Excellence, setting priorities, defining standards, and driving the team's technical direction
• Mentor, guide, and coordinate a team of engineers performing data labeling, annotation, curation, and IV&V across multiple data modalities
• Establish and evolve annotation standards, labeling guidelines, data governance frameworks, and quality assurance processes to ensure consistency and reproducibility at scale
• Design and oversee data pipelines for ingestion, transformation, quality control, and cataloging of classified and open-source data
• Lead IV&V efforts on datasets and model outputs, defining acceptance criteria and fitness-for-use standards
• Serve as the primary point of contact between the data curation team and research scientists, algorithm developers, and program stakeholders to translate data needs into actionable plans
• Present findings, status, and recommendations to leadership and sponsors through well-constructed briefings, papers, and technical artifacts
• Evaluate and introduce tools, platforms, and best practices for annotation (e.g., CVAT, Label Studio), data versioning, and metadata management
• Drive automation of manual data analysis and curation processes to improve efficiency and scalability
• Architect and maintain data catalogs, metadata schemas, and access-controlled repositories that make curated datasets discoverable and accessible to the broader research team
• Work within an Agile development environment within a large research team

Required Skills/Experience areas include:

• Bachelor's Degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field
• Extensive experience designing and managing data curation, annotation, or IV&V workflows for AI/ML systems
• Deep understanding of machine learning fundamentals, including how data quality, labeling strategies, and dataset composition impact model training, evaluation, and deployment
• Strong proficiency in Python and SQL for data manipulation, pipeline development, and analysis
• Experience with data annotation tools and platforms (e.g., CVAT, Label Studio, or equivalent)
• Success in environments where various forms of communication and organizational skills were crucial to be effective

Preferred Skills/Experience areas include:

• Prior experience leading or managing a technical team
• Experience working with DoD or Intelligence Community data, workflows, or operational environments
• Familiarity with geospatial data formats (shapefiles, GeoJSON, AIS), imagery/FMV exploitation, or signals data processing
• Experience with data versioning tools (e.g., DVC, LakeFS) or data catalog platforms
• Knowledge of IV&V methodologies and test and evaluation practices for data-driven systems
• Experience with containerized development environments (Docker, Kubernetes) and cloud platforms (AWS, Azure)
• Master’s degree or higher in a relevant field
• Current eligibility to access classified information at the Top Secret/ SCI level or higher and may be subject to a government background investigation to updated clearance eligibility, if required

Minimum education, work experience & required certifications

• If filled as R&D Engineer - Artificial Intelligence (ARL) - Principal Professional, this position requires: Bachelor’s Degree - Engineering or Science 19+ years of relevant experience Required Certifications: None
• If filled as R&D Engineer - Artificial Intelligence (ARL) - Senior Professional, this position requires: Bachelor’s Degree - Engineering or Science 14+ years of relevant experience Required Certifications: None

Background checks/clearances

Employment with the University will require successful completion of background check(s) in accordance with University policies.

Notice regarding employment at the Applied Research Laboratory (ARL): Employees must be eligible to obtain a government security clearance, participate in the ARL drug testing program, and comply with electronic and physical monitoring requirements applicable to federal contractors.

ARL operates in a secure information environment involving Unclassified, Controlled Unclassified Information (CUI), and Classified information.

Personal electronic devices brought onsite must be registered and may be restricted from certain areas.

You must be a U.S. citizen to apply.

Salary & benefits

The salary range for this position, including all possible grades, is $168,000.00 - $318,840.00. This salary range includes an adjustment based on required geographic work location.

Salary structure - information on Penn State's salary structure Penn State provides a competitive benefits package for full-time employees designed to support both personal and professional well-being. In addition to comprehensive medical, dental, and vision coverage, employees enjoy robust retirement plans and substantial paid time off which includes holidays, vacation and sick time. One of the standout benefits is the generous 75% tuition discount, available to employees as well as eligible spouses and children. For more detailed information, please visit our Benefits Page.

Campus security crime statistics

Pursuant to the Jeanne Clery Disclosure of Campus Security Policy and Campus Crime Statistics Act and the Pennsylvania Act of 1988, Penn State publishes a combined Annual Security and Annual Fire Safety Report (ASR). The ASR includes crime statistics and institutional policies concerning campus security, such as those concerning alcohol and drug use, crime prevention, the reporting of crimes, sexual assault, and other matters. The ASR is available for review here.

EEO is the law

Penn State is an equal opportunity employer and is committed to providing employment opportunities to all qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. If you are unable to use our online application process due to an impairment or disability, please contact 814-865-1473.

There's a reason Penn State consistently ranks among the top one percent of the world’s universities. Across 24 campuses, our 100,000 students and 40,000 faculty and staff know the real measure of success goes beyond the classroom – it’s the positive impact made on communities across the world. Our ideals stem from our origins as Pennsylvania’s sole land-grant institution, which allow us to continue to bring positive impact to humanity through our teaching, research, and engagement mission. And across the world is a community of Penn Staters – more than half a million strong – driven by that same spirit to serve our local and global communities. At Penn State, passion is met with collaboration in an environment that is rooted in shared pride for the accomplishments of our fellow students, faculty, staff, and alumni. Penn Staters cheer each other on to build a culture committed to service and engagement. Our University values represent our core ethical aspirations for all our daily activities and actions as students, faculty, staff, and volunteers at Penn State. Our values are as follows; Integrity, Respect, Responsibility, Discovery, Excellence, and Community. We Are Penn State. One Community. Impacting Many.