Artificial Intelligence / Machine Learning Verification and Validation Engineer

Dreamwork

State College (Centre County)

On-site

USD 92,000 - 201,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Healthcare coverage
Retirement plans
Paid time off

Job summary

Penn State's Applied Research Laboratory seeks an AI/ML Engineer to join the IV&V and Data Curation Center of Excellence. You will work with classified multi-modal data and build pipelines, annotation standards, and QA processes while engaging with researchers and program stakeholders.

The role emphasizes data governance, reproducibility, and responsible AI practices in an Agile, team-based environment. On-site in State College, PA or Reston, VA; TS/SCI eligibility may apply.

Qualifications

  • Bachelor's degree in a technical field such as CS/DS/IS/Engineering.
  • Proficiency in Python and SQL for data manipulation and pipelines.
  • Familiarity with data annotation tools such as CVAT or Label Studio.

Responsibilities

  • Label, annotate, and curate multi-modal datasets (imagery, geospatial, signals, text) for AI/ML development.
  • Design data pipelines for ingestion, transformation, quality control, and cataloging of data.
  • Develop and maintain annotation standards, labeling guidelines, and data governance processes.
  • Conduct IV&V of datasets and model outputs to ensure data integrity and fitness for use.
  • Collaborate with researchers, developers, and stakeholders to identify data requirements.
  • Build and maintain data catalogs, metadata schemas, and access-controlled repositories.
  • Use Python, SQL, and annotation platforms to automate labeling workflows and analyze data.
  • Document data provenance, lineage, and limitations to support reproducibility.
  • Collaborate within an Agile development environment as part of a large research team.

Skills

Python
SQL
Data manipulation
Annotation tools
ML concepts

Education

Bachelor's degree (technical)

Tools

CVAT
Label Studio

Job description

POSITION SPECIFICS

We are searching for a talented, experienced, organized, detail-oriented, and highly motivated AI/ML Engineer to join our Independent Verification and Validation (IV&V) and Data Curation Center of Excellence in the Information Science Division within the All-Domain Analytics and Signatures Office (A2SO) at the Applied Research Laboratory (ARL). This team serves as the foundation for effective machine learning—building, curating, and governing the data that directly determines whether AI/ML models succeed in operationally relevant environments. You will focus on hands‑on work with classified multi-modal data, including imagery/FMV, geospatial and AIS tracks, signals and sensor data, and text‑based intelligence reports and develop pipelines, annotation frameworks, and quality assurance processes while gaining deep exposure to state‑of‑the‑art AI/ML research.

ARL is an authorized DoD Skillbridge partner and welcomes all transitioning military members to apply.

Responsibilities
  • Label, annotate, and curate multi‑modal datasets (imagery/FMV, geospatial, signals, text/documents) to support AI/ML model development and evaluation
  • Design and implement data pipelines for ingestion, transformation, quality control, and cataloging of classified and open‑source data
  • Develop and maintain annotation standards, labeling guidelines, and data governance processes to ensure consistency and reproducibility across projects
  • Conduct IV&V of datasets and model outputs to ensure data integrity, label accuracy, and fitness for intended use
  • Collaborate with research scientists, algorithm developers, and program stakeholders to identify, acquire, and prioritize data requirements for specific AI/ML projects
  • Build and maintain data catalogs, metadata schemas, and access‑controlled repositories that make curated datasets discoverable and accessible to the broader research team
  • Employ Python, SQL, and annotation platforms (e.g., CVAT, Label Studio) to automate labeling workflows, perform exploratory data analysis, and develop quality metrics
  • Document data provenance, lineage, and known limitations to support model evaluation, reproducibility, and responsible AI practices
  • Collaborate within an Agile development environment as part of a large research team
Required Skills/Experience areas
  • Bachelor's Degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field
  • Proficiency in Python and SQL for data manipulation, analysis, and pipeline development
  • Familiarity with data annotation tools and workflows (e.g., CVAT, Label Studio, or equivalent)
  • Understanding of machine learning concepts, including how data quality impacts model training, evaluation, and deployment
Preferred Skills/Experience areas
  • Experience working with DoD or Intelligence Community data, workflows, or operational environments
  • Familiarity with geospatial data formats (shapefiles, GeoJSON, AIS), imagery/FMV exploitation, or signals data processing
  • Experience with data versioning tools (e.g., DVC, LakeFS) or data catalog platforms
  • Knowledge of IV&V methodologies and quality assurance practices for data‑driven systems
  • Exposure to containerized development environments (Docker, Kubernetes) and cloud platforms (AWS, Azure)
  • Current eligibility for access to classified information at the TS/SCI level or higher and may be subject to a government background investigation to upgrade clearance eligibility, if required
Location

Your working location will be fully on‑site, located in State College, PA or Reston, VA . Questions related to flexible work should be directed to the hiring manager during the interview process.

Minimum Education, Work Experience & Required Certifications

If filled as R&D Engineer - Artificial Intelligence (ARL) - Advanced Professional, this position requires:Bachelor's Degree - Engineering or Science5+ years of relevant experienceRequired Certifications:NoneIf filled as R&D Engineer - Artificial Intelligence (ARL) - Intermediate Professional, this position requires:Bachelor's Degree - Engineering or Science2+ years of relevant experienceRequired Certifications:NoneIf filled as R&D Engineer - Artificial Intelligence (ARL) - Professional, this position requires:Bachelor's Degree - Engineering or ScienceNo prior relevant work experience requiredRequired Certifications:None

ARL’s purpose

ARL’s purpose is to research and develop innovative solutions to challenging scientific, engineering, and technology problems in support of the Navy, the Intel Community (IC), and other federal government customers.

Salary & Benefits

The salary range for this position, including all possible grades, is $92,100.00 - $200,808.00.

Salary Structure - Information on Penn State’s salary structure

Penn State provides a competitive benefits package for full‑time employees designed to support both personal and professional well‑being.

  • comprehensive medical, dental, and vision coverage
  • robust retirement plans
  • substantial paid time off which includes holidays, vacation and sick time
  • generous 75% tuition discount, available to employees as well as eligible spouses and children
Background Checks/Clearances

Employment with the University will require successful completion of background check(s) in accordance with University policies.

Notice regarding employment at the Applied Research Laboratory (ARL)

Employees must be eligible to obtain a government security clearance, participate in the ARL drug testing program, and comply with electronic and physical monitoring requirements applicable to federal contractors. ARL operates in a secure information environment involving Unclassified, Controlled Unclassified Information (CUI), and Classified information. Personal electronic devices brought onsite must be registered and may be restricted from certain areas. You must be a U.S. citizen to apply.

EEO IS THE LAW

Penn State is an equal opportunity employer and is committed to providing employment opportunities to all qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. If you are unable to use our online application process due to an impairment or disability, please contact 814-865-1473.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Artificial Intelligence / Machine Learning Verification and Validation Engineer
Artificial Intelligence / Machine Learning Verification and Validation Engineer

The Applied Research Laboratory at Penn State University • Reston (VA)

On-site
USD 111,000 - 241,000
75% tuition discount
Artificial Intelligence / Machine Learning Verification and Validation Engineer
Artificial Intelligence / Machine Learning Verification and Validation Engineer

The Applied Research Laboratory at Penn State University • University Park (TX)

On-site
USD 92,000 - 201,000
75% tuition discount
Robust retirement plans
Paid time off
Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer
Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer

Penn State University • University Park (TX)

On-site
USD 140,000 - 266,000
Artificial Intelligence / Machine Learning Verification and Validation Engineer
Artificial Intelligence / Machine Learning Verification and Validation Engineer

Penn State University • University Park (IL)

On-site
USD 92,000 - 201,000
75% tuition discount
Artificial Intelligence / Machine Learning Research and Development Engineer
Artificial Intelligence / Machine Learning Research and Development Engineer

Applied Research Laboratory at the Penn State University • University Park (FL)

On-site
USD 146,000 - 319,000
Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer
Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer

The Pennsylvania State University • Struble (PA)

On-site
USD 140,000 - 266,000
75% tuition discount
Health and retirement benefits
Competitive leave
Artificial Intelligence / Machine Learning Verification and Validation Engineer
Artificial Intelligence / Machine Learning Verification and Validation Engineer

The Pennsylvania State University • State College

On-site
USD 92,000 - 201,000
Health benefits
75% tuition discount
Retirement plans
+1
Artificial Intelligence / Machine Learning Verification and Validation Engineer
Artificial Intelligence / Machine Learning Verification and Validation Engineer

Penn State • State College

On-site
USD 92,000 - 201,000
AI/ML Computer Science Research and Development Engineer
AI/ML Computer Science Research and Development Engineer

Penn State University • University Park (IL)

On-site
USD 122,000 - 231,000
Tuition discount
Comprehensive benefits
Retirement plans
Artificial Intelligence / Machine Learning Research and Development Engineer
Artificial Intelligence / Machine Learning Research and Development Engineer

The Pennsylvania State University • State College

On-site
USD 146,000 - 319,000