Applied ML QA Engineer

Compunnel Inc.

Louisville (KY)

On-site

USD 100,000 - 130,000

Part time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A technology company in the United States is seeking an experienced Applied ML QA Engineer. The role focuses on validating machine learning models, developing automated test frameworks, and ensuring robust model deployment. Candidates should have substantial experience in Python, ML QA, and drift detection, along with familiarity with tools like Databricks. Strong analytical and problem-solving skills are also essential. This is a contractor position offering opportunities to work with innovative technologies.

Qualifications

  • 8+ years of experience in Python, ML QA, drift detection, and testing ML features/pipelines.
  • 5+ years of experience with Databricks, feature stores, and model serving.
  • Strong understanding of ML lifecycle, including testing and monitoring.

Responsibilities

  • Validate ML models, scoring outputs, and feature pipelines for accuracy and reliability.
  • Develop and maintain automated test frameworks for ML workflows.
  • Collaborate with data scientists and engineers to ensure robust model deployment.

Skills

Python
ML QA
Drift detection
Testing ML features/pipelines
Analytical skills
Problem-solving skills

Tools

Databricks
GenAI tools
ML observability tools

Job description

We are seeking an experienced Applied ML QA Engineer (Contractor) to validate machine learning models, scoring outputs, feature pipelines, and inference services for a real-time decisioning platform.

This role involves creating automated tests, implementing drift monitoring, performing consistency checks, and providing validation support for every model release.

Key Responsibilities
  • Validate ML models, scoring outputs, and feature pipelines for accuracy and reliability.
  • Develop and maintain automated test frameworks for ML workflows.
  • Perform consistency checks across training, validation, and inference environments.
  • Collaborate with data scientists and engineers to ensure robust model deployment.
  • Maintain documentation and validation artifacts for compliance and reproducibility.
Required Qualifications
  • 8+ years of experience in Python, ML QA, drift detection, and testing ML features/pipelines.
  • 5+ years of experience with Databricks, feature stores, and model serving (preferred).
  • 5+ years of experience using GenAI tools (Cursor, Windsurf, Copilot).
  • Strong understanding of ML lifecycle, including testing and monitoring.
  • Familiarity with CI/CD workflows for ML deployments.
Preferred Qualifications
  • Experience with real-time decisioning platforms.
  • Knowledge of ML observability tools and QA best practices.
  • Strong analytical and problem-solving skills.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Real-Time ML QA Engineer (Contractor)
Real-Time ML QA Engineer (Contractor)

Compunnel Inc. • Louisville (KY)

On-site
USD 100,000 - 130,000
Software Quality Assurance Engineer
Software Quality Assurance Engineer

nexacode • United States

On-site
USD 85,000 - 120,000
ML Ops Senior Engineer
ML Ops Senior Engineer

Compunnel Inc. • Concord (CA)

On-site
USD 120,000 - 160,000
Lead Software Development Engineer in Test - AI
Lead Software Development Engineer in Test - AI

HighLevel • Texas

Hybrid
USD 140,000 - 200,000
AI QA Engineer
AI QA Engineer

Cavendish Professionals • Town of Italy (NY)

On-site
USD 95,000 - 120,000
QA Test Engineering
QA Test Engineering

InterSources Inc • Alpharetta (GA)

On-site
USD 90,000 - 130,000
ML Ops Engineer
ML Ops Engineer

GCS Recruitment • United States

Remote
USD 120,000 - 160,000
Senior ML Ops Engineer: Cloud ML Pipelines & CI/CD
Senior ML Ops Engineer: Cloud ML Pipelines & CI/CD

Compunnel Inc. • California

On-site
USD 120,000 - 160,000
QA Engineer
QA Engineer

Lakefusion • United States

Remote
USD 90,000 - 130,000
Applied ML & Predictive Analytics Engineer
Applied ML & Predictive Analytics Engineer

Hhw Group • United States

On-site
USD 120,000 - 180,000