Real-Time ML QA Engineer (Contractor)

Compunnel Inc.

Louisville (KY)

On-site

USD 100,000 - 130,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A technology company in the United States is seeking an experienced Applied ML QA Engineer. The role focuses on validating machine learning models, developing automated test frameworks, and ensuring robust model deployment. Candidates should have substantial experience in Python, ML QA, and drift detection, along with familiarity with tools like Databricks. Strong analytical and problem-solving skills are also essential. This is a contractor position offering opportunities to work with innovative technologies.

Qualifications

  • 8+ years of experience in Python, ML QA, drift detection, and testing ML features/pipelines.
  • 5+ years of experience with Databricks, feature stores, and model serving.
  • Strong understanding of ML lifecycle, including testing and monitoring.

Responsibilities

  • Validate ML models, scoring outputs, and feature pipelines for accuracy and reliability.
  • Develop and maintain automated test frameworks for ML workflows.
  • Collaborate with data scientists and engineers to ensure robust model deployment.

Skills

Python
ML QA
Drift detection
Testing ML features/pipelines
Analytical skills
Problem-solving skills

Tools

Databricks
GenAI tools
ML observability tools

Job description

We are seeking an experienced Applied ML QA Engineer (Contractor) to validate machine learning models, scoring outputs, feature pipelines, and inference services for a real-time decisioning platform.

This role involves creating automated tests, implementing drift monitoring, performing consistency checks, and providing validation support for every model release.

Key Responsibilities

  • Validate ML models, scoring outputs, and feature pipelines for accuracy and reliability.
  • Develop and maintain automated test frameworks for ML workflows.
  • Perform consistency checks across training, validation, and inference environments.
  • Collaborate with data scientists and engineers to ensure robust model deployment.
  • Maintain documentation and validation artifacts for compliance and reproducibility.
Required Qualifications
  • 8+ years of experience in Python, ML QA, drift detection, and testing ML features/pipelines.
  • 5+ years of experience with Databricks, feature stores, and model serving (preferred).
  • 5+ years of experience using GenAI tools (Cursor, Windsurf, Copilot).
  • Strong understanding of ML lifecycle, including testing and monitoring.
  • Familiarity with CI/CD workflows for ML deployments.
Preferred Qualifications
  • Experience with real-time decisioning platforms.
  • Knowledge of ML observability tools and QA best practices.
  • Strong analytical and problem-solving skills.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied ML QA Engineer
Applied ML QA Engineer

Compunnel Inc. • Louisville (KY)

On-site
USD 100,000 - 130,000
Software Quality Assurance Engineer
Software Quality Assurance Engineer

nexacode • United States

On-site
USD 85,000 - 120,000
Real-Time SQL & Data Analytics Engineer
Real-Time SQL & Data Analytics Engineer

Compunnel Inc. • Louisville (KY)

On-site
USD 90,000 - 115,000
Remote Python ML QA Lead (Contractor)
Remote Python ML QA Lead (Contractor)

SuperAnnotate AI, Inc. • United States

Remote
USD 136,000 - 194,000
QA Engineer - Remote
QA Engineer - Remote

YO AI Labs • New York (NY)

Remote
USD 55,000 - 103,000
Software Test Engineer - Remote
Software Test Engineer - Remote

YO AI Labs • New York (NY)

Remote
USD 41,000 - 83,000
AI QA Trainer
AI QA Trainer

Meridial • United States

Remote
USD 8,300 - 90,000
QA Test Engineering
QA Test Engineering

InterSources Inc • Alpharetta (GA)

On-site
USD 90,000 - 130,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Agency • United States

Remote
USD 8,300 - 90,000
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Meridial • United States

Remote
USD 8,265 - 89,544
Secure computer and high-speed internet required