AI Evaluation Engineer: QA & Automation Champion

Deposco, Inc.

Alpharetta, Northern (GA, KY)

Hybrid

USD 90,000 - 130,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health care
Paid time off
401k plan with match
Gym reimbursement
Barista-coffee bar
Team events and culture
Office with co-working spaces

Job summary

Deposco, Inc. is seeking an experienced AI Evaluation Engineer to join our quality assurance team in Alpharetta, GA. You will validate AI features, services, and integrations, ensuring accuracy, reliability, and performance across omnichannel solutions.

You will collaborate with product managers, developers, and data scientists in an agile environment, building automated tests with Python/Java, and contributing to CI workflows to deliver high‑quality software to customers.

Qualifications

  • Four-year degree in Computer Science/Engineering preferred.
  • 2+ years experience in software quality testing.
  • 2+ years of Agile Experience.
  • 2 years Python Experience preferred.
  • Experience in integration platforms preferred.
  • Familiar with JSON and XML formats.

Responsibilities

  • Engage in requirements and project meetings to understand goals and deliverables.
  • Review and analyze project requirements to pinpoint gaps and validate test cases.
  • Design and maintain automated tests using Java or Python for omnichannel solutions.
  • Utilize CI tools for automation of development, build, deployment, and testing workflows.
  • Collaborate with product owners as part of a Scrum team to clarify requirements.
  • Examine test results and provide feedback to the development team.
  • Assist in troubleshooting production issues through coordinated testing.
  • Create QA documentation including test plans, scripts, and strategies.

Skills

Python
Java
Agile
RESTful
CI/CD
Jira
Confluence
SQL

Education

Four-year degree in CS/Engineering

Tools

JSON/XML
MySQL

Job description

Deposco, Inc. is seeking an experienced AI Evaluation Engineer to join our quality assurance team in Alpharetta, GA. You will validate AI features, services, and integrations, ensuring accuracy, reliability, and performance across omnichannel solutions.

You will collaborate with product managers, developers, and data scientists in an agile environment, building automated tests with Python/Java, and contributing to CI workflows to deliver high‑quality software to customers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Evaluation Engineer
AI Evaluation Engineer

Deposco, Inc. • Alpharetta (GA), Northern (KY)

Hybrid
USD 90,000 - 130,000
Health care
Paid time off
401k plan with match
+4
AI Platform Engineer – Internal Automation & Tools
AI Platform Engineer – Internal Automation & Tools

Deposco • Alpharetta (GA)

On-site
USD 90,000 - 120,000
Health benefits
401k plan with match
Corporate events
+3
Senior AI SDET: Automation & ML QA Excellence
Senior AI SDET: Automation & ML QA Excellence

Synechron • Alpharetta (GA)

On-site
USD 110,000 - 160,000
Competitive compensation
Global mobility opportunities
Extensive training
AI SDET Automation Engineer — Lead QA & AI Testing
AI SDET Automation Engineer — Lead QA & AI Testing

Zodiac Solutions, Inc • Alpharetta (GA)

On-site
USD 85,000 - 100,000
QA Engineer: AI Web Test Automation & Validation
QA Engineer: AI Web Test Automation & Validation

Obsidian • Chicago (IL)

On-site
USD 110,000 - 140,000
Remote QA Engineer: AI-Driven Testing & Release Gate Expert
Remote QA Engineer: AI-Driven Testing & Release Gate Expert

DEFCON AI, Inc. • Northern (KY)

Hybrid
USD 135,000 - 170,000
Fully remote work environment
Health insurance for you and family
Unlimited PTO
+2
Remote SDET QA Engineer - Automation & Quality Advocate
Remote SDET QA Engineer - Automation & Quality Advocate

YO AI Labs • Philadelphia

Remote
USD 55,000 - 110,000
AI Quality Engineer – Agentic Systems & Validation
AI Quality Engineer – Agentic Systems & Validation

Sogeti • Phoenix (AZ)

On-site
USD 140,000 - 200,000
Remote QA Engineer for AI Testing & Automation
Remote QA Engineer for AI Testing & Automation

YO AI Labs • Washington

Remote
USD 60,000 - 90,000
AI-Driven Quality Engineer & Test Automation
AI-Driven Quality Engineer & Test Automation

Cognizant • Louisville (KY)

On-site
USD 58,000 - 75,000
Health benefits
401(k) plan and contributions
Stock Purchase Plan
+2