GenAI & ML QA Engineer — Hybrid

System One; Columbia (MD); Hybrid; USD 70,000 - 100,000; Part time

Benefits offered by this job

Health and welfare benefits

401(k) plan

Job summary

System One is seeking an AI/ML Software Test Engineer to support GenAI and chatbot initiatives in Columbia, MD. This contract role blends software testing with ML concepts and focuses on validating AI-powered solutions for quality and reliability.

You will collaborate with engineering and business teams to evaluate AI apps, analyze outputs, and drive improvements through automated testing, prompt engineering, and data-pipeline familiarity.

Qualifications

• Bachelor's degree in CS/IT/Engineering or equivalent experience.
• 3+ years of software engineering experience.
• 3+ years on cloud platforms (AWS, Azure, or GCP).
• Experience applying ML/GenAI concepts in a professional environment.
• Experience testing AI/ML solutions, models, or chatbots.
• Experience with automation testing (Selenium, BDD).
• Understanding of data pipelines and databases.

Responsibilities

• Support ML/GenAI initiatives, tests and enhancements.
• Collaborate with engineering to evaluate and improve AI apps.
• Analyze model outputs and provide feedback.
• Apply ML/GenAI concepts to assess model behavior and optimization.
• Work with stakeholders to ensure AI outputs meet business expectations.
• Test chatbot solutions and conversational AI platforms.
• Validate AI-generated responses for accuracy and relevance.
• Utilize prompt engineering to improve chatbot interactions.
• Develop and execute system, integration, and automation testing.
• Test data pipelines and validate outputs throughout the AI lifecycle.
• Document findings and testing results using collaboration tools.

Skills

Software testing

GenAI concepts

AI/ML concepts

Problem solving

Communication

Education

Bachelor's degree in CS/IT/Engineering

Tools

Selenium

BDD

Jira

Confluence

Job description

System One is seeking an AI/ML Software Test Engineer to support GenAI and chatbot initiatives in Columbia, MD. This contract role blends software testing with ML concepts and focuses on validating AI-powered solutions for quality and reliability.

You will collaborate with engineering and business teams to evaluate AI apps, analyze outputs, and drive improvements through automated testing, prompt engineering, and data-pipeline familiarity.