Contract AI Evaluation Engineer: Functional Testing & QA

Mindrift; Town of Florida (NY); Remote; USD 110,208; Part time

Job summary

An innovative tech company seeks experienced specialists for project-based opportunities in AI testing and evaluation. Responsibilities include refining coding tasks, writing comprehensive tests, and analyzing AI performance. Candidates should have a degree in Computer Science or a related field, along with 5+ years of software development experience, particularly in Python. Strong knowledge of Full-Stack development and test writing is essential. This position offers a flexible work schedule and competitive hourly rates, reaching up to $80/hour based on expertise.

Qualifications

• 5+ years in software development, primarily using Python.
• Background in Full-Stack development with focus on React interfaces and robust back-end systems.
• Experience writing functional and integration tests.

Responsibilities

• Review and refine coding tasks based on production codebases.
• Write comprehensive functional tests to validate end-to-end behavior.
• Craft challenges requiring complex reasoning for AI evaluation.
• Analyze AI failures to identify model weaknesses.

Skills

Python

Full-Stack development

Writing tests

Docker

CI/CD

English proficiency - B2

Education

Degree in Computer Science or Software Engineering

Job description

An innovative tech company seeks experienced specialists for project-based opportunities in AI testing and evaluation. Responsibilities include refining coding tasks, writing comprehensive tests, and analyzing AI performance. Candidates should have a degree in Computer Science or a related field, along with 5+ years of software development experience, particularly in Python. Strong knowledge of Full-Stack development and test writing is essential. This position offers a flexible work schedule and competitive hourly rates, reaching up to $80/hour based on expertise.