Remote Senior Software Engineer, LLM Evaluation & QA Tools

OpenTrain AI, Inc.; United States; Remote; USD 83,000 - 124,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a Senior Software Engineer for LLM Evaluation. This remote, US-based contractor role offers a flexible schedule of 20+ hours per week.

The role focuses on Python across backend services, data pipelines, ML infrastructure, and full-stack development. You will build Python agents and automated tools to verify code and assess AI-generated solutions, evaluating correctness, efficiency, and scalability while collaborating with cross-functional teams to improve coding

Qualifications

• Minimum three years in software engineering.
• Strong Python skills including production frameworks and development practices.
• Experience building full-stack applications and deploying scalable software.
• Good knowledge of software architecture, development, debugging and code review.

Responsibilities

• Create and improve code examples, develop solutions, and review AI-generated code.
• Use software engineering judgment to assess correctness, efficiency, scalability, reliability, and overall quality.
• Work primarily in Python across backend services, data pipelines, ML infrastructure, and full-stack development.
• Build Python agents and automated tools to verify code and assess AI-generated solutions.

Skills

Python

Full-stack development

Software architecture

Code review

Debugging

Production frameworks

Job description

OpenTrain AI, Inc. is seeking a Senior Software Engineer for LLM Evaluation. This remote, US-based contractor role offers a flexible schedule of 20+ hours per week.

The role focuses on Python across backend services, data pipelines, ML infrastructure, and full-stack development. You will build Python agents and automated tools to verify code and assess AI-generated solutions, evaluating correctness, efficiency, and scalability while collaborating with cross-functional teams to improve coding