Remote AI Model Evaluation Engineer

Intelliswift - An LTTS Company; United States; On-site; USD 95,000 - 150,000; Full time

Job summary

Intelliswift - An LTTS Company is seeking a Software Engineer/Research Engineer to design, build, and evaluate pipelines for AI model evaluation and systems in a remote U.S. setting (PST preferred).

The role combines software engineering with AI research, contributing to benchmarks, test suites, and validation workflows for next-generation AI systems. The candidate will work with researchers to diagnose model performance, implement scalable tooling in Python, and ensure high-quality,

Qualifications

• Bachelor's degree in Computer Science, Engineering, Machine Learning, AI, or a related field.
• 1-3 years of experience in AI/ML engineering, research engineering, or software engineering.
• Strong programming skills in Python.
• Hands-on experience training and evaluating machine learning models.
• Experience with PyTorch and modern deep learning frameworks.
• Experience developing benchmarks, validation frameworks, or model evaluation workflows.
• Strong debugging, analytical, and problem-solving abilities.
• Demonstrated experience managing technical projects from implementation through validation and delivery.
• Familiarity with AI-assisted development tools such as Claude Code, Cursor, Codex, or GitHub Copilot.

Responsibilities

• Design, implement, and maintain evaluation frameworks for AI and machine learning systems.
• Develop benchmarks, test suites, and validation workflows used to measure model performance.
• Investigate model behavior, performance discrepancies, and system-level issues through data-driven experimentation.
• Build scalable Python-based tooling and infrastructure to support AI research and evaluation.
• Collaborate with researchers and cross-functional teams to improve model quality and performance.
• Document findings, methodologies, and technical decisions to ensure reproducibility.
• Contribute to deployment, monitoring, and operational excellence of AI systems.
• Drive engineering best practices around testing, reliability, and code quality.

Skills

Python

AI/ML engineering

Model evaluation

Debugging

Project delivery

Education

Bachelor's degree in Computer Science or related field

Tools

PyTorch

Docker

Kubernetes

GitHub Copilot

Claude Code

Cursor

Codex

Job description

Intelliswift - An LTTS Company is seeking a Software Engineer/Research Engineer to design, build, and evaluate pipelines for AI model evaluation and systems in a remote U.S. setting (PST preferred).

The role combines software engineering with AI research, contributing to benchmarks, test suites, and validation workflows for next-generation AI systems. The candidate will work with researchers to diagnose model performance, implement scalable tooling in Python, and ensure high-quality,