Systems Experts | $300/task

Codefeast; India; Remote; INR 4,133,000 - 6,888,000; Part time

Job summary

Codefeast is seeking experienced systems and infrastructure engineers to design and review terminal-based tasks that test AI agents' ability to troubleshoot, configure, and optimize complex computing environments. The role focuses on Linux, networking, and distributed systems to improve benchmark reliability and realism.

This remote contract position requires hands-on Terminal-Bench 3.0 experience and the ability to build reproducible environments, validate workflows, and document technical

Qualifications

• 7+ years of professional systems or infrastructure experience.
• Strong Linux and troubleshooting skills.
• Experience with automated benchmarking and validation.

Responsibilities

• Design multi-step terminal tasks for realistic workflows.
• Build reproducible environments with pinned dependencies and defined configurations.
• Develop tasks involving Linux, networking, infrastructure, and distributed systems.
• Implement reference solutions and automated validation tests.
• Troubleshoot service failures, permissions, networking, and configuration issues.
• Assess system behavior under defined conditions.
• Improve evaluation criteria and task reproducibility.
• Document technical assumptions and expected system behavior.

Skills

Linux

Infrastructure

Networking

Distributed systems

Education

Bachelor's degree in CS/Engineering

Tools

Terminal-Bench 3.0

Job description

Experience: 7+ Years of Professional Systems or Infrastructure Experience

Job Type: Contractor

Location: Remote

Required Profiles: LinkedIn profile required to apply

Role Overview

We are looking for experienced systems and infrastructure engineers to develop and review terminal-based tasks that evaluate AI agents' ability to troubleshoot, configure, and optimize complex computing environments. You'll contribute your knowledge of Linux, infrastructure, networking, and distributed systems to improve benchmark reliability and realism.

Important: Prior hands-on experience working on Terminal-Bench 3.0 projects is mandatory.

Key Responsibilities

• Design multi-step terminal tasks based on realistic systems engineering workflows.
• Build reproducible environments with pinned dependencies and defined configurations.
• Develop and validate tasks involving Linux, networking, infrastructure, and distributed systems.
• Implement reference solutions and automated system validation tests.
• Troubleshoot service failures, permissions, networking, and configuration issues.
• Assess system behavior, reliability, and performance under defined conditions.
• Improve evaluation criteria and task reproducibility.
• Document technical assumptions and expected system behavior.

Key Requirements

• Bachelor's degree from a university ranked among the top 100 institutions in the country.
• Minimum 7 years of relevant systems or infrastructure experience.
• Prior hands-on experience with Terminal-Bench 3.0 projects.
• Relevant background in Computer Science, Electrical/Computer Engineering, Systems Engineering, or Control Systems.
• Strong knowledge of Linux, command-line tools, and system troubleshooting.
• Experience validating technical environments and automated workflows.
• Comfortable discussing troubleshooting approaches in an interview.
• Availability to work remotely on a flexible schedule.

Preferred Technical Skills

• Linux administration and shell scripting.
• Cloud infrastructure, DevOps, and platform engineering.
• Networking, distributed systems, and storage.
• Containerization, CI/CD, and infrastructure automation.
• Systems benchmarking and automated evaluation.