AI Analyst | Remote

Crossing Hurdles; Nuova Zelanda; Remoto; NZD 83.000 - 165.000; Part-time

Descrizione del lavoro

Crossing Hurdles is seeking an AI Trainer for a remote, contract role. The position involves creating challenging software engineering tasks to stress-test advanced AI models, along with developing instructions, environments, solutions, tests, and evaluation criteria.

Ideal candidates have hands-on experience training and benchmarking AI systems, strong Python skills, and familiarity with at least one additional programming language.

Competenze

• Experience training, evaluating, benchmarking, or improving AI systems.
• Proficient in Python.
• Experience with at least one more language (e.g., Java, JavaScript, TypeScript, Rust, C++, C#, Go).
• Knowledge of software design, debugging, testing, version control, and dependency management.

Mansioni

• Create realistic software engineering tasks that challenge advanced AI models.
• Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
• Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
• Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Conoscenze

Python

Other language

Software design

Debugging

Testing

Version control

Dependency management

Descrizione del lavoro

Position: AI Trainer

Type: Contract

Compensation: $60 - $120/hour

Location: Remote

Commitment: 10-40 hrs/week

• Create realistic software engineering tasks that challenge advanced AI models.
• Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
• Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
• Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Role Responsibilities

• Create realistic software engineering tasks that challenge advanced AI models.
• Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
• Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
• Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Requirements

• Have strong relevant experience training, evaluating, benchmarking, or improving AI systems.
• Strong practical proficiency with Python.
• Professional experience with at least one additional programming language, such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
• Strong knowledge of software design, debugging, testing, version control, and dependency management.