Senior Ruby Engineer for LLM Evaluation & Repo Validation

Turing Enterprises, Inc.; Pakistan; Remote; PKR 9,274,000 - 21,640,000; Part time

Benefits offered by this job

Fully remote

Cutting-edge AI projects

Multiple hours options (20/30/40)

Contractor role (no medical/paid leave

Job summary

Turing Enterprises, Inc. is seeking a Senior Software Engineer – Ruby with LLM Evaluation & Repository Validation.

You will perform hands-on software engineering, automate environments, triage issues, and evaluate test coverage on real-world codebases. The role involves setting up repositories with Docker, running projects locally, leading junior engineers, and collaborating with researchers to identify hard problems for LLMs.

Qualifications

• Minimum 3+ years of overall software engineering experience.
• Strong experience with Ruby is required.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
• Opportunities to lead a team of junior engineers to collaborate on projects.

Skills

Ruby

Git

Docker

CI/CD

Tools

Docker

Job description

Turing Enterprises, Inc. is seeking a Senior Software Engineer – Ruby with LLM Evaluation & Repository Validation.

You will perform hands-on software engineering, automate environments, triage issues, and evaluate test coverage on real-world codebases. The role involves setting up repositories with Docker, running projects locally, leading junior engineers, and collaborating with researchers to identify hard problems for LLMs.