Software Engineer C# (Remote)

Quik Hire Staffing; India; Remote; INR 2,500,000 - 4,500,000; Full time

Job summary

Quik Hire Staffing is hiring a Senior Software Engineer – C#(LLM Evaluation & Repository Validation) to work on a fully remote, full-time basis. The role focuses on building evaluation datasets for large language models by transforming public repository histories into verifiable tasks with human-in-the-loop.

Key responsibilities include triaging issues, containerizing environments, assessing test coverage, and collaborating with AI researchers.

Qualifications

• Minimum three years of professional software development experience with strong proficiency in C#.
• Experience with Git version control, Docker, and basic software pipeline setup.
• Ability to navigate and understand complex codebases, and to run, modify, and test real-world projects locally.
• Experience analyzing test coverage, writing unit tests, and assessing code quality.

Responsibilities

• Analyze and triage GitHub issues to identify challenging LLM assessment cases.
• Set up and configure repositories, including Docker containerization and environment provisioning.
• Evaluate unit test coverage and document gaps and improvements.
• Modify and run codebases locally to measure LLM performance in bug-fix and code-generation scenarios.
• Collaborate with researchers to design task sets and stress-test LLM capabilities.
• Lead and mentor junior engineers coordinating repository validation efforts.

Skills

C# proficiency

Git

Docker

Codebase navigation

Unit testing

Tools

Docker

Git

Job description

We are hiring for one of our clients, seeking a Senior Software Engineer – C#(LLM Evaluation & Repository Validation) to work on a Full-Time basis. The project builds evaluation and training datasets for large language models by creating verifiable software engineering tasks from public repository histories using a synthetic approach with human‑in‑the‑loop. The work expands dataset coverage across programming languages, difficulty levels, and real‑world code scenarios.

Key Responsibilities:

• Analyze and triage GitHub issues across trending open‑source libraries to identify challenging cases for LLM assessment.
• Set up and configure code repositories, including Docker containerization and environment provisioning for reproducible testing.
• Evaluate unit test coverage and quality, documenting gaps and improvement opportunities.
• Modify and run codebases locally to measure LLM performance in bug‑fixing and code‑generation scenarios.
• Collaborate with AI researchers to design task sets and select repositories that stress test LLM capabilities.
• Lead and mentor junior engineers, coordinating their contributions to repository validation efforts.

Required Skills & Qualifications:

• Minimum three years of professional software development experience with strong proficiency in C#.
• Demonstrated expertise with Git version control, Docker, and basic software pipeline setup.
• Ability to navigate and understand complex codebases, and to run, modify, and test real‑world projects locally.
• Experience analyzing test coverage, writing unit tests, and assessing code quality.
• Prior involvement in open‑source contributions or evaluation projects is considered a plus.

More About the Opportunity:

This role offers a unique opportunity to work with a global leader in the artificial intelligence industry, contributing to the creation of realistic software engineering datasets that shape future AI‑assisted development tools. The position is fully remote, allowing collaboration with researchers and engineers worldwide while focusing on cutting‑edge AI research.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.