Remote Java QA Lead — Code Quality & Mentorship

YO IT Consulting; Town of Florida (NY); On-site; USD 82,656 - 123,984; Full time

Job summary

YO IT Consulting is seeking a Java Quality Assurance Lead for an hourly, remote contractor role. You will oversee quality, consistency, and trainer performance across Java AI training projects, reviewing AI-generated Java code and providing precise feedback.

You will evaluate code against rubrics, ensure secure, idiomatic, and well-documented results, and guide remote teams through QA processes using Discord, Google Docs, trackers, and dashboards. This is a fast-growing AI data services company.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or equivalent professional software engineering experience.
• Strong grasp of English to follow guidelines, communicate with teams, and provide clear technical feedback.
• 3+ years of professional experience in Java development, backend engineering, enterprise software, JVM systems, code review, software QA, or technical mentoring.
• Strong understanding of Java fundamentals such as OOP, collections, generics, streams, lambdas, exceptions, concurrency, annotations, JVM behavior, memory management, modules/packages, and modern Java features.
• Ability to evaluate Java content against detailed rubrics and identify issues such as non-compilable code, incorrect logic, poor exception handling, unsafe concurrency, weak object modeling, inefficient algorithms, hallucinated APIs, or incomplete explanations.
• Familiarity with common Java ecosystems and tools such as Spring Boot, Maven, Gradle, JUnit, Mockito, Hibernate/JPA, REST APIs, JDBC, IntelliJ/Eclipse, Docker, GitHub, CI/CD, logging, and profiling tools is preferred.
• Experience leading or supporting remote teams of trainers, annotators, reviewers, engineers, coding mentors, or QAs is strongly preferred.
• Comfortable working in fast-moving remote environments using Discord, Google Sheets, Google Docs, trackers, dashboards, GitHub, and project management systems.
• Highly organized and able to maintain style guides, trackers, FAQs, onboarding materials, honeypots, calibration tasks, and quality documentation.
• Experience with AI training, data annotation, LLM evaluation, code QA, or rubric-based code review is a strong plus.

Responsibilities

• Quality monitoring: Spot-check Java items, identify quality issues, provide feedback through DMs, and escalate recurring or critical issues.
• Code review: Evaluate AI-generated Java code, Spring/backend snippets, debugging responses, algorithmic solutions, tests, architecture explanations, and step-by-step reasoning.
• Trainer and QA communication: Update contributors on Discord about guideline changes, workflow updates, and Java-specific review standards.
• Question handling: Respond to questions around Java syntax, OOP design, collections, streams, concurrency, exceptions, Spring Boot, testing, security, and rubric interpretation.
• Trainer/QA activation management: DM inactive contributors, track follow-ups, and flag availability issues.
• Documentation: Create and maintain Java style guides, trackers, FAQs, examples, honeypots, calibration tasks, and onboarding materials.
• Onboarding and training: Run onboarding/training calls for Java contributors.
• Risk and security review: Flag insecure, misleading, non-compilable, inefficient, or non-production-ready Java recommendations.
• Process improvement: Identify recurring quality gaps and improve QA workflows.

Skills

Java development

Backend engineering

Code review

Software QA

Technical mentoring

English communication

Remote team leadership

OOP & JVM

Rubric-based review

Education

Bachelor’s or Master’s in CS/SE/IT

Tools

Spring Boot

Maven/Gradle

JUnit/Mockito

Hibernate/JPA

REST APIs

JDBC

IntelliJ/Eclipse

Docker

GitHub

CI/CD

Job description

YO IT Consulting is seeking a Java Quality Assurance Lead for an hourly, remote contractor role. You will oversee quality, consistency, and trainer performance across Java AI training projects, reviewing AI-generated Java code and providing precise feedback.

You will evaluate code against rubrics, ensure secure, idiomatic, and well-documented results, and guide remote teams through QA processes using Discord, Google Docs, trackers, and dashboards. This is a fast-growing AI data services company.