Remote Part-Time AI Software Engineering Domain Expert

24-Mag Llc; Northern, New York (KY, NY); Hybrid; USD 138,000 - 276,000; Part time

Job summary

24-MAG LLC presents a part-time remote consulting opportunity for experienced software engineers with a focus on technical analysis, architecture evaluation, documentation, QA, prompt development, and AI-output assessment for an advanced AI training project.

Ideal candidates have 3+ years in software engineering and experience reviewing technical materials. Compensation is $100–$200 per hour, with asynchronous collaboration and no obligation to share confidential information.

Qualifications

• 3+ years of professional software-engineering experience.
• Background as a Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, Solutions Architect, or comparable professional.
• Experience authoring or reviewing technical documentation.
• Familiarity with architecture documents, RFCs, design specifications, engineering proposals, postmortems, or code reviews.

Responsibilities

• Review AI-generated software-engineering content for accuracy, completeness, and practical relevance.
• Evaluate architecture, system-design, and implementation decisions.
• Identify incorrect assumptions, weak reasoning, or maintainability, scalability, reliability, and performance concerns.
• Review RFCs, design specifications, engineering proposals, and related technical materials.
• Provide structured feedback grounded in professional engineering practice.
• Design and refine prompts for complex software-engineering scenarios.
• Create tasks testing technical reasoning and engineering judgement.
• Evaluate model outputs using detailed rubrics for correctness, relevance, and technical quality.
• Identify ambiguous or edge-case outputs requiring deeper analysis.
• Provide clear written rationales supporting evaluation decisions.
• Draft and edit technical documentation, reports, and analytical summaries.
• Conduct research and fact checking to validate technical claims.
• Review and annotate engineering content according to project standards.
• Support consistency and calibration across evaluation workflows.
• Translate complex engineering concepts for technical and non-technical audiences.

Skills

Software engineering

Technical analysis

Architecture

Documentation

Quality assurance

Prompt development

AI evaluation

Education

Advanced academic qualifications valued but not required

Job description

24-MAG LLC presents a part-time remote consulting opportunity for experienced software engineers with a focus on technical analysis, architecture evaluation, documentation, QA, prompt development, and AI-output assessment for an advanced AI training project.

Ideal candidates have 3+ years in software engineering and experience reviewing technical materials. Compensation is $100–$200 per hour, with asynchronous collaboration and no obligation to share confidential information.