AI/ML Software engineer -25-02840

LeadStack Inc.; United States; Remote; Full time

Job summary

LeadStack Inc. seeks experienced Software Engineers to develop training data for AI models in a remote, 6-month contract role. Responsibilities include designing data systems and evaluating datasets, requiring strong full-stack development skills and a Bachelor's degree in Computer Science. The role emphasizes analytical skills, attention to detail, and effective communication, making it ideal for those passionate about AI and software development.

Qualifications

• 5+ years of professional software development experience.
• Advanced understanding of data structures and algorithms.
• Experience with ML/AI systems preferred.

Responsibilities

• Design and implement data collection systems for AI training.
• Evaluate datasets for AI model training and benchmarking.
• Lead evaluation efforts of AI-generated code.

Skills

Full-stack Development

Analytical Skills

Attention to Detail

Communication

Education

Bachelor's degree in Computer Science

Tools

ML/AI Tools

Cloud Infrastructure (AWS, GCP, Azure)

Containerization (Docker, Kubernetes)

Job description

2 days ago Be among the first 25 applicants

This range is provided by LeadStack Inc.. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$90.00/hr - $100.00/hr

Direct message the job poster from LeadStack Inc.

Lead Stack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world.

LOCATION: Remote in USA

DURATION: 6-Month Contract with possible extension

No C2C

GC/USC preferred

Rate: $90-$100/hr on W2

Description:

We are seeking experienced Software Engineers to develop and evaluate high-quality training data for our advanced AI models. As part of the Human Data Operations team, you will architect, analyze, and curate sophisticated datasets that facilitate the training of large language models. You will work closely with our research and engineering teams to ensure our AI systems demonstrate key traits like helpfulness, honesty, and harmlessness while maintaining technical excellence.

Key Responsibilities:

• Design and implement data collection systems and pipelines for AI model training
• Architect and evaluate datasets for AI model training and benchmarking
• Provide in-depth analysis of model behaviors, performance, and interaction patterns
• Lead evaluation efforts of AI-generated code to enforce industry-leading standards
• Identify and analyze emerging trends, edge cases, and opportunities for improvement
• Develop advanced benchmarks and evaluation methodologies for AI capabilities
• Create technical documentation and evaluation frameworks

Quality Standards:

• Maintain high levels of precision and consistency in data labeling and code evaluation
• Follow annotation guidelines and quality control processes
• Participate in regular quality audits and calibration exercises
• Flag edge cases and provide detailed feedback on challenging examples

Required Qualifications:

• Bachelor's degree or equivalent experience in Computer Science, Software Engineering, or related technical field
• 5+ years of professional software development experience
• Strong full-stack development experience across frontend and backend systems
• Advanced understanding of data structures, algorithms, and system architecture
• Experience with ML/AI systems, preferably language models or related technologies
• Strong attention to detail with exceptional analytical and critical thinking skills
• Outstanding written and verbal communication abilities
• Proven ability to work independently while delivering high-quality output

Preferred Qualifications:

• Master's degree in Computer Science, AI, or related field
• Experience with AI language models, prompt engineering, or model evaluation
• Deep knowledge of machine learning frameworks and concepts
• Previous experience developing tooling for data labeling or annotation platforms
• Expertise in cloud infrastructure (AWS, GCP, Azure) and containerization (Docker, Kubernetes)
• Experience with distributed systems and high-performance computing
• Understanding of ethical considerations in AI development

To know more about current opportunities at Lead Stack, please visit us at https://leadstackinc.com/careers/

Should you have any questions, feel free to call me on 415 985-0816 or send an email on [e-mail]

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  Research Services

Referrals increase your chances of interviewing at LeadStack Inc. by 2x

Get notified about new Software Engineer jobs in United States.

Full-Stack Software Engineer (New graduates: United States)

United States $70,000 - $100,000 4 weeks ago

Palo Alto, CA $140,000 - $185,000 2 weeks ago

Software Engineer (L5) - Open Connect Platform

United States
$100,000.00
-
$720,000.00
2 weeks ago

New York, NY
$140,000.00
-
$185,000.00
2 weeks ago

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

United States
$100,000.00
-
$720,000.00
2 days ago

United States
$140,000.00
-
$170,000.00
2 months ago

Software Engineer Intern/Co-op (Fall 2025)

Software Engineer (L5) - Ads Identity & Privacy

United States
$100,000.00
-
$720,000.00
2 days ago

United States
$170,000.00
-
$720,000.00
6 hours ago

New York, NY
$145,000.00
-
$260,000.00
7 months ago

United States
$90,000.00
-
$170,000.00
9 months ago

Software Engineer L4/L5, Training Platform, Machine Learning Platform

United States
$100,000.00
-
$720,000.00
3 weeks ago

United States $200,000 - $380,000 1 day ago

United States $110,000 - $133,000 3 months ago

New York City Metropolitan Area 2 weeks ago

United States $176,000 - $210,000 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.