Remote AI Systems Engineer – LLM APIs & Data Pipelines

Ladders

United States

Remote

USD 120,000 - 145,000

Full time

6 hours ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Diversity and inclusion

Collaborative environment

Continuous learning

Empathetic workplace culture

Job summary

Ladders is seeking a Software Engineer, AI Systems to build and operate AI-enabled backend systems supporting data-heavy enterprise workflows. You’ll work with Product and Design to turn ambiguous goals into concrete specs, while improving reliability, quality, and customer experience across cloud services.

This remote US-based role offers exposure to integrations, data pipelines, and fast-moving AI engineering practices.

Qualifications

3–5 years of backend and distributed systems experience in cloud environments.
Production experience with agentic AI and retrieval-augmented generation (RAG).
Strong proficiency in Python, Java, or Go.
Experience with data-intensive systems including object storage and relational databases.
Bachelor's degree in Computer Science or equivalent experience.

Responsibilities

Build and operate LLM-backed APIs and integrations with internal and external systems.
Develop evaluations for agent and RAG workflows to enhance quality and reliability.
Create ingestion pipelines for data transfer between customer environments and cloud storage.
Collaborate with Product and Design to refine broad goals into practical specifications.
Identify and implement improvements, ensuring frequent shipping and follow-through on results.
Work across backend services and cloud infrastructure, with occasional UI changes to enhance customer experience.