Software Engineer, AI Systems

Ladders; United States; Remote; USD 120,000 - 145,000; Full time

Benefits offered by this job

Diversity and inclusion

Collaborative environment

Continuous learning

Empathetic workplace culture

Job summary

Ladders is seeking a Software Engineer, AI Systems to build and operate AI-enabled backend systems supporting data-heavy enterprise workflows. You’ll work with Product and Design to turn ambiguous goals into concrete specs, while improving reliability, quality, and customer experience across cloud services.

This remote US-based role offers exposure to integrations, data pipelines, and fast-moving AI engineering practices.

Qualifications

• 3–5 years of backend and distributed systems experience in cloud environments.
• Production experience with agentic AI and retrieval-augmented generation (RAG).
• Strong proficiency in Python, Java, or Go.
• Experience with data-intensive systems including object storage and relational databases.
• Bachelor's degree in Computer Science or equivalent experience.

Responsibilities

• Build and operate LLM-backed APIs and integrations with internal and external systems.
• Develop evaluations for agent and RAG workflows to enhance quality and reliability.
• Create ingestion pipelines for data transfer between customer environments and cloud storage.
• Collaborate with Product and Design to refine broad goals into practical specifications.
• Identify and implement improvements, ensuring frequent shipping and follow-through on results.
• Work across backend services and cloud infrastructure, with occasional UI changes to enhance customer experience.

Skills

Backend services

Distributed systems

Cloud environments

AI engineering practices

Product collaboration

Education

Bachelor's degree in Computer Science

Tools

Python

Java

Go

AWS

Azure

GCP

LLM APIs

RAG

Relational databases

Job description

For our client, we are seeking a Software Engineer, AI Systems to join the team of a leader in the Enterprise Technology space.

This role will focus on building and operating AI-enabled backend systems that support data-heavy enterprise workflows. You will work closely with Product and Design to turn ambiguous goals into practical specifications, while improving reliability, quality, and customer experience across cloud infrastructure and services. The position also offers the opportunity to shape integrations, data pipelines, and product enhancements in a fast-moving technology environment.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $120,000 – $145,000 annually

Responsibilities

• Build and operate LLM-backed APIs and integrations with internal and external systems.
• Develop evaluations for agent and RAG workflows to enhance quality and reliability.
• Create ingestion pipelines for efficient data transfer between customer environments and cloud storage.
• Collaborate with Product and Design to refine broad goals into practical specifications.
• Identify and implement improvements, ensuring frequent shipping and follow-through on results.
• Work across backend services and cloud infrastructure, with occasional UI changes to enhance customer experience.

Qualifications

• 3-5 years of experience with backend services and distributed systems in cloud environments, including AWS, Azure, or GCP.
• Production experience with agentic AI and retrieval-augmented generation (RAG).
• Strong proficiency in at least one programming language: Python, Java, or Go.
• Experience with data-intensive systems, including object storage and relational databases.
• Familiarity with AI coding agents and modern AI engineering practices.
• Ability to translate ambiguous goals into actionable plans with Product teams.
• Bachelor's degree in Computer Science or equivalent experience.

Benefits

• Commitment to diversity, equity, inclusion, and belonging in the workplace.
• Collaborative environment that encourages sharing and learning.
• Support for personal and professional growth through continuous learning opportunities.
• Empathetic workplace culture that values unique perspectives and experiences.

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.