Senior System Software Engineer — GPU AI Pipelines (Remote)

Ladders; United States; Remote; USD 184,000 - 357,000; Full time

Benefits offered by this job

Cutting-edge AI tech access

Collaborative environment

Professional growth focus

Access to hardware/software platforms

Impactful work for millions

Job summary

Ladders is seeking a Senior System Software Engineer, Agentic Retrieval, to help build GPU-accelerated software for generative AI and LLM workflows. You will collaborate with ML researchers and cross-functional teams to create scalable data processing and retrieval systems.

The role blends systems engineering, optimization, and production readiness to improve reliability, speed, and user experience across AI applications. Remote US-based; visa sponsorship not available.

Qualifications

• Bachelor’s or Master’s in CS/CE or related field or equivalent experience.
• 6+ years of relevant software engineering experience.
• Experience delivering software in a cloud context and managing cloud infrastructure.
• Knowledge of NLP, LLM, VLM, Generative AI and agentic retrieval workflows.
• Strong communication and cross-functional collaboration skills.

Responsibilities

• Develop and optimize Rust-based data processing frameworks for large datasets in GPU-accelerated environments.
• Lead development and optimization of agentic retrieval pipelines for improved performance.
• Collaborate with LLM and ML researchers to create GPU-accelerated data preparation pipelines.
• Implement benchmarking and optimization of algorithms in Python for LLM applications.
• Build and evaluate proof-of-concepts, developing roadmaps for production-level tools.
• Create integrated systems for a unified user experience across applications.
• Maintain continuous delivery pipelines for faster and safer production changes.
• Provide peer reviews and contribute to adoption of new technologies and standards.

Skills

Rust

Python

Cloud platforms

Cross-functional teamwork

Strong communication

Education

Bachelor’s or Master’s in CS/CE or related field

Tools

Docker Compose

Kubernetes

Job description

Ladders is seeking a Senior System Software Engineer, Agentic Retrieval, to help build GPU-accelerated software for generative AI and LLM workflows. You will collaborate with ML researchers and cross-functional teams to create scalable data processing and retrieval systems.

The role blends systems engineering, optimization, and production readiness to improve reliability, speed, and user experience across AI applications. Remote US-based; visa sponsorship not available.