Senior System Software Engineer, Agentic Retrieval

Ladders; United States; Remote; USD 184,000 - 357,000; Full time

Benefits offered by this job

Cutting-edge AI tech access

Collaborative environment

Professional growth focus

Access to hardware/software platforms

Impactful work for millions

Job summary

Ladders is seeking a Senior System Software Engineer, Agentic Retrieval, to help build GPU-accelerated software for generative AI and LLM workflows. You will collaborate with ML researchers and cross-functional teams to create scalable data processing and retrieval systems.

The role blends systems engineering, optimization, and production readiness to improve reliability, speed, and user experience across AI applications. Remote US-based; visa sponsorship not available.

Qualifications

• Bachelor’s or Master’s in CS/CE or related field or equivalent experience.
• 6+ years of relevant software engineering experience.
• Experience delivering software in a cloud context and managing cloud infrastructure.
• Knowledge of NLP, LLM, VLM, Generative AI and agentic retrieval workflows.
• Strong communication and cross-functional collaboration skills.

Responsibilities

• Develop and optimize Rust-based data processing frameworks for large datasets in GPU-accelerated environments.
• Lead development and optimization of agentic retrieval pipelines for improved performance.
• Collaborate with LLM and ML researchers to create GPU-accelerated data preparation pipelines.
• Implement benchmarking and optimization of algorithms in Python for LLM applications.
• Build and evaluate proof-of-concepts, developing roadmaps for production-level tools.
• Create integrated systems for a unified user experience across applications.
• Maintain continuous delivery pipelines for faster and safer production changes.
• Provide peer reviews and contribute to adoption of new technologies and standards.

Skills

Rust

Python

Cloud platforms

Cross-functional teamwork

Strong communication

Education

Bachelor’s or Master’s in CS/CE or related field

Tools

Docker Compose

Kubernetes

Job description

For our client, we are seeking a Senior System Software Engineer, Agentic Retrieval to join the team of a leader in the Telecommunications & Hardware space.
This role will help shape GPU-accelerated software that supports advanced generative AI and LLM workflows at scale. You will work closely with ML researchers and cross-functional engineering partners to build performant data processing and retrieval systems. The position blends systems engineering, optimization, and production readiness to improve reliability, speed, and the end-user experience across AI applications.
Location: Remote - US based candidates only, no visa sponsorship available
Compensation: $184,000 – $356,500 annually

Responsibilities

• Develop and optimize Rust-based data processing frameworks for large datasets in GPU-accelerated environments
• Lead development and optimization of agentic retrieval pipelines for improved performance
• Collaborate with LLM and ML researchers to create GPU-accelerated data preparation pipelines
• Implement benchmarking and optimization of algorithms in Python for LLM applications
• Build and evaluate proof-of-concepts, developing roadmaps for production-level tools
• Create integrated systems for a unified user experience across applications
• Maintain continuous delivery pipelines for faster and safer production changes
• Provide peer reviews and contribute to the adoption of new technologies and standards

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience
• 6+ years of experience in a similar or related role
• Experience delivering software in a cloud context and managing cloud infrastructure
• Knowledge of MLOps technologies such as Docker Compose, containers, and Kubernetes
• In-depth understanding of NLP, LLM, VLM, Generative AI, and agentic retrieval workflows
• Self-starter with a passion for growth and continuous learning
• Outstanding communication skills with the ability to simplify complex topics
• Ability to work effectively with multi-functional teams across organizational boundaries

Benefits

• Opportunity to work on cutting-edge technology in Generative AI and LLM
• Collaborative environment with diverse teams and experts
• Focus on continuous learning and professional growth
• Access to innovative hardware and software platforms
• Impactful work that enhances user experiences for millions

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.