Senior AI Systems Engineer - LLMs, RAG & Infra

People in AI; San Francisco (CA); On-site; USD 270,000 - 300,000; Full time

Job summary

People in AI is seeking a backend/systems engineer to join a mission-driven SaaS startup reimagining how complex professional services are delivered. This hands-on role focuses on prototyping, shipping, and scaling real features rather than demos.

You’ll split time between user-facing copilots and the infrastructure that powers them, designing RAG pipelines, tuning prompts, and building internal ML tooling for versioning, observability, and orchestration.

Qualifications

• Backend or systems engineering experience
• Exposure to applied AI systems (LLMs, NLP, RAG)
• Proficiency in Python; distributed systems experience a plus
• Familiarity with embeddings and vector databases
• Ability to move fast and own projects from idea to production
• Bonus: experience building eval frameworks or internal ML infra

Responsibilities

• Build LLM-powered assistants to streamline domain expert workflows
• Design RAG pipelines using structured and unstructured internal data
• Develop internal ML tooling for versioning, observability, and orchestration
• Tune prompts, build eval harnesses, and iterate based on real-world feedback
• Contribute to platform components that enable scalable experimentation

Skills

Backend engineering

Applied AI

Python

Distributed systems

Embeddings

Vector databases

Prompt engineering

ML tooling

Project ownership

Tools

Python

TypeScript

Prompting libraries

Orchestration tooling

Job description

People in AI is seeking a backend/systems engineer to join a mission-driven SaaS startup reimagining how complex professional services are delivered. This hands-on role focuses on prototyping, shipping, and scaling real features rather than demos.

You’ll split time between user-facing copilots and the infrastructure that powers them, designing RAG pipelines, tuning prompts, and building internal ML tooling for versioning, observability, and orchestration.