AI Insights Backend Engineer: Scalable LLM Pipelines

Axion Ray Inc.; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Generous time off

Equity and benefits

Lunch stipend

Job summary

Axion Ray Inc. in San Francisco is seeking a Senior or Staff Software Engineer to lead our agile backend teams. You will design scalable, data-intensive pipelines and architect APIs, databases, and cloud infrastructure to power agentic systems.

You will mentor engineers, shape technical strategy, and own reliability, observability, and performance of services running on major cloud platforms. Collaboration with product and customers will drive clear technical direction and impactful outcomes.

Qualifications

• 5+ years building and operating production backend or data-intensive systems.
• Production experience with LLM systems, including multi-step, tool-using, or agentic workflows.
• Experience designing distributed systems, asynchronous workflows, and reliable data-processing services.

Responsibilities

• Architect and operate multi-step, tool-using agentic pipelines that convert unstructured data into reliable structured output.
• Build evaluation frameworks, golden datasets, and feedback loops that measure quality and catch regressions.
• Improve model performance through prompt and pipeline optimization, model selection, and fine-tuning where it pays off.
• Own the reliability of cloud-native services: deployment, observability, scalability, and on-call support.
• Mentor engineers and lead cross-team technical initiatives from design through production.

Skills

Backend engineering

LLM workflows

Distributed systems

Data warehousing

Cloud platforms

Job description

Axion Ray Inc. in San Francisco is seeking a Senior or Staff Software Engineer to lead our agile backend teams. You will design scalable, data-intensive pipelines and architect APIs, databases, and cloud infrastructure to power agentic systems.

You will mentor engineers, shape technical strategy, and own reliability, observability, and performance of services running on major cloud platforms. Collaboration with product and customers will drive clear technical direction and impactful outcomes.