Software Engineer - AI Inference Platform

The Consensus; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation with equity

100% coverage of medical, dental, and vision insurance

Flexible PTO policy

Job summary

The Consensus is looking for a Software Engineer to join our Inference Stack team in San Francisco. You will help develop the infrastructure that powers large-scale LLM inference, ensuring scalability and reliability in our systems.

This role is ideal for engineers who enjoy solving complex integration problems and working across technology stacks. We offer competitive compensation, comprehensive health benefits, and a collaborative work environment.

Qualifications

• Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field.
• Strong background in distributed systems, backend infrastructure, or platform engineering.
• Experience building and operating production systems where reliability, latency, and scale are first-class concerns.

Responsibilities

• Develop infrastructure for managing large-scale distributed LLM inference.
• Work on customer-facing features to low-level infrastructure.
• Improve the reliability and scalability of the inference stack.

Skills

Distributed systems

Production systems

Developer experience

Kubernetes experience

Education

Bachelor's, Master's, or Ph.D. in Computer Science or Engineering

Tools

Kubernetes

Distributed scheduling

Job description

The Consensus is looking for a Software Engineer to join our Inference Stack team in San Francisco. You will help develop the infrastructure that powers large-scale LLM inference, ensuring scalability and reliability in our systems.

This role is ideal for engineers who enjoy solving complex integration problems and working across technology stacks. We offer competitive compensation, comprehensive health benefits, and a collaborative work environment.