Backend Engineer — Scalable LLM Infrastructure

Conduct; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

Conduct is seeking exceptional builders to design and ship foundational infrastructure that scales to the world’s largest enterprises. You’ll own broad architecture and production systems that support massive LLM workloads with enterprise-grade reliability.

You’ll work across APIs, data flows, and infrastructure, delivering internal tooling and abstractions that let product teams move faster while maintaining safety and governance.

Qualifications

• 3+ years backend experience with exposure to platform or infrastructure work.
• Strong system design instincts across APIs, infrastructure, and data flows.
• Experience with distributed systems, scaling databases (Postgres), queues, and large-scale batch processing.
• Ability to benchmark and tune systems under real load and make pragmatic trade-offs when data is ambiguous.
• Familiar with LLM infrastructure at scale.
• Able to raise the bar through code, mentorship, and better systems.

Responsibilities

• Accelerate product teams by building the platform and internal tools.
• Scale infrastructure to meet enterprise reliability requirements.
• Tame LLM infrastructure with high token throughput and real-time usage.
• Raise the floor from auth to observability and job orchestration with solid design from the start.

Skills

Backend experience

System design

Distributed systems

Benchmarking

LLM infrastructure

Mentorship

Tools

React

Vite

TanStack

Kotlin

Temporal

PortKey

LLM Harness

Job description

Conduct is seeking exceptional builders to design and ship foundational infrastructure that scales to the world’s largest enterprises. You’ll own broad architecture and production systems that support massive LLM workloads with enterprise-grade reliability.

You’ll work across APIs, data flows, and infrastructure, delivering internal tooling and abstractions that let product teams move faster while maintaining safety and governance.