A leading AI evaluation platform is seeking a Backend Engineer to develop high-performance APIs and infrastructure. This role involves solving complex streaming issues, working with cloud technologies, and collaborating with founders to innovate AI solutions. Ideal candidates will have expertise in Go or Rust, strong backend experience, and a mindset focused on product development in a dynamic startup environment. Competitive compensation ranges from $200k to $350k of USD plus equity.
Qualifications
4+ years of backend engineering experience, especially on distributed systems.
Strong proficiency in Go and/or Rust with high-throughput APIs.
Experience with LLM APIs and challenges like streaming and token management.
Responsibilities
Build API-based products with high reliability and low latency.
Handle streaming problems and ensure consistent response normalization.
Create enterprise-grade infrastructure including rate limiting and auditing.
Skills
Backend engineering experience
Proficiency in Go or Rust
Experience with LLM provider APIs
Cloud infrastructure skills
Developer experience mindset
Comfort with ambiguity
Tools
AWS
GCP
Kubernetes
Terraform
Postgres
Redis
Job description
A leading AI evaluation platform is seeking a Backend Engineer to develop high-performance APIs and infrastructure. This role involves solving complex streaming issues, working with cloud technologies, and collaborating with founders to innovate AI solutions. Ideal candidates will have expertise in Go or Rust, strong backend experience, and a mindset focused on product development in a dynamic startup environment. Competitive compensation ranges from $200k to $350k of USD plus equity.