Una candidatura completa in un minuto
Curriculum e lettera di presentazione personalizzati, pronti da inviare.
Lyceum is building an AI inference platform and seeks an engineer to ensure reliability, security, and scalability as user demand grows. You will focus on keeping the platform up under pressure, preventing outages, and delivering faster responses through careful design and optimization.
Your work includes scalable routing and resource scheduling, robust monitoring, and integrating open-source inference frameworks to improve throughput and latency across GPU clusters.
You will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time.
Scalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters.
Reliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime.
Performance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer.
Infrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack.
We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.