Evaluation Infra Engineer — Scalable ML & GPU Equity

Maven Ventures; Palo Alto (CA); Presencial; USD 180 000 - 440 000; Tempo integral

Resumo da oferta

SpaceXSI in Palo Alto is seeking an engineer to help develop our evaluation infrastructure. You will build reliable, scalable systems that run all model evaluations, collaborating with modeling and evaluation teams to expand our evals and improve signal quality.

You will tackle bottlenecks across the stack, from inference to scheduling and orchestration, and help design interfaces for comparing models and evals.

Qualificações

• Experience in building, debugging, and optimizing efficiency of large-scale distributed systems.
• Willingness to dive deep and solve hard problems at all levels of the stack.

Responsabilidades

• Build highly reliable, efficient, and easy to use infrastructure that runs all our evaluations at scale.
• Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models.
• Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more

Conhecimentos

LLM inference

GPU compute management

Workload scheduling

Dynamic resource optimization

Interfaces for comparing models and ev

Descrição da oferta de emprego

SpaceXSI in Palo Alto is seeking an engineer to help develop our evaluation infrastructure. You will build reliable, scalable systems that run all model evaluations, collaborating with modeling and evaluation teams to expand our evals and improve signal quality.

You will tackle bottlenecks across the stack, from inference to scheduling and orchestration, and help design interfaces for comparing models and evals.