Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Cast AI, a Miami-headquartered, global team, seeks an experienced ML infrastructure engineer to optimize inference workloads. You will tune throughput, reduce latency, and advance KV cache strategies while managing multi-GPU, multi-node deployments.
You’ll work with vLLM, SGLang, and TensorRT-LLM in a remote-first environment, contributing to performance experiments and scalable systems used across customers.
Cast AI, a Miami-headquartered, global team, seeks an experienced ML infrastructure engineer to optimize inference workloads. You will tune throughput, reduce latency, and advance KV cache strategies while managing multi-GPU, multi-node deployments.
You’ll work with vLLM, SGLang, and TensorRT-LLM in a remote-first environment, contributing to performance experiments and scalable systems used across customers.