Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
BoodleBox is seeking a Senior Software Engineer for AI Systems & Scalability. You will own production backends in Python and Scala, optimize latency and throughput, and explore self-hosted inference to reduce costs.
You’ll operate in a fully remote environment across the United States, contributing to a GenAI platform used by 100,000+ users. You will focus on designing scalable services, monitoring, and cost-aware architectures while collaborating with teams to deploy robust AI capabilities.
Full-time Remote, United States
Make BoodleBox’s AI platform faster and cheaper per request across Scala and Python, and lead the move to self-hosted inference where the numbers support it.
BoodleBox is a VC-backed GenAI platform built for higher education. With 100,000+ users across 1,200+ colleges and universities, we partner with faculty, staff, and students to make responsible AI adoption practical, impactful, and lasting. We're guided by three core values: service, education, and collaboration.
You're a backend engineer who is at home in a Scala service and a Python service on the same day. You take it personally when a request is slow. You've stood up a model behind an API under real load, watched the GPU utilization, and can tell us what it cost per request. You have enough MLOps to run models in production and no interest in training them. You find the bottleneck before you ask for more machines.
BoodleBox is already a generative AI platform in production: Scala and Python microservices on Kubernetes, hundreds of thousands of users, models served today through managed providers. We want to make the one we have faster, more scalable, and more flexible about where models run — including evaluating and implementing self-hosted inference for embeddings, re-rankers, document-processing models, and possibly open-weight LLMs.