Senior Software Engineer (AI Infra + Systems)

Jobot; Atlanta (GA); Remote; USD 170,000 - 200,000; Full time

Benefits offered by this job

Fully Remote

Equity

Healthcare benefits

Autonomy and growth

Job summary

Jobot is seeking a Senior Software Engineer for AI Infra and Systems to help scale our production AI backend and model-serving infrastructure. You will work across Python/Scala microservices, Kubernetes, and cloud deployments, delivering high-performance, reliable systems for inference-heavy applications.

You will collaborate with a senior engineering team, enjoy autonomy, and participate in equity opportunities as the company grows.

Qualifications

• 5+ years of backend experience with Python and Scala.
• Experience designing distributed systems and microservices in production.
• Hands-on with Kubernetes and containerized apps in cloud environments.
• Proficient in diagnosing performance bottlenecks (latency, concurrency).
• Experience deploying ML models via production APIs and model serving.

Responsibilities

• Build and optimize production AI backend services using Python/Scala.
• Improve scalability, performance, and resource utilization of high-traffic apps.
• Optimize model inference with self-hosted options, GPU use, autoscaling.
• Own production reliability: monitor, deploy, and maintain AI services on Kubernetes.
• Collaborate to improve system architecture and deliver scalable AI capabilities.

Skills

Python

Scala

Distributed systems

Performance optimization

MLOps

Tools

Kubernetes

Job description

Senior Software Engineer (AI Infra + Systems)

$170000 - $200000 per year | Atlanta, GA | Remote | Permanent

Fully remote, well-funded AI startup. Excellent benefits, stable future, room for growth!

A bit about us:

We’re an early-stage AI startup on a mission to redefine how users interact with intelligent systems. We’re building something brand new and we’re looking for talent to help us scale our platform services.

Why join us?

• Fully Remote
• Well-funded
• Senior team of proven engineers
• Autonomy and upward mobility
• Competitive compensation
• Lucrative Equity
• Great healthcare benefits

Job Details

This position focuses on improving the performance, reliability, and efficiency of AI-powered applications while expanding the organization’s model-serving capabilities. You’ll work across backend engineering, distributed systems, and production AI infrastructure, with an emphasis on optimizing inference performance, reducing latency, and evaluating opportunities to move from managed AI services toward self-hosted models.

What You’ll Do

• Build & Maintain AI Backend Services: Develop and optimize production microservices using Python and Scala, supporting AI integrations, application APIs, and distributed backend systems.
• Improve Scalability & Performance: Identify and eliminate bottlenecks involving latency, concurrency, throughput, and resource utilization across high-traffic applications.
• Optimize Model Inference: Evaluate and implement model-serving architectures, including self-hosted inference, GPU utilization, autoscaling, and cost optimization.
• Own Production Reliability: Manage the performance, monitoring, deployment, and operational health of AI services running in Kubernetes.
• Drive Technical Improvements: Collaborate across engineering teams to improve system architecture, measure performance, and deliver scalable AI capabilities.

What We’re Looking For

• 5 + years of experience minimally. Fluent on the backend with Python and Scala
• Experience designing, developing, and maintaining distributed systems and microservices in production.
• Hands-on experience with Kubernetes, containerized applications, and cloud infrastructure.
• Demonstrated ability to diagnose and resolve performance bottlenecks involving latency, concurrency, and system throughput.
• Experience deploying or operating ML models through production APIs, with an understanding of inference performance.
• Practical knowledge of MLOps principles related to model serving, monitoring, deployment, and operational reliability.
• Familiarity with LLM-powered applications and the backend architecture supporting generative AI systems.
• Strong understanding of production observability, including logging, metrics, tracing, and performance monitoring.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information or any other basis protected by applicable federal, state, or local laws. Jobot also prohibits harassment of applicants or employees based on any of these protected categories. It is Jobot’s policy to comply with all applicable federal, state and local laws respecting consideration of unemployment status in making hiring decisions.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Information collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Jobot, and/or its agents and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: jobot.com/privacy-policy