Senior Software Engineer (AI Infra + Systems)

Jobot

United States

Remote

USD 170,000 - 200,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote
Competitive compensation
Lucrative Equity
Great healthcare benefits

Job summary

Jobot is seeking a senior backend engineer for a fully remote AI startup. You will develop and optimize production AI backend services using Python and Scala, focusing on scalable model serving and end-to-end reliability.

With 5+ years of backend experience, you will design distributed systems, deploy ML models via production APIs, and ensure low latency and high throughput in Kubernetes-based environments. Equity and strong healthcare benefits accompany the role.

Qualifications

  • This role requires 5+ years of backend experience and strong knowledge of Python and Scala.
  • Experience designing and maintaining distributed systems and microservices in production.
  • Hands-on experience with Kubernetes, containers, and cloud infrastructure.
  • Experience deploying ML models via production APIs and understanding inference performance.
  • Knowledge of MLOps related to model serving, monitoring, and reliability.
  • Familiarity with LLM-powered applications and production observability (logs, metrics, tracing).

Responsibilities

  • Build and optimize production AI backend services using Python/Scala.
  • Improve scalability, latency, throughput, and resource utilization for high-traffic apps.
  • Evaluate and implement model-serving architectures including self-hosted inference.
  • Own production reliability: monitor, deploy, and maintain AI services in Kubernetes.
  • Collaborate with teams to improve system architecture and performance of AI capabilities.

Skills

Python
Scala
Distributed systems
Backend development
Kubernetes

Tools

Kubernetes

Job description

A bit about us

We’re an early-stage AI startup on a mission to redefine how users interact with intelligent systems. We’re building something brand new and we’re looking for talent to help us scale our platform services.

Why join us?
  • Fully Remote
  • Well-funded
  • Senior team of proven engineers
  • Autonomy and upward mobility
  • Competitive compensation
  • Lucrative Equity
  • Great healthcare benefits

Fully remote, well-funded AI startup. Excellent benefits, stable future, room for growth!

Salary: $170,000 - $200,000 per year

Job Details

This position focuses on improving the performance, reliability, and efficiency of AI-powered applications while expanding the organization’s model-serving capabilities. You’ll work across backend engineering, distributed systems, and production AI infrastructure, with an emphasis on optimizing inference performance, reducing latency, and evaluating opportunities to move from managed AI services toward self-hosted models.

What You’ll Do
  • Build & Maintain AI Backend Services: Develop and optimize production microservices using Python and Scala, supporting AI integrations, application APIs, and distributed backend systems.
  • Improve Scalability & Performance: Identify and eliminate bottlenecks involving latency, concurrency, throughput, and resource utilization across high-traffic applications.
  • Optimize Model Inference: Evaluate and implement model-serving architectures, including self-hosted inference, GPU utilization, autoscaling, and cost optimization.
  • Own Production Reliability: Manage the performance, monitoring, deployment, and operational health of AI services running in Kubernetes.
  • Drive Technical Improvements: Collaborate across engineering teams to improve system architecture, measure performance, and deliver scalable AI capabilities.
What We’re Looking For
  • 5 + years of experience minimally.
  • Fluent on the backend with Python and Scala.
  • Experience designing, developing, and maintaining distributed systems and microservices in production.
  • Hands‑on experience with Kubernetes, containerized applications, and cloud infrastructure.
  • Demonstrated ability to diagnose and resolve performance bottlenecks involving latency, concurrency, and system throughput.
  • Experience deploying or operating ML models through production APIs, with an understanding of inference performance.
  • Practical knowledge of MLOps principles related to model serving, monitoring, deployment, and operational reliability.
  • Familiarity with LLM‑powered applications and the backend architecture supporting generative AI systems.
  • Strong understanding of production observability, including logging, metrics, tracing, and performance monitoring.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information or any other basis protected by applicable federal, state, or local laws. Jobot also prohibits harassment of applicants or employees based on any of these protected categories. It is Jobot’s policy to comply with all applicable federal, state and local laws respecting consideration of unemployment status in making hiring decisions. Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer (AI Infra + Systems)
Senior Software Engineer (AI Infra + Systems)

Jobot • Atlanta (GA)

Remote
USD 170,000 - 200,000
Fully Remote
Equity
Healthcare benefits
+1
Engineering Lead (Delivery)
Engineering Lead (Delivery)

Jobot • United States

Remote
USD 170,000 - 200,000
Fully remote
Well-funded
Senior engineering team
+4
Senior Software Engineer (Python)
Senior Software Engineer (Python)

Jobot • Little Rock (AR)

Remote
USD 175,000 - 210,000
Unlimited PTO
WFH Stipend
Competitive Compensation
+1
Senior Software Engineer (Python)
Senior Software Engineer (Python)

Jobot • Miami (FL)

Remote
USD 175,000 - 210,000
Unlimited PTO
WFH Stipend
Competitive Compensation
Senior AI Systems Engineer (RAG)
Senior AI Systems Engineer (RAG)

Jobot • United States

Remote
USD 170,000 - 200,000
Fully Remote
Well-funded
Equity
+2
Staff Software Engineer
Staff Software Engineer

Jobot • San Francisco (CA)

On-site
USD 275,000 - 400,000
Senior MLOps Engineer
Senior MLOps Engineer

Jobot • United States

Remote
USD 150,000 - 175,000
Competitive base salary
Equity options
Medical, dental, and vision insurance
+6
Senior AI/ML Engineer
Senior AI/ML Engineer

Jobot • McLean (VA)

Remote
USD 160,000 - 200,000
Health, Vision, Dental coverage
100% remote in US
Equal opportunity employer
Senior Backend Engineer - Remote
Senior Backend Engineer - Remote

Jobs via Dice • United States

Remote
USD 170,000 - 220,000
Remote flexibility
Equity (0.5-0.7%)
Opportunity to work on innovative projects
Senior / Staff Software Engineer (Agentic AI Infrastructure)
Senior / Staff Software Engineer (Agentic AI Infrastructure)

Jobot • New York (NY)

On-site
USD 200,000 - 250,000
Equity
Onsite office
Remote days