Senior AI Engineer — Real-Time ML & LLM Systems

ServiceTitan, Inc.; San Francisco (CA); On-site; USD 168,000 - 270,000; Full time

Benefits offered by this job

Comprehensive onboarding program

401k match

Medical, dental, and vision coverage

Flexible time off

Tuition and learning opportunities

Job summary

ServiceTitan is seeking a Senior AI Engineer to build scalable, low-latency ML systems using Python and Azure. You’ll design end-to-end ML pipelines, deploy models including LLMs, and collaborate with product teams for production readiness.

Responsibilities include optimizing performance, handling real-time data, and communicating across engineering, product, and customers in a fast-paced, distributed environment. On-site in California.

Qualifications

• 5+ years of experience writing production-level code in Python.
• 2+ years of experience deploying ML models to production at scale.
• Experience designing and deploying scalable ML inference services for real-time or high-throughput apps.
• Advanced knowledge of ML methods, including traditional ML and deep learning.
• Experience with RL techniques and online optimization in production.
• Strong ML lifecycle understanding from experimentation to deployment.
• Experience with data platforms such as SQL Server, PostgreSQL, Redshift, and Snowflake.
• Experience with public cloud environments such as Azure or AWS.
• Experience with microservices and asynchronous messaging (Kafka, Azure Service Bus).
• Experience with serverless architecture (Azure Functions, AWS Lambda).
• Azure Cognitive Services or similar cloud AI offerings is a plus.
• Experience with Git, unit testing, debugging, profiling, and JIRA.

Responsibilities

• Design and implement scalable, low-latency ML systems and services, covering model training, inference, and deployment infrastructure.
• Partner with product teams to operationalize and deploy ML models into production, including LLMs and specialized models.
• Improve performance and real-time responsiveness of ML pipelines to support strong customer experience with minimal latency.
• Communicate effectively with engineers, product managers, customers, and partners.

Skills

Python

ML deployment

RL

ML lifecycle

SQL Server

PostgreSQL

Redshift

Snowflake

Azure

AWS

Kafka

Azure Service Bus

Azure Functions

AWS Lambda

Azure Cognitive Services

Git

JIRA

Tools

Git

JIRA

Kafka

Azure Functions

AWS Lambda

Azure

AWS

SQL Server

PostgreSQL

Redshift

Snowflake

Azure Service Bus

Job description

ServiceTitan is seeking a Senior AI Engineer to build scalable, low-latency ML systems using Python and Azure. You’ll design end-to-end ML pipelines, deploy models including LLMs, and collaborate with product teams for production readiness.

Responsibilities include optimizing performance, handling real-time data, and communicating across engineering, product, and customers in a fast-paced, distributed environment. On-site in California.