Hybrid ML Staff Engineer: AI Platform & Backend

Freshworks; San Mateo; Hybrid; PHP 12,985,000 - 16,062,000; Full time

Benefits offered by this job

Hybrid work model

Health insurance

Equity + ESPP

Flexible PTO

Parental leave

Job summary

Freshworks in San Mateo, CA is seeking a Machine Learning Staff Engineer to lead the development of core backend services powering our Agentic AI Platform. You will drive reasoning-driven agents, multi-agent orchestration, and outcome-based workflows, collaborating with the Principal AI Architect to bridge high-level design and scalable implementation.

You will own high-performance APIs and orchestration runtimes, integrating LangChain, LangGraph, and LangSmith.

Qualifications

• 6+ years of backend engineering experience.
• 1-2+ years hands-on AI/ML platform development experience.
• Proficiency in Java and Python.
• Hands-on experience with LangChain, LangGraph, or LangSmith.
• Deep understanding of event-driven architectures, microservices, and Kubernetes.
• Solid experience with AWS, Terraform, PostgreSQL, and vector databases.
• Experience with workflow engines like Temporal or Airflow and messaging systems like Kafka.

Responsibilities

• Lead implementation of agent runtime orchestration services focusing on reasoning, planning, and tool invocation.
• Own development of robust APIs and SDKs for internal and external teams.
• Build and optimize stateful dialog management and memory services for multi-turn agents.
• Implement multi-agent communication protocols and shared context systems.
• Drive transition to cloud-native backend services with microservices or service mesh architectures.
• Design workflows with Temporal or Airflow for long-running operations.
• Optimize orchestration performance and cost via caching, batching, and token monitoring.

Skills

Backend engineering

AI/ML platform

Java

Python

LangChain

LangGraph

LangSmith

Event-driven

Microservices

Kubernetes

AWS

Terraform

PostgreSQL

Vector databases

Temporal

Airflow

Kafka

Job description

Freshworks in San Mateo, CA is seeking a Machine Learning Staff Engineer to lead the development of core backend services powering our Agentic AI Platform. You will drive reasoning-driven agents, multi-agent orchestration, and outcome-based workflows, collaborating with the Principal AI Architect to bridge high-level design and scalable implementation.

You will own high-performance APIs and orchestration runtimes, integrating LangChain, LangGraph, and LangSmith.