Senior Software Engineer - AI Platform / Distributed Systems Engineer

Workato

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Workato is seeking a Staff Software Engineer to define and build the distributed backend powering its AI agent platform. You will architect event-driven services, APIs, gateways, and developer tools that enable AI agents to operate at enterprise scale.

You will influence architectural direction across teams, establish patterns for reliability, and build foundational systems for millions of users as the platform grows. Strong leadership and hands-on execution are essential.

Qualifications

  • 10+ years of experience designing, building, and operating production backend systems at scale.
  • Expert-level proficiency in Python and hands-on technical execution leadership.
  • Deep expertise in distributed systems with partial failure, backpressure, and horizontal scalability.
  • Experience building event-driven, streaming, or real-time systems with messaging or pub/sub.
  • Strong experience designing developer-facing products (APIs, SDKs, CLIs, gateways).
  • Production experience integrating LLMs/AI technologies into enterprise systems; MLP/LMM experience is a plus.

Responsibilities

  • Architect and build scalable, event-driven backend systems that remain correct and available under load.
  • Design core platform capabilities (APIs, streaming, gateways, CLI) powering AI agents and developer products.
  • Lead architectural design across teams and establish patterns for reliability and observability.
  • Integrate LLMs, agent frameworks, MCP, RAG into production systems for enterprise use.
  • Drive end-to-end initiatives from ideation to deployment and operations.
  • Collaborate with Product, Infrastructure, AI Research, and Developer Relations to shape roadmap and developer experience.
  • Establish engineering best practices through architecture reviews and mentorship.
  • Build observable, measurable systems with strong monitoring and tracing.

Skills

Python
Distributed systems
Event-driven
Kubernetes
AWS
LLMs / AI

Tools

PostgreSQL
FastAPI
CI/CD
Pub/Sub

Job description

About Workato

Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the Fortune 500, Workato’s cloud-native architecture connects every application, data source, and process to power real‑time orchestration at scale. With enterprise-grade security and continuous innovation at its core, Workato provides the trusted foundation for organizations to automate with confidence and operationalize AI across the business. To learn more, visit www.workato.com

Why join us?

Ultimately, Workato believes in fostering a flexible, trust-oriented culture that empowers everyone to take full ownership of their roles. We are driven by innovation and looking for team players who want to actively build our company.

But, we also believe in balancing productivity with self-care. That’s why we offer all of our employees a vibrant and dynamic work environment along with a multitude of benefits they can enjoy inside and outside of their work lives.

Also, feel free to check out why:

  • Business Insider named us an “enterprise startup to bet your career on”

  • Forbes’ Cloud 100 recognized us as one of the top 100 private cloud companies in the world

  • Deloitte Tech Fast 500 ranked us as the 17th fastest growing tech company in the Bay Area, and 96th in North America

  • Quartz ranked us the #1 best company for remote workers

Responsibilities

We're looking for an exceptional Staff Software Engineer to help define and build the distributed backend that powers our AI agent platform and the developer-facing products around it. You'll architect the event-driven services, real-time integrations, APIs, gateways, and platform capabilities that enable AI agents to reliably perform work at enterprise scale.

As a Staff Engineer, you'll operate beyond individual features—you'll influence technical direction across teams, establish architectural patterns, and build the foundational systems that will support millions of users as Workato's AI platform continues to grow.

You will:

  • Architect and build highly scalable, event-driven backend systems that remain correct, resilient, and available under partial failure and production load.
  • Design the core platform capabilities—including APIs, streaming services, gateways, CLIs, and developer infrastructure—that power AI agents and developer-facing products.
  • Lead the technical design and evolution of distributed systems, making thoughtful architectural tradeoffs around scalability, reliability, developer experience, and operational excellence.
  • Integrate LLMs, agent frameworks, MCP, RAG, and other AI-native capabilities into production systems that serve enterprise customers.
  • Drive initiatives end-to-end—from product ideation and technical strategy through architecture, implementation, deployment, observability, and continuous improvement.
  • Partner closely with Product, Infrastructure, AI Research, and Developer Relations to shape the roadmap and developer experience for our AI platform.
  • Establish engineering best practices through architecture reviews, design leadership, code reviews, technical mentorship, and raising the engineering bar across the organization.
  • Build systems that are observable, measurable, and resilient, with strong validation, monitoring, tracing, and operational tooling.
  • Influence platform strategy by identifying opportunities to simplify systems, reduce operational complexity, and improve developer productivity.
Requirements
Qualifications / Experience / Technical Skills
  • 10+ years of experience designing, building, and operating production backend systems at scale.
  • Expert-level proficiency in Python, with a demonstrated ability to write clean, maintainable, well-tested code and lead through hands‑on technical execution.
  • Deep expertise in distributed systems, including designing for partial failure, backpressure, concurrency, consistency, fault tolerance, and horizontal scalability.
  • Extensive experience building event-driven, streaming, or real-time systems using messaging platforms, pub/sub architectures, queues, or long-lived connections.
  • Strong experience designing developer-facing products such as APIs, SDKs, CLIs, gateways, platform services, or infrastructure that other engineers build upon.
  • Production experience integrating LLMs, agent frameworks, MCP, RAG, or similar AI technologies into enterprise systems. Experience with LLMOps or ML infrastructure is highly desirable.
  • Strong understanding of observability, monitoring, distributed tracing, metrics, logging, debugging, and operating services in Kubernetes and cloud environments.
  • Excellent architectural judgment with the ability to evaluate tradeoffs across reliability, scalability, cost, security, and developer usability.
  • Demonstrated experience driving technical direction across multiple teams and influencing engineering decisions beyond your immediate organization.
  • Proven history of mentoring engineers, leading architecture discussions, and raising engineering quality across an organization.

Our stack: Python, FastAPI, Postgres, Kubernetes, AWS. You don't need experience with every technology, but you should have a proven ability to learn new technologies quickly and apply them effectively.

What We're Looking For
  • You think like a platform engineer and build systems that other engineers love to use.
  • You have strong product intuition and understand that great developer experience is as important as technical correctness.
  • You naturally take ownership of ambiguous problems and drive them through architecture, implementation, and long-term operation.
  • You design for failure, operational reality, and scale—not just the happy path.
  • You're AI-native and actively leverage modern AI development tools, while staying current with advances in agentic systems and LLM technologies.
  • You're an influential technical leader who elevates the engineers around you through mentorship, thoughtful design reviews, and clear technical communication.
  • You enjoy working across organizational boundaries, aligning stakeholders, and helping define the long-term technical direction of the platform.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer - AI Agent Platforms
Software Engineer - AI Agent Platforms

Workato • San Francisco (CA)

On-site
USD 140,000 - 200,000
Senior Software Engineer (MLAI services)
Senior Software Engineer (MLAI services)

Workato • United States

On-site
USD 150,000 - 190,000
Forward Deployed Engineer
Forward Deployed Engineer

Workato • Town of Boston (NY)

On-site
USD 70,000 - 100,000
Equity
Senior Data Scientist
Senior Data Scientist

Workato • Sofia (NM)

On-site
USD 140,000 - 190,000
Senior Data Scientist
Senior Data Scientist

Workato • Barcelona (LA)

On-site
USD 120,000 - 180,000
Principal Software Engineer, GO & Rust (Engine)
Principal Software Engineer, GO & Rust (Engine)

Workato • Kentucky

On-site
USD 140,000 - 210,000
Principal Software Engineer, GO & Rust (Engine)
Principal Software Engineer, GO & Rust (Engine)

Workato • Berlin (NH)

On-site
USD 180,000 - 240,000
Principal Software Engineer, GO & Rust (Engine)
Principal Software Engineer, GO & Rust (Engine)

Workato • Barcelona (LA)

On-site
USD 180,000 - 240,000
Principal Software Engineer, GO & Rust (Engine)
Principal Software Engineer, GO & Rust (Engine)

Workato • Sofia (NM)

On-site
USD 180,000 - 240,000
Senior Software Engineer
Senior Software Engineer

Workato • San Francisco (CA)

On-site
USD 120,000 - 160,000
Flexible work environment
Health benefits
Professional development opportunities