Staff Engineer — Core Infra & AI Platform (Hybrid)

TrueFoundry; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Comprehensive health insurance for you

Lunch and snacks provided

Flex hybrid work: 2 days in office

Work from another TrueFoundry office 3

Job summary

TrueFoundry is hiring a Staff Engineer – Core Engineering to help build a unified compute layer and governance for AI production systems. You will own system design, drive architectural decisions, and lead US-based engineering efforts to scale the platform across multiple components.

The role requires deep expertise in distributed systems, cloud-native architectures, and practical ML/GenAI deployment experience, with strong leadership and customer collaboration skills.

Qualifications

• Strong backend / systems engineering experience at top technology companies or startups.
• Deep expertise in distributed systems, cloud-native architectures, and scalable system design.
• Strong working knowledge of Kubernetes, containerized workloads, and infrastructure engineering.
• Practical experience building or deploying ML/GenAI applications (or closely working with ML/DS teams).
• Solid understanding of system observability, resiliency design, and SRE practices.
• Strong technical leadership and communication skills — able to work with both customers and engineering teams.
• Ability to think strategically while also executing hands-on when required.

Responsibilities

• Develop deep expertise across TrueFoundry’s platform stack infrastructure, deployment systems, LLM/ML orchestration, observability, cost optimization, and more.
• Drive the system architecture and design for complex, distributed, cloud-native systems.
• Act as the technical point-of-contact for enterprise customer engineering needs and escalations.
• Lead and participate in design reviews, code reviews, and critical incident responses.
• Collaborate closely with the CTO on architectural decisions, scaling strategies, and technical roadmap prioritization.
• Guide and mentor US-based engineers across multiple initiatives, helping them deliver high-quality, scalable systems.
• Identify and drive technical debt cleanup, performance improvements, and resilience upgrades across the platform.
• Bring a product engineering mindset, ensuring that customer needs and feedback translate into scalable engineering solutions.

Skills

Python

Go

TypeScript

Distributed systems

System observability

SRE practices

Leadership

Tools

Kubernetes

Containerized workloads

Cloud-native

Job description

TrueFoundry is hiring a Staff Engineer – Core Engineering to help build a unified compute layer and governance for AI production systems. You will own system design, drive architectural decisions, and lead US-based engineering efforts to scale the platform across multiple components.

The role requires deep expertise in distributed systems, cloud-native architectures, and practical ML/GenAI deployment experience, with strong leadership and customer collaboration skills.