Staff AI Platform Engineer — Equity & API Leadership

Nscale; New York (NY); On-site; USD 220,000 - 293,000; Full time

Benefits offered by this job

Medical, dental, vision

Flexible paid time off

Parental leave

Retirement plan participation

Job summary

Nscale is seeking a Staff AI Product Engineer to drive the technical direction of its AI product platform. You will set patterns, APIs, and systems spanning AI services, API gateway, and developer experience to deliver scalable and reliable products.

You will define how the platform is built, guide cross-team decisions, and influence overall product velocity while ensuring security, identity, and extensibility surfaces support enterprise customers.

Qualifications

• 8–12 years of software engineering experience.
• Proven ability to set technical direction for a product domain, including cross-team architectural patterns.
• Deep expertise in API design, platform engineering, and large-scale distributed systems.
• Experience designing cloud services with clear control plane / data plane separation and cell-based architecture for horizontal scalability and blast-radius isolation.
• Experience building and operating developer-facing platforms used by large numbers of engineers or customers.
• Proven ability to define provisioning contracts for onboarded teams.
• Experience with dependency-ordered composition across services.
• Experience setting versioning and compatibility policy for customer-facing surfaces.
• Hands-on production ownership at scale including on-call experience.
• Track record of improving reliability and managing costs as a platform scales.

Responsibilities

• Set technical direction for the AI product platform domain across multiple teams.
• Drive cross-team architectural decisions: service boundaries, API contracts, data models, and platform standards.
• Identify and lead systemic improvements - performance, reliability, cost, or developer experience.
• Resolve ambiguous, open-ended technical problems at scale.
• Coach and grow Senior AI Product Engineers across teams.
• Partner with product leadership to align technical strategy with business goals.
• Evaluate build-vs-buy decisions for key platform capabilities.
• Represent the product engineering domain in cross-functional reviews.

Skills

API design

Platform engineering

Distributed systems

Cloud services

On-call ownership

SLO & incidents

Cost visibility

Cross-team influence

Technical standards

Tools

Terraform provider

Job description

Nscale is seeking a Staff AI Product Engineer to drive the technical direction of its AI product platform. You will set patterns, APIs, and systems spanning AI services, API gateway, and developer experience to deliver scalable and reliable products.

You will define how the platform is built, guide cross-team decisions, and influence overall product velocity while ensuring security, identity, and extensibility surfaces support enterprise customers.