Software Engineer - Hosted Model Infrastructure

Palantir; Palo Alto (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Palantir is seeking a software engineer to join its team focused on enabling machine learning models in production. You will work on deploying AI models across various environments, including government networks and enterprises with strict data sovereignty.

Your work will involve end-to-end service ownership and collaboration across the stack—from inference engines and GPU scheduling to deployment pipelines. If you are interested in tackling infrastructure challenges in machine learning, this role is for you.

Qualifications

• Experience in deploying AI models in various environments.
• Ability to manage end-to-end service ownership.
• Understanding of GPU scheduling and deployment pipelines.

Responsibilities

• Solve problems at the intersection of infrastructure and machine learning.
• Deliver new models and capabilities quickly and continuously.
• Work across the full stack from inference engines to integration.

Job description

A World-Changing Company

Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.

The Role

We are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements. Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access. Rising to that challenge and meeting those expectations is what Palantir's excels at.

We treat models like any other software: continuously tested, continually delivered, packaged for reproducible deployment, and built for long-term maintainability. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform. The goal is to deliver new models and capabilities quickly and continuously.

Join us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers.