ML Model Serving Infra Engineer - On-Prem & Edge

Palantir Technologies; Palo Alto (CA); Hybrid; USD 145,000 - 200,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k plan

Paid time off

Job summary

Palantir Technologies is looking for a Software Engineer to enhance its AI modeling capabilities. You will develop and maintain production systems, ensuring robust model serving infrastructure.

The ideal candidate has 4+ years of software engineering experience, strong coding abilities in languages like Java and Python, and is well-versed in containers and Kubernetes. Benefits include comprehensive health insurance, paid time off, 401k plan, and more.

Qualifications

• 4+ years of professional software engineering experience.
• Strong coding skills in Java, C++, Python, Rust, or similar.
• Experience with containers and Kubernetes.

Responsibilities

• Build high-performance model serving infrastructure.
• Design intelligent request handling and authentication.
• Develop observability for production AI systems.
• Integrate hosted model infrastructure with deployment systems.

Skills

Java

Python

Kubernetes

Rust

C++

Education

Computer Science, Mathematics, Software Engineering, Physics, or related field

Tools

Docker

GitHub

Job description

Palantir Technologies is looking for a Software Engineer to enhance its AI modeling capabilities. You will develop and maintain production systems, ensuring robust model serving infrastructure.

The ideal candidate has 4+ years of software engineering experience, strong coding abilities in languages like Java and Python, and is well-versed in containers and Kubernetes. Benefits include comprehensive health insurance, paid time off, 401k plan, and more.