ML Model Serving Infra Engineer - On-Prem & Edge

Palantir Technologies; New York (NY); Hybrid; USD 145,000 - 200,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k plan

Paid time off

Relocation assistance

Job summary

Palantir Technologies is seeking skilled software engineers to develop and maintain high-performance infrastructures for AI model serving in New York City. You will work on integrating various models into production while ensuring compliance with strict security standards.

The role demands strong coding skills and experience with technologies like Java, Python, Docker, and Kubernetes. A competitive salary range of $145,000 - $200,000/year is offered, alongside comprehensive benefits and the opportunity for professional growth.

Qualifications

• 4+ years of professional software engineering experience building and operating production systems.
• Strong coding skills with proficiency in programming languages such as Java, C++, and Python.
• Experience with containers and deploying backend services in production environments.

Responsibilities

• Building high-performance model serving infrastructure that integrates with security and hardware constraints.
• Designing intelligent request handling including authentication and rate limiting.
• Developing observability for production AI systems to enable easy service monitoring.

Skills

Software Engineering

Machine Learning

Containerization

GPU Scheduling

Problem-Solving

Education

Computer Science, Mathematics, Software Engineering, Physics, or similar field

Tools

Java

Python

Kubernetes

Docker

Job description

Palantir Technologies is seeking skilled software engineers to develop and maintain high-performance infrastructures for AI model serving in New York City. You will work on integrating various models into production while ensuring compliance with strict security standards.

The role demands strong coding skills and experience with technologies like Java, Python, Docker, and Kubernetes. A competitive salary range of $145,000 - $200,000/year is offered, alongside comprehensive benefits and the opportunity for professional growth.