Software Engineer, Internship - Query Engines

Palantir; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

Palantir seeks a software engineer to join a world-class data processing team supporting Palantir Foundry. You will help design and optimize the data infrastructure that powers hospitals, supply chains, and more.

You will work with open-source data technologies such as Apache Spark, DataFusion, and Iceberg, focusing on performance, correctness, and scalable systems in production. You will collaborate with experienced engineers through design reviews, testing, and releases, ensuring compatibility

Qualifications

• Experience building data processing infrastructure.
• Familiar with open-source data technologies and large-scale systems.
• Ability to work on production-grade data platforms.

Responsibilities

• Contribute to the data processing infrastructure behind Palantir Foundry.
• Work on query planning, execution, and optimization.
• Collaborate in design reviews, testing, and releases to ensure performance and compatibility.

Skills

Software engineering

Data systems

Open-source technologies

Tools

Apache Spark

Apache DataFusion

Apache Iceberg

Job description

A World-Changing Company

Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.

The Role

We are a software engineering team applying open-source data technologies to some of the world's hardest and most important problems. We build the data processing infrastructure that underpins Palantir Foundry, supporting applications that help hospitals care for more patients, help clinical teams coordinate timely diagnoses, and keep essential supplies moving through global disruption.

You will work deep inside the systems that make this possible: how computations are represented, how query plans are optimized, how operators execute, and how data is read and written efficiently. We build on and extend Apache Spark, Apache DataFusion, and Apache Iceberg, bringing advances in open-source engines and table formats into the demanding environments our customers operate in. Our work serves many products and workloads across Foundry, including no-code pipelines, interactive analysis, and the processing that keeps the Ontology up to date.

Working alongside experienced engineers, you will take on real problems in our production systems. That could mean writing a new planning rule, adding a capability to a native execution engine, or making large tables faster to scan. You will see your work through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to everything we build, and you will learn how to deliver all three.

Join us if you want to learn how modern data systems work from the inside and apply that knowledge to consequential problems.