Lead Palantir Data Software Engineer

Epam Systems; Hyderabad, Pune District, Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Epam Systems is seeking a Lead Palantir Data Software Engineer to lead transformative data projects in the Insurance domain. The role focuses on building scalable analytics using Palantir Foundry and modern big data tools.

The ideal candidate will design and optimize complex data pipelines, collaborate with stakeholders, and mentor a diverse team in a global setting. Strong Python/PySpark, SQL, and ELT expertise are essential.

Qualifications

• Bachelor's degree or equivalent in Computer Science, Data Science, or related field.
• 9–12 years IT experience with 5+ years in large-scale distributed computing.
• At least 6 months hands-on Palantir Foundry
• Proficiency in Python and PySpark for data pipelines
• Expertise in SQL, including Spark SQL, for advanced querying
• Strong data warehousing and ELT knowledge
• Experience with Agile and Scrum methodologies
• Strong analytical and problem-solving skills
• Ability to work autonomously and communicate clearly
• English upper-intermediate (B2) or higher

Responsibilities

• Design and manage complex data pipelines and analytics solutions.
• Develop scalable workflows using Python and PySpark.
• Optimize querying with Spark SQL.
• Architect data warehousing solutions with ELT and distributed computing.
• Collaborate with stakeholders to align data solutions with goals.
• Apply Agile and Scrum methodologies to drive development.
• Integrate Palantir Foundry for data transformation and visualization.
• Analyze and resolve technical issues for reliability and scalability.
• Mentor team members and foster technical growth.
• Communicate complex concepts to diverse audiences.
• Support cross-functional collaboration in a global team environment

Skills

Palantir Foundry

Python

PySpark

SQL

Spark SQL

ELT techniques

Data warehousing

Agile Scrum

Communication

Mentoring

Education

Bachelor's degree in CS/DS

Job description

We are seeking a highly skilled and experienced Lead Palantir Data Software Engineer to join our dynamic team and lead transformative data projects within the Insurance domain.

This role is ideal for professionals who excel at addressing complex big data challenges, leveraging cutting-edge technologies like Palantir Foundry, and building scalable analytics solutions to empower critical business decision-making.

Responsibilities

• Design and manage complex data pipelines and analytics solutions to address business challenges in the Insurance domain
• Develop scalable workflows using Python and PySpark to handle large datasets efficiently
• Optimize querying and data manipulation through expertise in SQL, with a preference for Spark SQL
• Architect advanced data warehousing solutions, focusing on ELT techniques and distributed computing systems
• Collaborate with stakeholders to align data solutions with organizational goals and requirements
• Apply Agile and Scrum methodologies to drive iterative development processes and deliver results effectively
• Integrate and leverage Palantir Foundry to support advanced data transformation and visualization needs
• Analyze, troubleshoot, and resolve technical issues to ensure data solution reliability and scalability
• Mentor team members, fostering a culture of technical growth and innovation
• Communicate complex technical concepts clearly and professionally to diverse audiences
• Support and enhance cross-functional collaboration in a global, multicultural team environment

Requirements

• Bachelor's degree or equivalent in Computer Science, Data Science, or related field
• 9-12 years of IT experience, including at least 5 years focused on large-scale distributed computing systems
• At least 6 months of hands‑on development experience with Palantir Foundry
• Proficiency in Python and PySpark for building and optimizing data pipelines
• Expertise in SQL, including Spark SQL, for advanced querying and data manipulation
• Strong knowledge of data warehousing principles and ELT techniques
• Background in Agile and Scrum methodologies to manage and execute projects
• Strong analytical and problem‑solving skills for complex data challenges
• Capability to work autonomously and manage workloads effectively
• Proven ability to communicate technical solutions through written and verbal means
• Flexibility to collaborate in a global and multicultural environment
• English language proficiency at an Upper-Intermediate level (B2) or higher

Nice to have

• Background in the Insurance domain or experience in Finance functions across industries
• Familiarity with front-end technologies like HTML, CSS, and JavaScript
• Experience with Gradle for build automation
• Showcase of leading cross-functional or globally distributed teams
• Understanding of machine learning principles for data-driven insights