Lead Palantir Data Software Engineer

Epam Systems; Coimbatore District; On-site; INR 3,200,000 - 5,200,000; Full time

Job summary

Epam Systems in India seeks a Lead Palantir Data Software Engineer to guide transformative data projects within the Insurance domain. You will design scalable data pipelines using Palantir Foundry, Python, PySpark and Spark SQL, implement ELT-based warehousing, mentor teammates and collaborate with stakeholders across geographies.

The ideal candidate has 9–12 years of IT experience, strong distributed computing skills, and can communicate complex concepts clearly in a global, multicultural

Qualifications

• Bachelor's degree in CS/Data Science or related field required.
• 9–12 years IT experience with at least 5 years in large-scale distributed computing.
• At least 6 months hands-on Palantir Foundry development experience.
• Proficient in Python and PySpark for building data pipelines.
• Expert in SQL including Spark SQL for advanced querying.
• Strong knowledge of data warehousing and ELT techniques.
• Experience with Agile/Scrum project management.
• Strong analytical and problem-solving skills.
• Ability to work autonomously in a global team.
• Effective written and verbal communication in English.

Responsibilities

• Design and manage complex data pipelines and analytics solutions in Insurance domain.
• Develop scalable workflows using Python and PySpark for large datasets.
• Optimize querying and data manipulation with Spark SQL and SQL.
• Architect ELT-based data warehousing and distributed computing solutions.
• Collaborate with stakeholders to align data solutions with goals.
• Apply Agile and Scrum methodologies for iterative development.
• Integrate Palantir Foundry to support data transformation and visualization needs.
• Troubleshoot and resolve data solution issues to ensure reliability and scalability.
• Mentor team members and foster technical growth.
• Communicate complex technical concepts to diverse audiences.
• Support cross-functional collaboration in a global environment.

Skills

Python

PySpark

Spark SQL

SQL

Data warehousing

ELT

Agile/Scrum

Communication

English proficiency

Palantir Foundry

Education

Bachelor's degree in Computer Science/Data Science or related field

Tools

Palantir Foundry

Job description

We are seeking a highly skilled and experienced Lead Palantir Data Software Engineer to join our dynamic team and lead transformative data projects within the Insurance domain.

This role is ideal for professionals who excel at addressing complex big data challenges, leveraging cutting-edge technologies like Palantir Foundry, and building scalable analytics solutions to empower critical business decision-making.

Responsibilities

• Design and manage complex data pipelines and analytics solutions to address business challenges in the Insurance domain
• Develop scalable workflows using Python and PySpark to handle large datasets efficiently
• Optimize querying and data manipulation through expertise in SQL, with a preference for Spark SQL
• Architect advanced data warehousing solutions, focusing on ELT techniques and distributed computing systems
• Collaborate with stakeholders to align data solutions with organizational goals and requirements
• Apply Agile and Scrum methodologies to drive iterative development processes and deliver results effectively
• Integrate and leverage Palantir Foundry to support advanced data transformation and visualization needs
• Analyze, troubleshoot, and resolve technical issues to ensure data solution reliability and scalability
• Mentor team members, fostering a culture of technical growth and innovation
• Communicate complex technical concepts clearly and professionally to diverse audiences
• Support and enhance cross-functional collaboration in a global, multicultural team environment

Requirements

• Bachelor's degree or equivalent in Computer Science, Data Science, or related field
• 9-12 years of IT experience, including at least 5 years focused on large-scale distributed computing systems
• At least 6 months of hands‑on development experience with Palantir Foundry
• Proficiency in Python and PySpark for building and optimizing data pipelines
• Expertise in SQL, including Spark SQL, for advanced querying and data manipulation
• Strong knowledge of data warehousing principles and ELT techniques
• Background in Agile and Scrum methodologies to manage and execute projects
• Strong analytical and problem‑solving skills for complex data challenges
• Capability to work autonomously and manage workloads effectively
• Proven ability to communicate technical solutions through written and verbal means
• Flexibility to collaborate in a global and multicultural environment
• English language proficiency at an Upper-Intermediate level (B2) or higher

Nice to have

• Background in the Insurance domain or experience in Finance functions across industries
• Familiarity with front-end technologies like HTML, CSS, and JavaScript
• Experience with Gradle for build automation
• Showcase of leading cross-functional or globally distributed teams
• Understanding of machine learning principles for data-driven insights