Data Engineer- Palantir(Backend)

Birlasoft; Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Birlasoft is seeking a skilled Backend/Data Engineer to design and implement scalable data pipelines and ETL/ELT workflows. You will work with PySpark to process large batches and build curated datasets within Palantir Foundry, focusing on data quality and governance.

The role emphasizes semantic modeling, performance tuning of Spark jobs, and cost-efficient data workflows. A CS/IS degree and hands-on data engineering experience are required for this position in our Bengaluru-based operations.

Qualifications

• Bachelor’s or master’s degree in computer science, information systems, or related field.
• Experience with data engineering and large-scale data processing is preferred.

Responsibilities

• Backend / Data Engineering role focusing on building scalable data pipelines.
• Design and build scalable data pipelines using PySpark for large-scale batch processing.
• Develop robust ETL/ELT workflows within Palantir Foundry.
• Build and maintain curated datasets, semantic models, and reusable data assets.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Implement data quality checks, validation frameworks, and monitoring pipelines.
• Work with data governance, lineage, and metadata management in Foundry.

Skills

Data engineering

PySpark

Spark tuning

Data pipelines

Data quality

Data governance

Semantic models

Education

Bachelor’s or master’s degree in computer science, information systems, or related field

Tools

Palantir Foundry

Job description

About Birlasoft

Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company’s consultative and design-thinking approach empowers societies worldwide, enhancing the efficiency and productivity of businesses. As part of the multibillion-dollar diversified CKA Birla Group, Birlasoft with its 12,000+ professionals, is committed to continuing the Group’s 170-year heritage of building sustainable communities.

Area(s) of responsibility

Educational Background – Bachelor\u2019s degree in Computer Science, Information Technology, or related field.

Location: Any BSL Location

Job Overview

Key Responsibilities:

Education: Bachelor’s or master’s degree in computer science, Information Systems, or equivalent experience.

Job Description

• Backend / Data Engineering


• Design and build scalable data pipelines using PySpark for large-scale batch processing


• Develop robust ETL/ELT workflows within Palantir Foundry


• Build and maintain curated datasets, semantic models, and reusable data assets


• Optimize Spark jobs for performance, scalability, and cost efficiency


• Implement data quality checks, validation frameworks, and monitoring pipelines


• Work with data governance, lineage, and metadata management in Foundry