Data Engineer- Palantir(Backend)

Birlasoft; India; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Birlasoft is seeking a Backend / Data Engineer to design and build scalable data pipelines using PySpark for large-scale batch processing in Bengaluru. The role focuses on developing ETL/ELT workflows within Palantir Foundry, and building curated datasets, semantic models, and reusable data assets.

The ideal candidate will optimize Spark jobs for performance and cost efficiency, implement data quality checks, and collaborate on governance, lineage, and metadata in Foundry.

Qualifications

• Educational background – Bachelor's degree in Computer Science, Information Technology, or related field.
• Bachelor’s or master’s degree in computer science, Information Systems, or equivalent experience.

Responsibilities

• Design and build scalable data pipelines using PySpark for large-scale batch processing.
• Develop robust ETL/ELT workflows within Palantir Foundry.
• Build and maintain curated datasets, semantic models, and reusable data assets.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Implement data quality checks, validation frameworks, and monitoring pipelines.
• Work with data governance, lineage, and metadata management in Foundry.

Job description

Select how often (in days) to receive an alert:

Location: INDIA - BENGALURU - BIRLASOFT OFFICE

Description:

Area(s) of responsibility

About Birlasoft:
Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company’s consultative and design-thinking approach empowers societies worldwide, enhancing the efficiency and productivity of businesses. As part of the multibillion-dollar diversified CKA Birla Group, Birlasoft with its 12,000+ professionals, is committed to continuing the Group’s 170-year heritage of building sustainable communities.)
Educational Background – Bachelor's degree in Computer Science, Information Technology, or related field.
Location: Any BSL Location
Job Overview
Key Responsibilities:
Education: Bachelor’s or master’s degree in computer science, Information Systems, or equivalent experience.
Job Description:
Backend / Data EngineeringDesign and build scalable data pipelines using PySpark for large-scale batch processingDevelop robust ETL/ELT workflows within Palantir FoundryBuild and maintain curated datasets, semantic models, and reusable data assetsOptimize Spark jobs for performance, scalability, and cost efficiencyImplement data quality checks, validation frameworks, and monitoring pipelinesWork with data governance, lineage, and metadata management in Foundry