Palantir Data Engineer

Tata Consultancy Services; Mumbai; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Tata Consultancy Services is seeking immediate joiners for the role of Data Engineer in Mumbai, India. This position focuses on designing and building robust data pipelines, ensuring high-quality data through ingestion and transformation processes, and integrating diverse data sources into Palantir Foundry.

The ideal candidate will have expertise in Python and Pyspark, with a minimum of 4 years of hands-on experience. The role also involves collaboration with cross-functional teams to develop data solutions and promote best practices in data management.

Qualifications

• Minimum 4 years of experience in Python and Pyspark.
• Hands-on experience with BI tools and SQL.
• Familiarity with Palantir Tools.

Responsibilities

• Design and optimize the data ecosystem.
• Develop data pipelines and manage data integration.
• Collaborate with teams to meet business needs.

Skills

Python

Pyspark

BI tools

SQL queries

Palantir Tools

Job description

LOOKING FOR IMMEDIATE JOINERS

Role & responsibilities

• The Data Engineer is responsible for designing, building, and optimizing our data ecosystem. With a focus on delivering high-quality and trustworthy data, the Data Engineer's responsibilities include:
• Data Ingestion and Transformation: Ingesting data from various sources, transforming, cleaning, and enriching it for use in Palantir Foundry.
• Data Pipeline Development: Designing and implementing robust and scalable data pipelines to ensure data flow within Foundry.
• Ontology Development: Contributing to the development and maintenance of the data ontology within Foundry.
• Data Integration: Integrating diverse data sources into Palantir Foundry using its data connectors.
• Collaboration: Working with cross-functional teams to understand business requirements and develop solutions using Palantir Foundry.
• Problem Solving: Identifying and resolving issues related to data quality, access, and performance.
• Application Development: Potentially contributing to the development of applications within the Foundry ecosystem.
• Data Analytics: Leveraging data analytics and machine learning for insights and solutions.
• Knowledge Sharing: Stay at the forefront of Big Data technology evolution and ensure this knowledge is disseminated across the organization. Promote best practices, stablished standards, governed processes, and the adoption of the latest technologies.

Must have skills

• Expertise and experience in Python and Pyspark (at least 4 years of experience)
• Experience with BI tools, SQL queries, and organizing and analyzing data
• Should have working knowledge and hands-on experience on the following Palantir Tools - Data Connection, Ontology, Code Workbook/Code Repository, Contour, Quiver, Workshop and Slate