Data Engineer III

Crossell; Bengaluru; On-site; INR 1,500,000 - 2,000,000; Full time

Job summary

Crossell in Bengaluru is seeking an experienced Data Engineer to develop and maintain data solutions using Palantir Foundry and AI technologies. This role involves collaborating with business stakeholders and risk management teams to create scalable data pipelines and AI applications, ensuring high data quality and compliance.

The ideal candidate has a strong background in Python and SQL, experience with cloud platforms, and knowledge of data governance practices. A hybrid work model is offered, requiring office attendance at least three days a week.

Qualifications

• Hands-on experience with Palantir Foundry, including pipeline development and operations.
• Strong programming skills in Python for data engineering processes.
• Experience integrating data from various systems and platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Collaborate with stakeholders to translate business requirements into solutions.
• Monitor and optimize data pipelines for performance and reliability.

Skills

Palantir Foundry expertise

Python programming

Data pipeline development

SQL proficiency

Cloud platforms (Azure/AWS)

Tools

Palantir AIP

PySpark

Machine Learning frameworks

Job description

About the Role

We are seeking an experienced Data Engineer with expertise in Palantir Foundry and Artificial Intelligence Platform (AIP) to join our Risk Management InfoTech department. In this role, you will design, build, and scale enterprise data and AI solutions that support risk analytics, operational workflows, and critical business decision‑making.

Working closely with risk management experts, business stakeholders, data scientists, and technology teams, you will develop robust data pipelines, operational applications, and AI‑powered solutions that transform complex business requirements into scalable, secure, and production‑ready capabilities.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines, ETL/ELT processes, and data models within Palantir Foundry, ensuring data quality, reliability, and integrity.
• Build and manage data transformations using Foundry Code Repositories, Pipeline Builder, and Ontology, supporting analytics, reporting, operational applications, and risk management use cases.
• Develop Python‑based data processing solutions and integrate data from enterprise systems, databases, APIs, cloud platforms, and third‑party applications.
• Design, implement, and support AI‑enabled solutions using Palantir AIP, including AI‑assisted workflows, AIP Logic, AIP Assist, and LLM‑powered decision‑support capabilities.
• Collaborate with business stakeholders, risk management teams, data scientists, and engineers to translate business requirements into scalable, secure, and production‑ready solutions.
• Ensure data governance, lineage, security, access controls, and compliance standards across data and AI assets.
• Monitor, troubleshoot, and optimize data pipelines, AI workflows, and performance to improve scalability, reliability, and cost efficiency.
• Document data assets, processes, and architectures, while contributing to engineering practices, and continuous improvement initiatives.
• Stay current with emerging capabilities in Palantir Foundry, AIP, and data engineering to drive innovation and enhance business outcomes.

About the Team

The Group Functions & ORM Delivery team is part of the Risk Management InfoTech department at Swiss Re — a global leader in reinsurance, insurance, and risk transfer, helping make the world more resilient. We are a dynamic and collaborative team dedicated to delivering innovative technology solutions that support Operational Risk Management (ORM) across the enterprise. Our team builds and maintains the platforms that underpin operational risk, compliance, and governance capabilities, working at the forefront of data and technology. We partner closely with risk professionals, architects, and business leaders to deliver secure, scalable, and maintainable solutions that enable smarter, faster, and more informed risk decisions at a global scale.

About You

You are a curious, solutions‑oriented data professional who takes pride in building reliable, elegant data solutions. You communicate effectively with both technical and non‑technical stakeholders, and you bring a collaborative mindset to everything you do. You are comfortable navigating ambiguity, thrive in a fast‑paced environment, and are driven by the desire to make a meaningful impact through data.

Requirements

• Hands‑on experience with Palantir Foundry, including pipeline development, data modelling, ontologies, datasets, transforms, and platform operations.
• Experience designing and implementing scalable data pipelines, ETL/ELT processes, and data models for structured and unstructured data.
• Strong programming skills in Python for data engineering, workflow automation, and large‑scale data processing, with experience using PySpark, Spark, or similar technologies.
• Strong proficiency in SQL for data querying, transformation, and analysis.
• Experience integrating data from enterprise systems, databases, APIs, cloud platforms, and third‑party applications.
• Hands‑on experience with Palantir AIP, including AI‑enabled application development, AIP Logic, AIP Assist, ontology‑driven AI actions, agentic workflows, and LLM integrations within the Foundry ecosystem.
• Knowledge of Large Language Models (LLMs), prompt engineering, and AI application development concepts.
• Experience working with cloud platforms such as Azure or AWS, particularly for data storage, processing, and orchestration.
• Understanding of data governance, lineage, security, access controls, and compliance requirements.
• Strong analytical, problem‑solving, communication, and stakeholder management skills.

Nice to haves

• Operational Risk Management (ORM) domain knowledge, including familiarity with risk assessment, monitoring, and reporting processes.
• Experience with Palantir Foundry Workshop, Operational Applications, and other user‑facing application development capabilities.
• Experience implementing Retrieval‑Augmented Generation (RAG), vector search, AI agents, agentic workflows, or AI orchestration frameworks.
• Experience implementing solutions using enterprise AI platforms such as OpenAI, Anthropic, Azure OpenAI, or similar technologies.
• Experience supporting machine learning, MLOps, model deployment, or advanced analytics initiatives.
• Palantir Foundry and/or AIP certifications.

Our company has a hybrid work model where the expectation is that you will be in the office at least three days per week.

About Swiss Re

Swiss Re is one of the world’s leading providers of reinsurance, insurance and other forms of insurance‑based risk transfer, working to make the world more resilient. We anticipate and manage a wide variety of risks, from natural catastrophes and climate change to cybercrime. We cover both Property & Casualty and Life & Health. Combining experience with creative thinking and cutting‑edge expertise, we create new opportunities and solutions for our clients. This is possible thanks to the collaboration of more than 15,000 employees across the world.

Our success depends on our ability to build an inclusive culture encouraging fresh perspectives and innovative thinking. We embrace a workplace where everyone has equal opportunities to thrive and develop professionally regardless of their age, gender, race, ethnicity, gender identity and/or expression, sexual orientation, physical or mental ability, skillset, thought or other characteristics. In our inclusive and flexible environment everyone can bring their authentic selves to work and their passion for sustainability.

If you are an experienced professional returning to the workforce after a career break, we encourage you to apply for open positions that match your skills and experience.

We may use AI‑powered tools to support the review and evaluation of applications for this position. These tools provide additional insights to our recruitment teams, but all hiring decisions are carefully reviewed and made by people. To learn more about how we use AI in recruitment and how we handle your personal data, please review our Data Privacy Statement before applying.