Senior Data Engineer

Swiss Re; Hyderabad; Hybrid; INR 2,500,000 - 4,200,000; Full time

Job summary

Swiss Re Hyderabad is seeking a Senior Data Engineer to design and deliver scalable data platforms and analytics capabilities across global teams. You will work with Palantir Foundry, Azure Databricks, Python/PySpark, and SQL to build robust data pipelines while applying AI-assisted development and best practices.

Join a multinational, agile team focused on data-driven decision support, cloud-native architectures, and continuous learning in a hybrid work environment with three in-office days per

Qualifications

• 9+ years designing and developing large-scale software systems with Palantir Foundry and Azure Databricks.
• Proficiency in Python, PySpark, and SQL with performant data modeling.
• Experience with Spark/Hive/Hadoop in cloud environments (AWS or Azure).
• Experience leading an Agile development team and using Git.
• Bachelor's degree in Computer Science, Data Science, or related field with global collaboration ability.

Responsibilities

• Drive end-to-end analytics delivery across data platforms.
• Collaborate with Product Owners and Architects to define solutions.
• Build scalable data pipelines using Python/PySpark, SQL, and Palantir Foundry.
• Leverage Palantir AIP and generative AI to enhance analytics solutions.
• Mentor and lead a team of developers in an agile environment.
• Set engineering standards and best practices.
• Deliver as a global team across distributed teams.

Skills

Python

PySpark

SQL

Git

Agile methodologies

Leadership

Education

Bachelor's degree or equivalent in CS/Data Science

Tools

Palantir Foundry

Azure Databricks

Spark

Hadoop

Job description

Locations:

Bangalore, KA, IN |Hyderabad, TG, IN

Senior Data Engineer

Are you passionate about transforming raw data into powerful insights that drive real business decisions? Do you thrive at the intersection of cutting-edge technology, AI innovation, and large-scale data engineering? If so, we have an exciting opportunity for you to make a meaningful impact on a global scale.

About the Role

As a Senior Data Engineer, you will be at the heart of our ambition to become a truly data-driven organisation. You will design and deliver best-in-class data engineering capabilities, architect scalable solutions on modern cloud platforms, and help democratise data for business stakeholders and customers alike. This is a role for someone who embraces AI-assisted development, loves solving complex problems, and is energised by working in a fast-paced, collaborative, global environment.

Key Responsibilities

• Drive end-to-end analytics delivery - design, develop, and implement analytics models and visualisations that provide actionable, business-ready data insights
• Collaborate with stakeholders - work closely with Product Owners and Architects to understand requirements, formulate solutions, and evaluate implementation effort
• Build scalable data pipelines - design, develop, and maintain robust transformation logic using Python/PySpark, SQL, and modern analytics platforms such as Palantir Foundry
• Leverage AI technologies - utilise Palantir AIP and generative AI to enhance analytics solutions, automate workflows, and improve user experiences where appropriate
• Champion AI-assisted development - apply tools such as GitHub Copilot or equivalent to improve development efficiency while upholding high engineering standards
• Optimise Spark-based solutions - oversee architecture design and performance tuning of Spark-based data solutions at enterprise scale
• Set engineering standards - define and drive the adoption of best practices, coding standards, and quality frameworks across the team
• Innovate and prototype - evaluate new platform capabilities, develop prototypes, and draw conclusions on their applicability to the solution landscape
• Mentor and lead - provide knowledge, guidance, and technical leadership to a team of developers in an agile, collaborative environment
• Stay ahead of the curve - continuously track emerging data engineering tools, frameworks, and industry trends, driving innovation within the team
• Deliver as a global team - collaborate across a globally distributed development team to design and deliver impactful solutions

About the Team

The L&H Data & Analytics Engineering team is a key technical partner for our Life & Health (L&H) Reinsurance division, supporting the transformation of the data landscape and the creation of innovative analytical products and capabilities. We are a large, globally distributed team operating in an agile development environment, delivering solutions that make better use of reinsurance data and enhance data-driven decision-making across the entire business value chain. Joining this team means being part of a dynamic, forward-thinking group that values collaboration, continuous learning, and technical excellence.

About You

You are a curious, driven, and technically sharp data engineering professional who thrives on solving complex big data challenges using leading-edge technologies. You have a clear ability to learn and adopt new tools quickly - particularly in AI, modern analytics platforms, and cloud-native data engineering. You are a self-starter who takes ownership of solutions from inception to delivery and communicates effectively across technical and business audiences. You bring a collaborative mindset, a passion for engineering excellence, and the ability to lead and inspire those around you.

We are looking for candidates who meet these requirements:

• 9+ years of experience designing and developing large-scale software systems, with a strong focus on platforms such as Palantir Foundry and Azure Databricks
• Proficiency in Python/PySpark and SQL, including experience designing performant queries, data models, and dimensional modelling/data warehousing concepts
• Hands-on experience with enterprise data platforms and distributed computing (Spark/Hive/Hadoop), working with large datasets in Cloud environments such as AWS or Azure
• Experience leading an Agile development team, with familiarity in agile software delivery practices and collaborative development using Git
• Bachelor's degree or equivalent in Computer Science, Data Science, or a related discipline, combined with the ability to work effectively in a global, multicultural environment

These are additional nice to haves:

• Proficiency in full-stack design and implementation on Palantir Foundry, Databricks, Microsoft Fabric, or Snowflake
• Spark performance and optimisation expertise at scale
• Experience using Palantir AIP or other AI/LLM frameworks to develop analytics applications
• Experience integrating Large Language Models (LLMs) into analytics workflows
• Knowledge of the Insurance domain, Financial Industry, or Finance functions in other industries

Our company has a hybrid work model where the expectation is that you will be in the office at least three days per week.

About Swiss Re

Swiss Re is one of the world's leading providers of reinsurance, insurance and other forms of insurance-based risk transfer, working to make the world more resilient. We anticipate and manage a wide variety of risks, from natural catastrophes and climate change to cybercrime. Combining experience with creative thinking and cutting-edge expertise, we create new opportunities and solutions for our clients. This is possible thanks to the collaboration of more than 15,000 employees across the world.

Our success depends on our ability to build an inclusive culture encouraging fresh perspectives and innovative thinking. We embrace a workplace where everyone has equal opportunities to thrive and develop professionally regardless of their age, gender, race, ethnicity, gender identity and/or expression, sexual orientation, physical or mental ability, skillset, thought or other characteristics. In our inclusive and flexible environment everyone can bring their authentic selves to work and their passion for sustainability.

We may use AI-powered tools to support the review and evaluation of applications for this position. These tools provide additional insights to our recruitment teams, but all hiring decisions are carefully reviewed and made by people. To learn more about how we use AI in recruitment and how we handle your personal data, please review our Data Privacy Statement before applying.

Keywords:

Reference Code: 139772