Data Engineer II

Swiss Re; Hyderabad; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Swiss Re is seeking an experienced Application Engineer II in Hyderabad to contribute to a lakehouse architecture on Azure using Python and PySpark for business services. You will develop backend applications that combine data from multiple domains, automate tests, and support DevOps operations in production.

The role emphasizes clean code, automation, and collaboration with engineers, analysts, product owners, and stakeholders to deliver scalable data solutions.

Qualifications

• 6+ years of experience in designing and implementing reliable and scalable software through the full software development lifecycle.
• Proficient in Python, PySpark, SQL.
• Experience with Spark-based data lake & extended services like Azure Databricks (Workflows/Jobs), Azure Data Factory, Azure Data Lake Storage Gen2, Delta Lake and Terraform.
• Experience with Git, CI/CD pipelines and Azure DevOps.
• Expertise working with relational databases like Oracle/Postgres.
• Experience with Integration technologies like REST/SOAP APIs.
• Experience with AI-assisted development tools such as GitHub Copilot is considered an advantage.
• Problem-solving skills and commitment to quality and timely delivery.
• Strong interpersonal, written, and verbal communication skills.
• A desire to continuously upskill & stay relevant with emerging technologies.

Responsibilities

• Understand business requirements and convert them into technical specifications.
• Hands-on coding in Python / PySpark.
• Oversee the end-to-end application architecture.
• Drive the design and build of business services that create financial data by combining input from various sources.
• Take ownership for the implementation of functional and non-functional requirements. Ensure a high level of test automation.
• Peer reviews.
• Foster sustainable relationships and become a trusted partner to team members.
• Meet with stakeholders, understand the requirements, and advise on efficient solutions.
• Ensure timely customer communication and coordination of follow-up activities.
• Apply and implement Agile Scrum and DevOps standard methodologies.
• Contribute to the operations during quarterly closing cycles.
• Collaborate with other team members to develop the software products within the team's scope.
• Design and implement data transformation services and data flows.
• Collaborate with other engineers in the team to ensure design decisions are aligned.
• Perform peer code reviews.
• Present and communicate ideas and designs to various stakeholder for review and brainstorming.
• Ensure technical design and implementation are in line with the application architecture and meet quality requirements (e.g., performance, reliability, availability).
• Implement software engineering practices to ensure the quality, performance, and maintainability of our applications.

Skills

Python

PySpark

SQL

Azure Databricks

Azure Data Factory

Delta Lake

Terraform

Azure Data Lake

Git

CI/CD

Azure DevOps

REST APIs

SOAP APIs

GitHub Copilot

Education

Bachelor's degree

Master's degree

Tools

Visual Studio Code

IntelliJ

Git

Azure DevOps

GitHub Copilot

Job description

About Swiss Re

Swiss Re is one of the world’s leading providers of reinsurance, insurance, and other forms of insurance-based risk transfer, working to make the world more resilient. It anticipates and manage a wide variety of risks, from natural catastrophes to climate change, from ageing populations to cybercrime. The aim of the Swiss Re Group is to enable society to thrive and progress, creating new opportunities and solutions for its clients. Headquartered in Zurich, Switzerland, where it was founded in 1863, the Swiss Re Group operates through a network of around 80 offices globally. It is organised into three Business Units, each with a distinct strategy and set of objectives contributing to the Group’s overall mission.

About The Role:

As an Application Engineer II in our Product Area, you will contribute to the development of a modern lakehouse architecture build on Azure Datalake using Python to implement business services. You will implement business functionality that enables our customers to run their accounting processes and generate data to meet their reporting needs. You will design, develop, automate, and support backend applications that combine data elements from multiple domains and systems. You will leverage innovative technologies and frameworks to enable scalable and efficient processing. You will collaborate with other engineers, analysts, product owners and stakeholders to deliver value-added solutions that meet the business needs and expectations.

We value clean code, automation, continuous improvement, knowledge sharing and engineering excellence. We actively leverage AI-assisted development tools such as GitHub Copilot to improve engineering productivity and quality.

We are living DevOps. We own the implementation of the business functionality and operate our workload in production. We are looking for an ambitious application engineer, who will help to build and deploy business services to production environments.

Key Tasks:

• Understand business requirements and convert them into technical specifications
• Hands-on coding in Python /PySpark
• Oversee the end-to-end application architecture
• Drive the design and build of business services that create financial data by combining input from various sources
• Take ownership for the implementation of functional and non-functional requirements. Ensure a high level of test automation
• Peer reviews
• Foster sustainable relationships and become a trusted partner to team members.
• Meet with stakeholders, understand the requirements, and advise on efficient solutions
• Ensure timely customer communication and coordination of follow-up activities
• Apply and implement Agile Scrum and DevOps standard methodologies
• Contribute to the operations during quarterly closing cycles

Your Main Responsibilities Are:

As an Application Engineer II you contribute by:

• Collaborate with other team members to develop the software products within the team's scope.
• Design and implement data transformation services and data flows.
• Collaborate with other engineers in the team to ensure design decisions are aligned.
• Perform peer code reviews
• Present and communicate ideas and designs to various stakeholder for review and brainstorming
• Ensure technical design and implementation are in line with the application architecture and meet quality requirements (e.g., performance, reliability, availability)
• Implement software engineering practices to ensure the quality, performance, and maintainability of our applications

About the Team (Description of the team and context in which the role sits in)

• The Estimated Cashflow Preparation team is a growing engineering team within the Subledger Input Preparation Product Area, focused on building the next generation of finance data and processing services
• The Product Owner and Engineering Manager who are based in Zurich and lead a team that operates from Zurich and Hyderabad
• The team builds on a lakehouse architecture using Azure Databricks, Azure Data Factory and Azure Data Lake (Delta Lake) with Python being the main programming language and PySpark is used for large scale data engineering.

About you: (education, linguistic ability, professional experience, leadership qualities, soft skills)

• Bachelor's or master's degree in a relevant quantitative field, e.g. Computer Science, Mathematics, Engineering or other equivalent
• 6+ years of experience in designing and implementing reliable and scalable software through the full software development lifecycle using modern IDEs (Visual Studio Code and/or IntelliJ), code management and automation tools. Hands-on experience with test driven development (Unit testing, Integration testing)
• Strong understanding of software engineering techniques with modern programming languages and analytical frameworks. Proficient in Python, PySpark, SQL
• Profound experience in Spark based data lake & extended services like, Azure Databricks (Workflows/Jobs), Azure Data Factory, Azure Data Lake Storage Gen2, Delta Lake and Terraform
• Experience with Git, CI/CD pipelines and Azure DevOps.
• Expertise working with relational databases like Oracle/Postgres
• Experience with Integration technologies like REST/SOAP APIs
• Experience working with AI-assisted development tools such as GitHub Copilot is considered an advantage.
• Problem-solving skills and commitment to quality and timely delivery
• Strong interpersonal, written, and verbal communication skills
• A desire to continuously upskill & stay relevant with emerging technologies

About Swiss Re

Swiss Re is one of the world’s leading providers of reinsurance, insurance and other forms of insurance-based risk transfer, working to make the world more resilient. We anticipate and manage a wide variety of risks, from natural catastrophes and climate change to cybercrime. We cover both Property & Casualty and Life & Health. Combining experience with creative thinking and cutting-edge expertise, we create new opportunities and solutions for our clients. This is possible thanks to the collaboration of more than 15,000 employees across the world.

Our success depends on our ability to build an inclusive culture encouraging fresh perspectives and innovative thinking. We embrace a workplace where everyone has equal opportunities to thrive and develop professionally regardless of their age, gender, race, ethnicity, gender identity and/or expression, sexual orientation, physical or mental ability, skillset, thought or other characteristics. In our inclusive and flexible environment everyone can bring their authentic selves to work and their passion for sustainability.

If you are an experienced professional returning to the workforce after a career break, we encourage you to apply for open positions that match your skills and experience.

We may use AI-powered tools to support the review and evaluation of applications for this position. These tools provide additional insights to our recruitment teams, but all hiring decisions are carefully reviewed and made by people. To learn more about how we use AI in recruitment and how we handle your personal data, please review our Data Privacy Statement before applying.

Reference Code: 139189