Senior Data Engineer

Tishman Speyer Properties; Pune District; Hybrid; INR 2,600,000 - 4,200,000; Full time

Job summary

Air Products is seeking a Senior Data Engineer in Pune with 8+ years of data engineering experience. You will design and scale cloud-native data platforms using Databricks, Spark, Delta Lake and Python to support analytics, AI/ML and business teams.

You will migrate workloads from AWS to Databricks, implement data governance, and mentor junior engineers in a collaborative, security-conscious environment.

Qualifications

• 8+ years of experience in Data Engineering.
• Strong hands-on experience with Databricks.
• Advanced knowledge of Apache Spark (PySpark).
• Experience with Terraform, Delta Lake, SQL and Python.

Responsibilities

• Gather requirements, design, develop and optimize data pipelines using Databricks and PySpark.
• Build and manage Delta Lake Medallion architectures.
• Develop batch and streaming pipelines using Structured Streaming.
• Optimize Spark workloads for performance and cost.
• Implement Databricks Jobs, Workflows and SQL; ingest data from varied sources.

Skills

Databricks

Apache Spark (PySpark)

Delta Lake

SQL

Python

Terraform

Cloud (AWS/Azure)

Data Lakehouse

Tools

Terraform

Delta Lake

Apache Spark

Python

SQL

AWS

Azure

Job description

At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every voice is heard and everyone knows they belong and matter – we create solutions that launch people into space, support lifesaving care in hospitals, and enable the construction of groundbreaking, world scale production facilities.

Reimagine What’s PossibleLocation: Pune (Hybrid) Experience: 8+ Years Skills: Databricks | Spark | Azure or AWS | Delta Lake

About the Role

We are looking for a Senior Data Engineer with strong hands-on experience in Databricks to build and scale modern, cloud-native data platforms. You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions. This role will also be involved in migrating enterprise data workloads from AWS-based platforms to Databricks, contributing to our broader data modernization journey.

Key Responsibilities

• Must have experience in requirement gathering, design, develop, and optimize data pipelines using Databricks and Apache Spark (PySpark).
• Build and manage Delta Lake Medallion architectures.
• Develop batch and streaming pipelines using Structured Streaming.
• Optimize Spark workloads for performance and cost efficiency.
• Implement Databricks Jobs, Workflows, and SQL.
• Ingest data from various relation databases, SAP, API’s, etc into databricks.
• Contribute to AWS (Glue/Redshift) to Databricks data migration initiatives.
• Implement data quality, security, and governance best practices.
• Collaborate with cross-functional teams and mentor junior engineers.

Required Skills & Experience

• 8+ years of experience in Data Engineering
• Strong hands-on experience with Databricks.
• Knowledge and experience on security and governance topics is a plus.
• Advanced knowledge of Apache Spark (PySpark preferred)
• Experience with Terraform (IAC), Delta Lake, SQL, and Python
• Solid understanding of cloud-native data architectures on Databricks.
• Experience building scalable, production-grade data pipelines
• Strong problem-solving and communication skills.

Nice to Have

• Experience with Unity Catalog and data governance
• Familiarity with CI/CD pipelines and DevOps best practices for data solutions.
• Familiarity with Terraform, dbt, or Airflow
• Databricks certification (preferred, not mandatory)

Founded in 1940, Air Products is a world-leading industrial gases company and has a proud history of innovation, operational excellence, with an unwavering commitment to safety and environmental stewardship. Working together, we are taking our passion and diverse backgrounds forward to reimagine what’s possible and generate a cleaner future for our customers, our communities, and the world.

Behind every success and innovation that has made a difference in the world, you will find a team of passionate people who helped make it possible. At Air Products, our talented people help each other and our customers thrive. To our colleagues, we are valued and respected teammates. To our customers, we are partners in creating value. To our communities, we are caring, involved neighbors and committed stewards of the environment.

Air Products is a world-leading industrial gases company with more than 85 years of experience serving energy, environmental, and emerging markets while generating a cleaner future. Our people are at the heart of everything we do. We are committed to creating a workplace where safety comes first, diverse perspectives are valued, innovation thrives, and employees have opportunities to learn, grow, and make a meaningful impact.