Data Engineer (Enterprise Data & Lakehouse)

Aspire Systems; Ernakulam, Chennai District, Bengaluru; Hybrid; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Hybrid work model

Diversity & Inclusion

Job summary

Aspire Systems in India is hiring a Data Engineer (Enterprise Data & Lakehouse), Senior Engineer role for 4-7 years of experience. Location is hybrid across Chennai, Kochi, Bangalore, or Hyderabad, with immediate joiner notices.

The ideal candidate will build and optimize data pipelines using Apache Spark, Databricks SDP, Delta Lake, and streaming processing, ensuring robust metadata-driven ETL/ELT frameworks and scalable performance.

Qualifications

• Strong hands-on experience with Apache Spark, PySpark and Spark SQL.
• Experience with Databricks Spark Declarative Pipelines (SDP) and Delta Lake.
• Knowledge of metadata-driven ETL/ELT frameworks and CI/CD, version control advantageous.

Skills

Apache Spark

PySpark

Spark SQL

Structured Streaming

Delta Lake

Databricks SDP

ETL/ELT design

CI/CD

Version control

Tools

Databricks

Unity Catalog

Workspace configuration

Compute/Cluster configuration

Job description

Immediate Hiring!!!

Role - Data Engineer (Enterprise Data & Lakehouse) Senior Engineer

Experience 4-7yrs

Location Chennai/Kochi/Bangalore/Hyderabad (Hybrid)

Notice Period - Immediate Joiners

Required Expertise

The resources should have strong hands-on experience in the following areas:

• Strong experience with Apache Spark, including PySpark and Spark SQL.
• Hands-on implementation experience with Databricks Spark Declarative Pipelines (SDP).
• Experience designing and implementing metadata-driven ETL/ELT frameworks using Databricks and SDP.
• Good understanding and implementation experience with Structured Streaming, Materialized Views, and streaming/incremental data processing on Databricks
• Experience with Delta Lake and its capabilities, including schema evolution, incremental processing, and optimization.
• Strong understanding of ETL dependency management, orchestration, and pipeline parameterization.
• Experience with Databricks performance optimization, including Spark optimization, partitioning, and efficient data processing.
• Have Implementation knowledge of Workspace configuration, Compute/Cluster Configuration , Unity Catalogue Configuration , permissions and Policies
• Experience with CI/CD and Version control would also be an advantage.

About Aspire Systems

Aspire Systems is a $180+ million global technology services firm with over 4,900 employees worldwide, partnering with 275+ active customers. Founded in 1996, Aspire has grown steadily at a 19% CAGR since 2020.

Headquartered in Singapore, we operate across the US, UK, LATAM, Europe, the Middle East, India, and Asia Pacific regions, with strong nearshore delivery centers in Poland and Mexico. Aspire has been consistently recognized among Indias 100 Best Companies to Work For for 12 consecutive years by the Great Place to Work Institute.

Who We Are

Aspire is built on deep expertise in Software Engineering, Digital Services, Testing, and Infrastructure & Application Support. We serve diverse industries including Independent Software Vendors, Retail, Banking & Financial Services, and Insurance.

Our proven frameworks and accelerators enable us to create future-ready, scalable, and business-focused systems, helping customers across the globe embrace digital transformation at speed and scale.

Why Join Aspire Systems

Being an Aspirian means being part of a future-ready, global workplace where you will work on emerging technologies, collaborate with diverse teams, and contribute to meaningful digital transformation initiatives.

We foster innovation, value diverse perspectives, and enable continuous learning and career growth guided by our philosophy of Attention. Always. Aspire also follows a hybrid work model, promoting flexibility, collaboration, and work-life balance.

Learn more about Life at Aspire:

https://www.aspiresys.com/careers/life-at-aspire

Our Commitment to Diversity & Inclusion

At Aspire Systems, we foster a work culture that appreciates diversity and inclusiveness. We understand that our multigenerational workforce represents different regions, cultures, economic backgrounds, races, genders, ethnicities, education levels, personalities, and religions. We believe these differences make us stronger and are committed to building an inclusive workplace where everyone feels respected and valued.

Privacy Notice

Aspire Systems values your privacy. Candidate information collected through this recruitment process will be used solely for hiring purposes, handled securely, and retained only as long as necessary in compliance with applicable privacy laws.