Senior Data Engineer

Better Beans; Ernakulam; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Better Beans in India (Kerala) seeks a data engineering specialist with strong Microsoft Azure Fabric and Lakehouse experience. The role requires building scalable data pipelines, managing data warehousing solutions and implementing CDC-based incremental loads.

Proficiency in SQL, Python and PySpark is essential for transforming complex datasets and delivering reliable analytics-ready datasets. Candidates should have exposure to ETL/ELT processes and be comfortable with notebooks for data

Qualifications

• Experience with Azure and Microsoft Fabric, including Fabric Pipelines and Lakehouse architecture.
• Strong SQL, Python and PySpark proficiency required.
• Hands-on with ETL/ELT, Azure Data Lake, Delta Lake and medallion architecture, CDC/incremental loads and data warehousing.

Skills

Azure

Microsoft Fabric

SQL

Python

PySpark

ETL/ELT

Azure Data Lake

Delta Lake

Medallion Architecture

CDC loads

Data Warehousing

Lakehouse

Notebooks

Education

M.Tech

Tools

Azure Data Lake

Delta Lake

Medallion Architecture

PySpark

Job description

Experience in Azure / Microsoft Fabric.
Fabric Pipelines, Lakehouse, Data Warehouse, Notebooks.
Strong SQL, Python, PySpark.
Experience with ETL/ELT, Azure Data Lake, Delta Lake, Medallion Architecture, CDC/incremental loads, and data warehousing.

Role Category: IT & Information Security - Other

Education

PG: M.Tech

Key Skills

Skills highlighted with ‘‘ are preferred keyskills