Data Engineer - Azure Databricks

Keka Technologies Private Limited; Bengaluru; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

Tarento is seeking a senior data engineer to lead design and delivery of large-scale data pipelines in Azure. You will shape the data platform, mentor global teams, and ensure secure, scalable solutions across Data Lakehouse architectures.

The role emphasizes optimizing costs, implementing CI/CD for data workflows, and deep data modelling and SQL skills in a fast-growing tech consulting environment.

Qualifications

• 5-8 years in data engineering or platform roles (often 8+ in practice).
• Hands-on with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Strong SQL and data modelling skills (OLAP, OLTP, dimensional modelling).
• Proficiency in Python/Scala for Spark jobs and data transformation.
• Understanding of Azure Data Lake Storage optimizations and cost tuning.
• Experience implementing CI/CD and IaC for data pipelines.
• Knowledge of data security/compliance (RBAC, encryption, GDPR).

Responsibilities

• Lead design and architecture of large-scale data infrastructure and pipelines (Data Lakehouse).
• Transform complex business requirements into automated, secure data solutions (ETL/ELT) primarily in Azure.
• Optimize data storage and compute costs across Databricks clusters and Data Lake.
• Troubleshoot and resolve production pipeline failures and data quality issues.
• Drive best practices in data governance, security, and pipeline reliability.
• Mentor and coordinate with global teams (data scientists, analysts, operations).

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

SQL

Data Modelling

Python/Scala

Azure Data Lake Storage

CI/CD & IaC

Data Security & Compliance

Job description

Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.

• Lead design and architecture of large-scale data infrastructure and pipelines (Data Lakehouse).
• Transform complex business requirements into automated, secure data solutions (ETL/ELT) primarily in Azure.
• Optimize data storage and compute costs across Databricks clusters and Data Lake.
• Troubleshoot and resolve production pipeline failures and data quality issues.
• Drive best practices in data governance, security, and pipeline reliability.
• Mentor and coordinate with global teams (data scientists, analysts, operations).

Required Skills & Experience:

• 5-8 years (often 8+ in practice) in data engineering or platform roles.
• Expert hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Deep SQL and data modelling skills (OLAP, OLTP, dimensional modelling).
• Proficiency in Python/Scala for Spark jobs and data transformation.
• Understanding of Azure Data Lake Storage optimizations and Azure resource cost tuning.
• Experience implementing CI/CD and IaC for data pipelines.
• Knowledge of data security/compliance (RBAC, encryption, GDPR principles).