Data Engineer - Azure Databricks

Tarento Group; Bengaluru; On-site; INR 2,500,000 - 6,000,000; Full time

Job summary

Tarento Group seeks a Senior Data Engineer to design and implement scalable data pipelines on Azure Databricks. You will lead data architecture, optimize costs, and ensure data governance across global teams.

You should have 5–8 years of data engineering experience with Azure Data Factory, Databricks, and Synapse, plus strong SQL and Python/Scala skills. This role focuses on data lakehouse solutions and secure, compliant data delivery.

Qualifications

• 5–8 years of data engineering or platform experience (8+ in practice).
• Hands-on with Azure Databricks, Data Factory, and Synapse.
• Strong SQL and data modelling (OLAP/OLTP).
• Proficiency in Python/Scala for Spark jobs and data transformation.
• Knowledge of Azure Data Lake Storage optimizations and cost tuning.
• Experience with CI/CD and IaC for data pipelines.
• Familiarity with data security/compliance (RBAC, encryption, GDPR).

Responsibilities

• Lead design and architecture of large-scale data infrastructure and pipelines (Data Lakehouse).
• Transform complex business requirements into automated, secure data solutions (ETL/ELT) in Azure.
• Optimize data storage and compute costs across Databricks clusters and Data Lake.
• Troubleshoot production pipeline failures and data quality issues.
• Drive best practices in data governance and pipeline reliability.
• Mentor and coordinate with global teams (data scientists, analysts, operations).

Skills

Data modelling

SQL

Python/Scala

CI/CD

Security & governance

Tools

Azure Databricks

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

Job description

About Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.

About Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.

Senior Data Engineer (Azure Databricks)

• Lead design and architecture of large-scale data infrastructure and pipelines (Data Lakehouse).
• Transform complex business requirements into automated, secure data solutions (ETL/ELT) primarily in Azure.
• Optimize data storage and compute costs across Databricks clusters and Data Lake.
• Troubleshoot and resolve production pipeline failures and data quality issues.
• Drive best practices in data governance, security, and pipeline reliability.
• Mentor and coordinate with global teams (data scientists, analysts, operations).

Required Skills & Experience

• 5–8 years (often 8+ in practice) in data engineering or platform roles.
• Expert hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Deep SQL and data modelling skills (OLAP, OLTP, dimensional modelling).
• Proficiency in Python/Scala for Spark jobs and data transformation.
• Understanding of Azure Data Lake Storage optimizations and Azure resource cost tuning.
• Experience implementing CI/CD and IaC for data pipelines.
• Knowledge of data security/compliance (RBAC, encryption, GDPR principles).