Azure Data Engineer

Tekskills Inc.; Bengaluru, Chennai, Delhi; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

Tekskills Inc. in Bengaluru, Karnataka, is seeking an experienced Data Engineer with 5+ years in data engineering and 3+ years on Azure. The role requires hands-on work with Azure Data Factory, Databricks, Python, and PySpark/Scala.

You will design and implement pipelines, data flows, and notebooks using PySpark/Scala, optimize clusters, and collaborate in Scrum/Kanban teams using Azure DevOps.

Qualifications

• 5+ years data engineering experience with at least 3+ years on Azure.
• 5+ years development across ADF, Databricks, Python.
• Experience with ADF pipelines, data flows, triggers and error handling.
• Databricks Notebooks/Jobs, PySpark/Scala, Delta Lake and cluster tuning.
• Strong Python or Scala coding, unit testing (pytest).
• Familiar with Scrum/Kanban; Azure DevOps.

Skills

Data engineering

Python

PySpark/Scala

Databricks

Tools

Azure Data Factory

Azure Databricks

Azure DevOps

Job description

Role & responsibilities

Description:

1. 5 (min.) - 8 years in data engineering, of which at least 3+ years on Azure.


2. 5+ years of development experience across ADF, Databricks, Python.


3. Azure Data Factory: Pipelines, data flows (mapping/wrangling), triggers, integration runtimes, parameterization, error handling & retries.


4. Azure Databricks: Databricks Notebooks, Jobs/Workflows, PySpark/Scala, Delta Lake, cluster configuration and optimization.


5. Programming: Advanced Python or Scala (at least one), strong coding standards, modularization, and unit testing (e.g., pytest)


6. Practical experience with Scrum/Kanban; story slicing, Azure DevOps


7. ETRM skills are desirable