ADF Data Engineer

Intellics Global Services; Pune District, Mumbai, Chennai District; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Intellics Global Services in Mumbai, India, seeks an experienced ADF Data Engineer to design, build and optimize data pipelines using Azure Data Factory, Databricks and SQL DW.

You will implement ETL processes, data quality checks, and security controls while collaborating with cross-functional teams to ensure reliable data delivery across cloud environments.

Qualifications

• At least 5+ years of Data Engineering experience with data warehousing and cloud computing.
• Proven experience with Azure data services including ADF, Databricks and SQL DW.
• Experience in Data Quality and ETL principles.
• Knowledge of job scheduling and dependencies.
• Experience handling structured and semi-structured datasets.
• Proven SQL development experience (preferably SQL Server).
• Strong communication, documentation, and leadership skills.

Responsibilities

• Understand business requirements and provide inputs from a data perspective.
• Understand data flow and underlying data structures.
• Build simple to complex pipelines and dataflows.
• Collaborate with other Azure stack modules (e.g., Azure Data Lakes, SQL DW).
• Design, develop and test software components using Microsoft Azure.
• Implement modules with security and authorization frameworks.
• Adapt to process changes as the project grows.

Skills

Data engineering

Cloud computing

Azure Data Factory (ADF)

Azure Databricks

SQL Server / SQL DW

Data quality

ETL principles

Job scheduling

Structured data

Semi-structured data

Communication skills

Leadership

Tools

Azure Data Factory

Azure Databricks

Snowflake

SQL Server

Azure SQL databases

SQL DW

Job description

Role ADF Data Engineer

Location: Mumbai, Kolkatta, Pune, Bangalore, Chennai, Noida

Must have

• At least 5 years of experience with Data EngineeringData Warehousing developmentoperations experience with minimum 2 years in cloud computing
• Proven experience in MS Azure data services Azure Data Factory ADF Azure Data bricks SQL DW
• Working experience of Data Quality and ETL principles
• Good understanding of job scheduling and dependencies
• Experience handling Structured and semistructured datasets
• Knowledge of Database Azure SQL databases Snowflake database
• Proven experience in SQL development preferably SQL Server
• Technical and analytical mindset
• Good communication verbal written documentation skills
• Leadership and interpersonal skills including teamwork facilitation and negotiation

Nice to have

• Reasonable experience of migration of conventional ETL processes from on premise to Azure landscape
• Experience of ADF pipeline migration from one environment to another environment
• Good to have Python skills
• Knowledge of CI CD Pipelines Git Unit Testing

Roles and Responsibilities

• Understand business requirement and actively provide inputs from Data perspective
• Understand the underlying data and flow of data
• Build simple to complex pipelines dataflows
• Work with other Azure stack modules like Azure Data Lakes SQL DW etc
• Defines designs develops and test software componentsapplications using Microsoft Azure
• Should be able to implement modules that has security and authorization frameworks
• Recognize and adapt to the changes in processes as the project evolves in size and function