Azure Data Engineer

Wissen Digital; Hyderabad, Bengaluru; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Wissen Digital is seeking an Azure Data Engineer to design and optimize scalable data pipelines across Azure Data Factory, Databricks, and ADLS. You will implement ETL/ELT processes, tune performance for large datasets, and ensure robust deployments with ARM templates and Key Vault.

You will collaborate in an Agile environment, create Power BI reports, and work with incidents tracked in JIRA and ServiceNow. Remote work is not specified; you will engage with BI and data teams in India offices.

Qualifications

• Experience in Databricks, Azure Data Factory, Azure Data Lake and Azure SQL Server.
• Developed ETL/ELT processes using SSIS and/or Azure Data Factory.
• Build complex pipelines & dataflows using Azure Data Factory.
• Design and implement data pipelines using in Azure Data Factory (ADF).
• Improve functionality/performance of existing data pipelines.
• Performance tuning for very large data sets.
• Configuration and deployment of ADF packages.
• Proficient with ARM Templates, Key Vault, Integration Runtime.
• Adaptable to work with ETL frameworks and standards.
• Strong analytical and troubleshooting skills to root cause issues and propose solutions.
• Knowledge of Azure services like Blob storage, ADLS, Logic Apps, Azure SQL, Web Jobs.
• Experience with ServiceNow incidents and JIRA; exposure to Agile methodologies.
• Expertise in building Power BI reports using latest methodologies.

Responsibilities

• Develop and maintain end-to-end data pipelines in Azure.
• Tune performance for large data workflows and ensure reliability.
• Design data models and data lakes in ADLS and Azure SQL.
• Package deployments using ARM templates and manage credentials in Key Vault.
• Collaborate in agile sprints with cross-functional teams and Jira/ServiceNow.

Skills

Databricks

Azure Data Factory

Azure Data Lake

Azure SQL Server

Power BI

ETL/ELT

SSIS

ARM Template

Key Vault

Integration Runtime

Agile

JIRA

ServiceNow

Tools

Azure Databricks

CI/CD

Logic Apps

Web Jobs

Job description

JD: Azure Data Engineer

Exp 4 to 7 years

Location : Bangalore / Hyd

• Experience in Databricks ,Azure Data Factory, Azure data lake and Azure SQL Server.
• Developed ETL/ELT process using SSIS and/or Azure Data Factory.
• Build complex pipelines & dataflows using Azure Data Factory.
• Designing and implementing data pipelines using in Azure Data Factory (ADF).
• Improve functionality/ performance of existing data pipelines.
• Performance tuning processes dealing with very large data sets.
• Configuration and Deployment of ADF packages.
• Proficient of the usage of ARM Template, Key Vault, Integration runtime.
• Adaptable to work with ETL frameworks and standards.
• Strong analytical and troubleshooting skill to root cause issue and find solution.
• Propose innovative, feasible and best solutions for the business requirements.
• Knowledge on Azure technologies / services such as Blob storage, ADLS, Logic Apps, Azure SQL, Web Jobs..
• Expert in Service now , Incidents ,JIRA.
• Should have exposure agile methodology.
• Expert in understanding , building PowerBI reports using latest methodologies