Data Engineer

Bahwan CyberTek; Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Bahwan CyberTek is seeking an Azure Data Engineer to design, develop, and maintain enterprise-scale ADF pipelines, ingesting data from SQL Server, Salesforce, REST APIs and more into ADLS Gen2 and Azure Blob Storage.

You will implement data quality checks, monitor production, support CI/CD with Azure DevOps, and build Power BI reports and dashboards while collaborating with analysts, QA, data scientists, and stakeholders in an Agile environment.

Qualifications

• Design, develop, and maintain enterprise Azure Data Factory (ADF) pipelines.

Responsibilities

• Design, develop, and maintain enterprise Azure Data Factory pipelines and metadata-driven ETL/ELT frameworks to support multiple source systems.

Skills

Agile delivery

Client communication

Collaboration

Data quality

SDLC security

Tools

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Blob Storage

Power BI

Azure DevOps

Azure Monitor

Log Analytics

SQL Server

Salesforce

REST APIs

JSON/Parquet

Databricks/PySpark

Job description

Job Summary We are seeking a skilled Azure Data Engineer to join our Data Engineering team. The successful candidate will design, develop, maintain, and support enterprise-scale, metadata-driven Azure Data Factory (ADF) solutions. The role involves integrating data from SQL Server, Salesforce, REST APIs, and other enterprise applications into Azure Data Lake Storage Gen2 and Azure Blob Storage while ensuring secure, scalable, and high-performance data movement. The engineer will work closely with business stakeholders, data analysts, QA teams, and data scientists to design robust ETL/ELT solutions, implement best practices for data quality, and support production environments. The ideal candidate should have strong experience in Azure services, production support, Azure DevOps CI/CD, Power BI reporting, Agile delivery, and secure cloud data engineering. Key Responsibilities Design, develop, and maintain enterprise Azure Data Factory (ADF) pipelines. Build metadata-driven ETL/ELT frameworks supporting multiple source systems. Acquire, ingest, validate, and process data from SQL Server, Salesforce, REST APIs, JSON, CSV, and Parquet. Develop secure and scalable data integration solutions using ADLS Gen2 and Azure Blob Storage. Monitor production pipelines, troubleshoot failures, analyze logs, and resolve incidents within SLA. Implement data quality validations, reconciliation, and error handling. Create Power BI reports and operational dashboards. Develop Azure Logic Apps for workflow automation and notifications. Deploy Azure artifacts using Azure DevOps CI/CD. Collaborate with business users, QA, data scientists, and developers. Participate in Agile ceremonies and maintain technical documentation. Required Technical Skills Azure Data Factory (ADF) Metadata-driven ETL/ELT Pipelines SQL Server, T-SQL, Stored Procedures, Views, Performance Tuning Azure Data Lake Storage Gen2 & Azure Blob Storage Azure Monitor, Log Analytics Azure DevOps (Repos, Branching, PRs, CI/CD) Power BI Reports & Dashboards Azure Logic Apps Strong understanding of Information Security and SDLC Preferred Skills Python scripting Salesforce Integration REST APIs Azure Key Vault & Managed Identity JSON, CSV, Parquet Databricks/PySpark (good to have) Qualifications & Experience 5+ years in Azure Data Engineering or similar role. Experience delivering enterprise-scale Azure Data Platform solutions. Hands-on production support and performance optimization. Strong client communication, collaboration, and consulting mindset. Knowledge of Data Warehousing, Data Quality, and dimensional modeling.

Required Skills

Design, develop, and maintain enterprise Azure Data Factory (ADF) pipelines. Build metadata-driven ETL/ELT frameworks supporting multiple source systems. Acquire, ingest, validate, and process data from SQL Server, Salesforce, REST APIs, JSON, CSV, and Parquet. Develop secure and scalable data integration solutions using ADLS Gen2 and Azure Blob Storage. Monitor production pipelines, troubleshoot failures, analyze logs, and resolve incidents within SLA. Implement data quality validations, reconciliation, and error handling. Create Power BI reports and operational dashboards. Develop Azure Logic Apps for workflow automation and notifications. Deploy Azure artifacts using Azure DevOps CI/CD. Collaborate with business users, QA, data scientists, and developers. Participate in Agile ceremonies and maintain technical documentation. Required Technical Skills Azure Data Factory (ADF) Metadata-driven ETL/ELT Pipelines SQL Server, T-SQL, Stored Procedures, Views, Performance Tuning Azure Data Lake Storage Gen2 & Azure Blob Storage Azure Monitor, Log Analytics Azure DevOps (Repos, Branching, PRs, CI/CD) Power BI Reports & Dashboards Azure Logic Apps Strong understanding of Information Security and SDLC Preferred Skills Python scripting Salesforce Integration REST APIs Azure Key Vault & Managed Identity JSON, CSV, Parquet Databricks/PySpark (good to have)