Senior Azure Data Engineer: Databricks, BI & DevOps Lead

NTT DATA, Inc.; Indianapolis (IN); On-site; USD 21,000 - 32,000; Full time

Job summary

NTT DATA, Inc. is seeking a Z2_Azure Data Engineer with DevOps to lead a complex SAP BW to Azure Databricks migration in a global, hybrid team. You will architect end-to-end data platforms, define data products, and enable Power BI reporting on a scalable Lakehouse.

You will implement CI/CD for notebooks and data pipelines, automate infrastructure with Terraform, and embed security controls. Collaboration with SAP teams, data engineering, and leadership is essential for success.

Qualifications

• Lead the end-to-end BI FSL 2.0 transformation from SAP BW/BW4HANA to neXtollo/Azure Databricks.
• Translate SAP BW data models, transformations, and reporting logic into Databricks Lakehouse patterns.
• Define target-state data architecture covering ingestion and semantic consumption.
• Design SAP-to-Azure extraction and integration patterns (ODP, SLT, BW Bridge, APIs, CDC).
• Drive fit-gap analysis between SAP BW and future-state architecture.

Responsibilities

• Design, build, and optimize enterprise-scale data pipelines using Azure Databricks, PySpark, Delta Lake, ADLS Gen2.
• Implement CI/CD pipelines for notebooks, data pipelines, and infrastructure across environments.
• Automate infrastructure provisioning using IaC (Terraform or Azure-native tooling).
• Define release management, branching, and deployment gates for production readiness.
• Embed DevSecOps: secrets management, RBAC, Key Vault, and audit readiness.

Skills

Azure Databricks

Delta Lake

Power BI

Python

PySpark

SQL/T-SQL

Data Modeling

ETL/ELT Design

Data Warehousing

Performance Tuning

CI/CD

Terraform

Azure DevOps

GitHub

Tools

Terraform

Azure DevOps

GitHub

Azure Data Factory

Job description

NTT DATA, Inc. is seeking a Z2_Azure Data Engineer with DevOps to lead a complex SAP BW to Azure Databricks migration in a global, hybrid team. You will architect end-to-end data platforms, define data products, and enable Power BI reporting on a scalable Lakehouse.

You will implement CI/CD for notebooks and data pipelines, automate infrastructure with Terraform, and embed security controls. Collaboration with SAP teams, data engineering, and leadership is essential for success.