Azure Databricks Data Migration Lead

Half the Sky Australia; Singapore; On-site; SGD 130,000 - 180,000; Full time

Benefits offered by this job

Employee share purchasing

Flexible work arrangements

Diversity and inclusion

Competitive pay

Job summary

Avanade is seeking a Data Migration Lead to architect and drive large-scale data migration programs using Databricks and Azure. You will design data pipelines, data streams, and APIs, while guiding a team of data engineers and analysts.

Strong Azure Data Factory/Data Lake/Databricks expertise is essential, with a track record of delivering enterprise-scale data solutions. The role requires extensive experience in cloud data architectures, governance, and collaboration with business stakeholders

Qualifications

• 12+ years of relevant professional experience
• 4+ years architecting & implementing large-scale data projects through Azure Data services
• Strong collaboration and communication skills
• Ability to translate business use cases into technical solutions
• Data profiling, cataloging, and mapping for technical design

Responsibilities

• Translate business requirements to technical solutions leveraging strong business acumen
• Support planning and implementation of data design services, providing sizing and configuration assistance
• Deliver data transformations and modernizations of enterprise data solutions using Azure data technologies
• Design and build modern data pipelines and data streams
• Expose data to end users via Power BI, Azure API Apps, or other visualization platforms
• Provide technical direction to data engineers, data analysts, data integration developers, and DBAs
• Ensure quality of architecture and design deliverables
• Prepare High-Level Design (HLD) documents
• Manage and resolve design integration risks with stakeholders
• Develop data warehouse schematics and architectures for data access and analytics
• Travel as needed

Skills

Azure Data Services

Business Acumen

Communication

Data Governance

CI/CD

Tools

Azure Data Factory

Azure Data Lake

Azure SQL DW

Azure SQL

Databricks

PowerShell

ARM templates

Hadoop

Spark

ETL/ELT tools (AWS Glue, Talend)

MS SQL

DynamoDB

Job description

Avanade is seeking a Data Migration Lead to architect and drive large-scale data migration programs using Databricks and Azure. You will design data pipelines, data streams, and APIs, while guiding a team of data engineers and analysts.

Strong Azure Data Factory/Data Lake/Databricks expertise is essential, with a track record of delivering enterprise-scale data solutions. The role requires extensive experience in cloud data architectures, governance, and collaboration with business stakeholders