Azure Databricks Data Migration Lead | Solution Architect

Celebal Technologies; Grand Rapids (MI); On-site; USD 120,000 - 180,000; Full time

Job summary

Celebal Technologies in Grand Rapids, MI is seeking a seasoned Team Lead / Solution Architect to drive a cloud transformation. You will migrate complex legacy data systems to an Azure Databricks Lakehouse and lead delivery teams across data engineering disciplines.

The role requires hands-on engineering with strategic architectural oversight, ensuring governance, security, and regulatory compliance in a large-scale enterprise environment.

Qualifications

• 8–15 years of proven IT experience in data warehousing, big data and cloud environments.
• Advanced expertise in Azure Databricks, Delta Lake, Apache Spark, and cloud data architecture.
• Hands-on experience architecting and driving legacy-to-cloud data warehouse modernization projects.
• Deep proficiency with Azure cloud services (ADLS Gen2, Azure Data Factory, Azure DevOps).
• Must be locally based within Grand Rapids, MI (49544) or nearby for onsite delivery.

Responsibilities

• Architect and implement end-to-end data migration pipelines from legacy systems to Azure Databricks and Delta Lake.
• Lead and mentor a team of data engineers with PySpark, Spark SQL, and Azure cloud infrastructure.
• Collaborate with stakeholders to translate legacy data models into optimized cloud-native formats.
• Troubleshoot and optimize performance, memory usage, and data governance in cloud pipelines.
• Ensure cloud data architectures meet strict security, quality, and compliance standards.

Skills

Azure Databricks

Delta Lake

Apache Spark

PySpark

Cloud data architecture

Tools

ADLS Gen2

Azure Data Factory

Azure DevOps

Job description

Celebal Technologies in Grand Rapids, MI is seeking a seasoned Team Lead / Solution Architect to drive a cloud transformation. You will migrate complex legacy data systems to an Azure Databricks Lakehouse and lead delivery teams across data engineering disciplines.

The role requires hands-on engineering with strategic architectural oversight, ensuring governance, security, and regulatory compliance in a large-scale enterprise environment.