Team Lead / Solution Architect – (Databricks & Azure Migration)

Celebal Technologies; Grand Rapids (MI); On-site; USD 120,000 - 180,000; Full time

Job summary

Celebal Technologies in Grand Rapids, MI is seeking a seasoned Team Lead / Solution Architect to drive a cloud transformation. You will migrate complex legacy data systems to an Azure Databricks Lakehouse and lead delivery teams across data engineering disciplines.

The role requires hands-on engineering with strategic architectural oversight, ensuring governance, security, and regulatory compliance in a large-scale enterprise environment.

Qualifications

• 8–15 years of proven IT experience in data warehousing, big data and cloud environments.
• Advanced expertise in Azure Databricks, Delta Lake, Apache Spark, and cloud data architecture.
• Hands-on experience architecting and driving legacy-to-cloud data warehouse modernization projects.
• Deep proficiency with Azure cloud services (ADLS Gen2, Azure Data Factory, Azure DevOps).
• Must be locally based within Grand Rapids, MI (49544) or nearby for onsite delivery.

Responsibilities

• Architect and implement end-to-end data migration pipelines from legacy systems to Azure Databricks and Delta Lake.
• Lead and mentor a team of data engineers with PySpark, Spark SQL, and Azure cloud infrastructure.
• Collaborate with stakeholders to translate legacy data models into optimized cloud-native formats.
• Troubleshoot and optimize performance, memory usage, and data governance in cloud pipelines.
• Ensure cloud data architectures meet strict security, quality, and compliance standards.

Skills

Azure Databricks

Delta Lake

Apache Spark

PySpark

Cloud data architecture

Tools

ADLS Gen2

Azure Data Factory

Azure DevOps

Job description

Location: Grand Rapids, MI 49544

Position Type: Full-Time/Direct Hire (Preferred) or Long-term Contract

Experience Level: 8+ Years

Position Overview

Celebal Technologies is seeking a seasoned Team Lead / Solution Architect to spearhead a high-impact, enterprise-scale cloud transformation initiative. In this role, you will take ownership of migrating complex legacy data systems to a modern Databricks Lakehouse platform on Azure. The ideal candidate will combine strong hands-on engineering capabilities with strategic architectural vision to lead delivery teams and map robust data frameworks in a highly regulated environment.

Key Responsibilities

• Architecture & Design: Architect, design, and implement end-to-end data migration pipelines from legacy systems to Azure Databricks and Delta Lake.
• Technical Leadership: Lead, mentor, and provide technical governance to a team of data engineers, ensuring best practices in PySpark, Spark SQL, and Azure cloud infrastructure.
• Migration Strategy: Collaborate with business stakeholders and project managers to convert complex legacy data models into optimized cloud-native formats.
• Performance Optimization: Troubleshoot and resolve complex data engineering bottlenecks, including Spark tuning, memory optimization, and data governance frameworks.
• Compliance & Governance: Ensure all cloud data architectures meet strict enterprise data security, quality, and compliance standards.

Required Skills & Qualifications

• Experience: 8-15 years of proven IT experience with a heavy focus on data warehousing, big data, and cloud environments.
• Core Core Tech Stack: Advanced expertise in Azure Databricks, Delta Lake, Apache Spark, and cloud data architecture.
• Migration Track Record: Hands-on experience architecting and driving legacy-to-cloud data warehouse modernization projects.
• Cloud Ecosystem: Deep proficiency with Azure cloud services (ADLS Gen2, Azure Data Factory, Azure DevOps).
• Proximity: Must be locally based within Grand Rapids, MI (49544) or the immediate surrounding area for onsite delivery.