Senior Data Platform Engineer – Lakehouse & AI on Azure

ComplexCare Solutions; Nashville (TN); On-site; USD 140,000 - 190,000; Full time

Job summary

ComplexCare Solutions in Nashville seeks a Principal Software Data Engineer to lead the data platform, building lakehouse and warehouse solutions, and creating complex data pipelines using Azure Data Factory and Databricks notebooks. You will mentor teams and drive scalable analytics while partnering with stakeholders to forecast business needs.

This role emphasizes data governance, HIPAA compliance, and DevOps practices, with a focus on performance, security, and reliable production support

Qualifications

• 10+ years of related professional experience in data engineering.
• 5+ years on Databricks platform (Unity Catalog, DLTs, Spark SQL, PySpark).
• 7+ years on data platforms (Lakehouse, data warehouse, data marts).
• 5+ years in cloud environments (AWS/Azure) with 3+ years on Azure.

Responsibilities

• Architect and develop data pipelines and data marts on Databricks/Azure.
• Design and implement ELT processes and analytics in Power BI.
• Collaborate with stakeholders to understand data models and reporting needs.

Skills

Databricks

Azure

PowerBI

ETL pipelines

Python

HIPAA

Education

Bachelors in CS or related field

Databricks certification preferred

Tools

Unity Catalog

Delta Live Tables (DLTs)

DeltaShare

Azure Data Factory

Job description

ComplexCare Solutions in Nashville seeks a Principal Software Data Engineer to lead the data platform, building lakehouse and warehouse solutions, and creating complex data pipelines using Azure Data Factory and Databricks notebooks. You will mentor teams and drive scalable analytics while partnering with stakeholders to forecast business needs.

This role emphasizes data governance, HIPAA compliance, and DevOps practices, with a focus on performance, security, and reliable production support