Senior Data Architect for AI-Ready Cloud Platform

Ensemble Health Partners; United States; Remote; USD 149,000 - 223,000; Full time

Benefits offered by this job

Remote work option

Tuition reimbursement

Certification support

Job summary

Ensemble Health Partners is seeking a Principal Data Engineer to lead data architecture for a cloud-native platform on Azure and Databricks. You will drive assessment, design scalable solutions, and guide AI-enabled analytics across teams.

The role emphasizes technical decision making, mentorship, and cross-functional collaboration, with a focus on cost optimization and long-term sustainability across the data ecosystem.

Qualifications

• 10+ years of relevant job experience.
• Deep experience designing and reviewing SQL-based data models and transformations at enterprise scale.
• 3+ years working with big data technologies including but not limited to Databricks, SPARK, Azure.
• Excellent understanding of engineering fundamentals: testing automation, code reviews, telemetry, iterative delivery and DevOps.
• Experience with polyglot storage architectures including relational, columnar, key-value, graph or equivalent.

Responsibilities

• Conduct cross-organizational assessments of existing data pipelines, platforms, and engineering practices to identify inefficiencies, technical debt, risk, and opportunities for improvement.
• Architect scalable, secure, and cost-efficient data solutions that span multiple teams and business domains, built on Databricks and Azure.
• Act as a technical escalation point for the organization’s hardest data engineering problems, diagnosing recurring or systemic reliability issues in tier-1 pipelines and datasets.
• Define and evolve data engineering standards, patterns, and architectural guardrails used across engineering teams, balancing standardization with the flexibility teams need to move quickly.
• Establish and evolve a data platform architecture that enables AI, machine learning, and advanced analytics workloads, including feature readiness, training data quality, lineage, and observability.

Skills

Databricks

Azure

SQL

Data architecture

Mentorship

Stakeholder comms

Tools

Databricks Platform

Job description

Ensemble Health Partners is seeking a Principal Data Engineer to lead data architecture for a cloud-native platform on Azure and Databricks. You will drive assessment, design scalable solutions, and guide AI-enabled analytics across teams.

The role emphasizes technical decision making, mentorship, and cross-functional collaboration, with a focus on cost optimization and long-term sustainability across the data ecosystem.