Director of BI and Data Engineering

Jobot; Town of Florida (NY); Hybrid; USD 175,000 - 230,000; Full time

Job summary

Jobot is seeking a Director of BI and Data Engineering to own the enterprise data platform, analytics ecosystem, and data engineering strategy for a growing healthcare organization in Hollywood, FL. This hands‑on, builder‑first leadership role will oversee a modern Databricks lakehouse, governance standards, and a high‑performing data and BI team shaping the technology roadmap.

You will partner with clinical, operations, finance, and executive leadership to translate business needs into scalable

Qualifications

• 10+ years of experience in data engineering, BI, or analytics leadership.
• Healthcare data experience and HIPAA knowledge is desirable.
• Strong SQL, data modeling, and governance skills.
• Experience with Databricks lakehouse and cloud platforms (Azure).

Responsibilities

• Own the Databricks lakehouse architecture and data pipelines.
• Lead the BI semantic layer and enterprise KPI definitions.
• Establish data quality controls and governance across data platforms.
• Build and mentor a high‑performing data engineering team and partner with executives.

Skills

Databricks

Apache Spark

SQL

Cube/Looker

Power BI

CI/CD

GitHub

Confluence

dbt

Azure

Tools

Jira

GitHub

Confluence

dbt

Airflow

Astronomer

Power BI

Looker

Job description

Director of BI and Data Engineering

$175000 - $230000 per year | Hollywood, FL | Hybrid | Permanent

Lead the Data Strategy for a Growing Healthcare Org | Own a Modern Databricks Platform, Build Your Team & Drive Enterprise-Wide Impact

A bit about us:

Our client is a growing healthcare organization focused on improving patient outcomes through data-driven decision-making, operational efficiency, and innovative technology. Operating in a complex, highly regulated healthcare environment, they leverage clinical, claims, and operational data to support better care delivery, strengthen performance, and provide actionable insights across the business. As they continue to scale, they're investing in modern data infrastructure, analytics, and engineering capabilities to support long-term growth.

Why join us?

This is an opportunity to take ownership of an enterprise data and analytics function at a growing healthcare organization. You'll have the ability to shape the technical strategy, modernize a Databricks-based data platform, establish engineering standards, and build a high-performing team. With direct exposure to executive leadership and meaningful influence over the technology roadmap, you'll play a critical role in building scalable, reliable data solutions that directly support business operations and healthcare outcomes.

Job Details

We are partnering with a growing healthcare organization to hire a Director of Business Intelligence & Data Engineering to own its enterprise data platform, analytics ecosystem, and data engineering strategy.

This is a hands‑on, builder‑first leadership role for someone who can set technical direction while remaining close to the architecture and engineering work. You will lead the evolution of a modern Databricks lakehouse, establish a governed source of truth for enterprise metrics, strengthen data quality and engineering standards, and build a high‑performing data and BI organization.

The ideal candidate has built and operated modern data platforms within healthcare and understands the complexity of payer, claims, clinical, and operational data.

What You'll Own

Data Platform & Architecture

• Own and evolve the Databricks lakehouse architecture, including Bronze, Silver, and Gold layers.
• Drive pipeline reliability, performance, lineage, observability, and governance across the data platform.
• Establish standards for ingesting and transforming payer, claims, clinical, CRM, and other enterprise data.
• Ensure curated datasets and data marts remain accurate, current, scalable, and trusted across the organization.
• Own governance across Delta Lake, Unity Catalog, SQL warehouses, and related Databricks capabilities.

Business Intelligence & Semantic Layer

• Own the organization's governed semantic and metrics layer, creating a single source of truth for enterprise KPIs.
• Establish reusable definitions and models that deliver consistent metrics across leadership, finance, clinical, and operational teams.
• Oversee the BI and reporting environment, ensuring dashboards are accurate, timely, governed, and actionable.
• Drive adoption of modern semantic-layer platforms such as Cube or Looker, with Power BI experience considered a plus.

Data Quality & Governance

• Build data-quality controls that identify issues before upstream disruptions impact downstream reporting or applications.
• Implement automated checks around data freshness, completeness, reconciliation, and integrity.
• Establish clear ownership, lineage, alerting, and root‑cause visibility across critical data pipelines.
• Maintain the standards required for a highly sensitive and regulated healthcare data environment.

Engineering & Delivery

• Establish strong engineering practices across data pipelines and data‑adjacent applications, including code review, automated testing, CI/CD, and environment parity.
• Lead a disciplined two‑week sprint cadence using tools such as JIRA, GitHub, and Confluence.
• Improve requirements definition and prioritization to ensure engineering teams remain focused on high‑impact initiatives.
• Champion responsible AI‑assisted development using tools such as Claude Code and Cursor while maintaining human review, testing, and engineering accountability.

Cloud, Security & Cost Governance

• Own cloud cost governance across Azure and Databricks, including workload budgets, tagging, ownership, right‑sizing, and usage controls.
• Establish visibility into platform consumption and prevent unexpected infrastructure costs.
• Maintain private networking, least‑privilege access, audit logging, encryption, and access‑review standards.
• Ensure the data environment supports HIPAA‑aligned security and governance requirements.

Team Leadership & Strategy

• Lead and grow the data engineering and business intelligence organization.
• Provide technical direction to distributed and offshore engineering resources.
• Build hiring pipelines, lead technical interviews, and establish a high engineering bar for the team.
• Partner closely with clinical, operations, finance, and executive leadership to translate business needs into scalable data solutions.
• Own and prioritize the data roadmap, ensuring resources remain focused on the organization's highest‑impact initiatives.

What We're Looking For

• 10+ years of experience across data engineering, data architecture, or business intelligence, including 3+ years leading technical teams.
• Deep, hands‑on expertise with Databricks and Apache Spark, including lakehouse architecture, Delta Lake, Unity Catalog, and SQL warehouses.
• Experience building and governing a modern semantic or metrics layer, ideally using Cube or Looker/LookML.
• Advanced SQL skills and strong knowledge of dimensional and semantic data modeling.
• Healthcare industry experience is required, with hands‑on exposure to payer, claims, clinical, or healthcare operational data.
• Strong understanding of healthcare data security and regulatory requirements, including HIPAA, HITECH, PHI, and BAAs.
• Experience establishing engineering standards around testing, code review, sprint delivery, and CI/CD.
• Experience with modern cloud data environments, preferably Microsoft Azure.
• Strong knowledge of data governance, lineage, observability, and data‑quality practices.
• Ability to communicate effectively with both highly technical teams and executive/business stakeholders.

Preferred Experience

• Experience within an MSO, IPA, ACO, Medicare Advantage, or value‑based‑care organization.
• Knowledge of healthcare datasets and programs including HEDIS, HCC/risk adjustment, MMR, eligibility, and claims.
• Familiarity with healthcare transaction formats including X12 837, 835, 834, 270, and 271.
• Experience with dbt, Airflow, Astronomer, or comparable orchestration and data‑platform tooling.
• Power BI experience.
• Salesforce data integration and pipeline experience.
• Application engineering exposure involving technologies such as FastAPI, React, or Azure Container Apps.
• FinOps or cloud cost‑management experience.
• Experience leading distributed or offshore engineering teams.

The Ideal Profile

You are a technical data leader who still understands the details. You've built or significantly evolved a modern healthcare data platform, know what trustworthy data looks like, and can challenge architecture and modeling decisions rather than simply managing the people making them.

You bring structure to environments that are growing quickly: clear ownership, reliable pipelines, governed metrics, strong engineering practices, and a roadmap the organization can actually execute. Most importantly, you understand that in healthcare, data accuracy, security, and traceability aren't optional.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information or any other basis protected by applicable federal, state, or local laws. Jobot also prohibits harassment of applicants or employees based on any of these protected categories. It is Jobot’s policy to comply with all applicable federal, state and local laws respecting consideration of unemployment status in making hiring decisions.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Information collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Jobot, and/or its agents and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: jobot.com/privacy-policy