Principal Data & AI Platform Architect – Azure Databricks

United Vein & Vascular Centers

Tampa (FL)

On-site

USD 150,000 - 210,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

United Vein & Vascular Centers (UVVC) in Tampa, FL, is seeking a Senior Data Architect to lead architecture, governance, and optimization of the enterprise data platform. You will design scalable data pipelines, medallion data products, and semantic models to enable trusted self-service analytics and AI-driven insights across UVVC.

This is a hands-on leadership role requiring collaboration with Security, Compliance, and business data owners to ensure HIPAA-aligned data solutions.

Qualifications

  • 8+ years in data engineering/architecture with production Databricks ownership
  • Hands-on expertise with Azure Data Factory and Databricks
  • Strong SQL and Python for data pipelines and analytics
  • Experience in HIPAA-compliant data environments and data governance

Responsibilities

  • Design and govern enterprise data platforms across Azure (ADLS Gen2, Azure SQL, Databricks)
  • Lead data modeling and Delta Lake/Medallion architecture implementation
  • Establish DataOps practices: testing, version control, monitoring, CI/CD
  • Collaborate with Security, Compliance and business data owners to ensure HIPAA alignment

Skills

Data architecture leadership
Azure data platform
SQL
Python
ETL/ELT
HIPAA compliance
Unity Catalog
Delta Lake
Databricks
Leadership & mentoring

Education

Bachelor's degree in CS/Engineering/related field
Master's degree preferred in data science or related

Tools

Azure Data Factory
Azure Databricks
Delta Lake
Power BI

Job description

Tampa, Florida, United States

Reporting to the Senior Director of Data & AI, the Senior Data Architect is a hands-on technical leader responsible for the architecture, engineering, governance, and optimization of UVVC’s enterprise data platform. This role will define technical standards and design scalable data pipelines, medallion data products, semantic models, and governed analytics solutions that enable trusted self-service analytics and AI-driven insights across UVVC.

Responsibilities
  • Design, build, and optimize batch and streaming ETL/ELT pipelines and reusable ingestion frameworks using Azure Data Factory and Databricks across APIs, databases, SaaS platforms, and internal systems.
  • Build scalable Delta Lake transformation frameworks using medallion architecture, Spark, and SQL.
  • Implement CI/CD, parameterization, triggers, and pipeline automation best practices.
  • Architect, manage, and optimize enterprise data environments across Azure Data Lake Storage Gen2 (ADLS Gen2), Azure SQL, and Databricks, including serverless and classic compute strategies, cost governance, and workload isolation strategies.
  • Implement DataOps practices including testing, version control, monitoring, and documentation.
Unity Catalog, Security & Data Governance
  • Design and administer the enterprise Unity Catalog structure, including catalogs, schemas, external locations, storage credentials, groups, service principals, and ownership models.
  • Implement least-privilege access, governed tags, attribute-based access-control policies, row-level filters, and column-level masking for PHI, PII, financial, and other sensitive information.
  • Establish standards for data classification, lineage, auditability, stewardship, retention, certification, and access reviews.
  • Partner with Security, Compliance, Privacy, and business data owners to ensure data solutions align with HIPAA and organizational security requirements.
  • Govern tables, views, volumes, functions, metric views, dashboards, models, and Genie Agents through Unity Catalog.
  • Design and develop Databricks AI/BI Dashboards and domain-specific Genie Agents for clinical, operational, financial, RCM, marketing, and executive use cases.
  • Configure trusted datasets, joins, business terminology, instructions, example queries, dimensions, measures, synonyms, and approved KPI definitions.
  • Develop and govern Unity Catalog metric views and semantic definitions to ensure consistent reporting across Databricks AI/BI and Power BI.
  • Establish testing and monitoring processes for Genie Agent accuracy, data grounding, security, explainability, performance, and user adoption.
  • Ensure that AI-generated results respect Unity Catalog permissions and approved business definitions.
  • Design and implement enterprise-grade Databricks Lakehouse Medallion architecture (Bronze, Silver, Gold layers).
  • Define and enforce data engineering standards, naming conventions, and architectural patterns across all pipelines.
  • Lead the architecture of Delta Lake design patterns, including partitioning, optimization, and data lifecycle management.
  • Establish scalable serverless and classic compute strategies, job orchestration frameworks, and workspace organization.
  • Evaluate and implement new Databricks capabilities and ensure alignment with enterprise data strategy.
Cross-Functional Collaboration
  • Work closely with clinical, sales, marketing, finance, RCM, operations, HR, and IT teams to understand business needs.
  • Provide technical guidance on data engineering patterns and platform capabilities.
  • Clearly communicate progress, risks, and technical decisions to data stakeholders and leadership.
Data Modeling and Enterprise Metrics
  • Develop conceptual, logical, dimensional, and physical data models supporting clinical, operational, financial, marketing, RCM, and workforce analytics.
  • Establish conformed dimensions, master and reference data standards, governed KPIs, and reusable semantic definitions.
  • Reduce conflicting calculations and duplicate business logic across Databricks AI/BI, Power BI, and downstream applications.
Data Quality and Observability
  • Establish data-quality rules, reconciliation controls, data SLAs, pipeline observability, alerting, incident response, and root-cause-analysis processes.
  • Define standards for schema evolution, change data capture, late-arriving data, historical tracking, retries, and recovery.
Performance and FinOps
  • Monitor and optimize Databricks consumption using system tables, workload tagging, budget controls, query profiling, serverless and classic compute selection, SQL warehouse configuration, and data-layout optimization.
  • Establish cost allocation and accountability by environment, data product, department, and workload.
Qualifications
Required Qualifications
  • 8+ years of progressive experience in data engineering, data architecture, analytics engineering, or cloud data platforms, including demonstrated ownership of production Databricks architecture.
  • Demonstrated technical leadership and mentoring experience within data engineering or architecture teams.
  • Hands-on expertise with Azure Data Factory, including pipelines, mapping data flows, Integration Runtime configuration and management, triggers, and monitoring.
  • Hands-on expertise with Azure Databricks, including notebooks, Apache Spark, Delta Lake, Databricks SQL, Lakeflow Jobs, Lakeflow pipelines, and workflow orchestration.
  • Advanced SQL expertise, including complex transformations, dimensional and semantic modeling, query-plan analysis, Delta Lake optimization, Databricks SQL, and SQL warehouse performance tuning.
  • Advanced proficiency in Python and PySpark for data engineering, reusable framework development, automation, testing, and performance optimization.
  • Deep expertise in Medallion Lakehouse architecture (Bronze/Silver/Gold) and Delta Lake optimization techniques.
  • Demonstrated experience designing, implementing, and operating enterprise Databricks environments across development, testing, and production, including security, governance, deployment, performance, and cost management responsibilities.
  • Strong understanding of Databricks Unity Catalog, data governance, and security models.
  • Strong understanding of HIPAA, PHI/PII safeguards, least-privilege access, data retention, auditability, and secure healthcare data integration.
  • Experience defining data platform standards, frameworks, and best practices
Preferred Qualifications
  • Experience with AI/ML workflows, feature engineering, or model enablement.
  • Experience integrating data across EHR/EMR, CRM, patient-engagement, contact-center, marketing, finance/ERP, HRIS, and revenue-cycle platforms.
  • Experience designing enterprise data models and governed KPIs for healthcare operations, including patient volume, referrals, scheduling, conversion, provider productivity, revenue cycle, payer performance, denials, collections, labor, and clinic-level financial performance.
  • Familiarity with real-time processing (Structured Streaming) within Databricks.
  • Experience with master data management, reference data, and entity-resolution strategies across patients, providers, locations, payers, legal entities, and acquired practices.
About us:

UVVC, is a leading provider of comprehensive vein and vascular care with over 60 clinics across Arizona, Illinois, Colorado, Florida, Georgia, Texas, and expanding. Our mission is to revolutionize vascular care by delivering an all-inclusive clinic experience that addresses every aspect of lower extremity vein, vascular, and wound conditions.

United Vein & Vascular Centers (UVVC) is distinguished by its innovative approach to diagnosing and treating a variety of vascular conditions that affect the pelvis and lower extremities. With a team of committed specialists, cutting-edge medical technology, and a patient-centric approach that emphasizes minimally invasive procedures, UVVC ensures superior care and optimal outcomes for it’s patients.

U.S. Standard Demographic Questions

We invite applicants to share their demographic background. If you choose to complete this survey, your responses may be used to identify areas of improvement in our hiring process.

How would you describe your gender identity? Select...

How would you describe your racial/ethnic background? Select...

How would you describe your sexual orientation? Select...

Do you identify as transgender? Select...

Do you have a disability or chronic condition (physical, visual, auditory, cognitive, mental, emotional, or other) that substantially limits one or more of your major life activities, including mobility, communication (seeing, hearing, speaking), and learning? Select...

Are you a veteran or active member of the United States Armed Forces? Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in United Vein & Vascular Centers’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-\u00E2\u0080\u009Cconnected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more ...

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention‑deficit/hyper‑activity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature ( dwarfism)

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Sr. Data Engineer
Sr. Data Engineer

PatientPoint® • Cincinnati (OH)

Hybrid
USD 80,000 - 120,000
Flexible Time Off
401K Plan
Mental Wellness Resources
+2
Veterinary Assistant
Veterinary Assistant

GoodVets • Northern (KY)

Hybrid
USD 26,000 - 33,000
Medical insurance
Dental insurance
Vision insurance
+4
CV/ML Platform Engineer: GPU Kubernetes & Edge Deploy
CV/ML Platform Engineer: GPU Kubernetes & Edge Deploy

Allen Control Systems • Austin (TX)

On-site
USD 100,000 - 130,000
Paid Time Off
Healthcare Data Analyst II - Remote (SQL & Analytics)
Healthcare Data Analyst II - Remote (SQL & Analytics)

Cohere Health, Inc. • Boston (MA)

Hybrid
USD 70,000 - 85,000
Analytics Manager New San Francisco, California, United States
Analytics Manager New San Francisco, California, United States

Forge Global • San Francisco (CA), Northern (KY)

Hybrid
USD 120,000 - 150,000
Director, AI & Agentic Engineering
Director, AI & Agentic Engineering

LinkedIn Job Wrapping • New York (NY)

On-site
USD 200,000 - 260,000
Senior Forward Deployed Software Engineer, GenAI
Senior Forward Deployed Software Engineer, GenAI

Scale AI • New York (NY)

Hybrid
USD 188,000 - 226,000
Comprehensive health, dental, and vision coverage
Retirement benefits
Learning and development stipend
+2
6456 - Control Systems Engineer / Senior Automation Engineer Portsmouth, NH
6456 - Control Systems Engineer / Senior Automation Engineer Portsmouth, NH

Verista • Portsmouth (NH)

On-site
USD 85,000 - 150,000
Company-paid Life Insurance
Disability Insurance
Tuition Reimbursement
+1
Medical Receptionist Concord, New Hampshire, United States
Medical Receptionist Concord, New Hampshire, United States

ConvenientMD LLC • Concord (NH)

Hybrid
USD 22,000 - 30,000
Health benefits
401(k) match
Tuition assistance
+2
Staff Accountant Stamford, Connecticut, United States
Staff Accountant Stamford, Connecticut, United States

Beeline Medicines Corporation • Stamford (CT)

Hybrid
USD 77,000 - 100,000