Senior Data & AI Engineer

Hospice of the Valley; Phoenix (AZ); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Supportive environment

Benefits program

Paid time off

Flexible schedules

Job summary

Hospice of the Valley seeks a Senior Data & AI Engineer to design secure, scalable data platforms using Snowflake and Microsoft Fabric. You will work with claims and clinical data to build ML pipelines, implement data modeling and integration, and support data governance.

Collaborate with clinicians and analytics teams to improve cost, quality, and patient experience. You’ll deploy MLOps, ensure HIPAA compliance, and drive measurable outcomes in a mission-driven, not-for-profit setting.

Qualifications

• 8+ years in data engineering/analytics.
• 5+ years hands-on with Snowflake (compute, storage, virtual warehouses, tasks, streams, Snowpipe, Time Travel, RBAC, row/column masking, data sharing, Dynamic Tables).
• 2+ years with Microsoft Fabric (incl. OneLake, Lakehouses, Warehouses, Dataflows Gen2, Notebooks, Pipelines; capacity management).
• Data integration & transformation proficiency: SQL (advanced), dbt or Fabric Dataflows/Power Query M, ADF/Synapse/Fabric Pipelines, Python for ETL/ELT.
• Mapping from CMS data (CMS datasets, claims/encounters), X12/EDI, FHIR/HL7, provider and eligibility.
• Structured and unstructured data; NLP pipelines (optional but valued).
• ML: feature engineering, model training/evaluation, deployment; production monitoring.
• Security & compliance: HIPAA, PHI handling, auditing, data residency, access control in Snowflake/Fabric.
• Strong communication; ability to author mapping specs, lineage docs, and present trade‑offs.

Responsibilities

• Architect, implement, and optimize data solutions in Snowflake and Fabric.
• Build ingestion frameworks for batch and streaming data with lineage and governance.
• Manage data security, privacy, and compliance.
• Design conceptual/logical/physical models.
• Implement data mapping and transformations for structured and unstructured data.
• Harmonize healthcare data using standards; link records across sources.
• Build ML pipelines for risk stratification, forecasting, QA measures.
• Operationalize models with MLOps; monitoring and drift detection.
• Leverage LLMs for data quality, entity resolution, and clinical insights; ensure auditability.
• Implement data cataloging, lineage, metadata; quality rules.
• Produce documentation; mentor engineers; contribute to roadmaps.
• Maintain and enhance professional skills; adhere to standards.

Skills

Data modeling

Data integration

Data transformation

Machine learning

MLOps

Communication

Tools

Snowflake

Microsoft Fabric

Power BI

Azure ML

Job description

Join Arizona’s largest, most prominent not-for-profit hospice, serving the valley since 1977.

Hospice of the Valley is a national leader in hospice care and has been serving thePhoenixmetropolitan area since 1977. A mission-driven, not-for-profit organization, Hospice of the Valley employs compassionate, skilled professionals who are committed to excellence, enjoy teamwork, and contribute daily to our mission and culture of caring. Team members experience a friendly, supportive atmosphere, leadership support, autonomy, flexibility, and the privilege of doing meaningful, rewarding work.

• Supportive work environment with a culture of caring for patients and one another.
• Competitive wages and excellent benefit program.
• Generous Paid Time Off.
• Flexible schedules for work/life balance.

Position Profile

The Senior Data & AI Engineer will need to have deep hands ‑ on experience in Snowflake, Microsoft Fabric (incl. OneLake), and healthcare data ecosystems. The ideal candidate understands data modeling, data integration, and data transformation across structured and unstructured sources, and can build machine learning pipelines that operate on claims and clinical data. You’ll design secure, scalable data platforms; map and normalize data across payers, providers, CMS datasets, EHR systems, and HIEs; and operationalize AI tools to drive measurable outcomes in cost, quality, and member/patient experience.

Responsibilities

• Architect, implement, and optimize data solutions in Snowflake and Microsoft Fabric (incl. OneLake, Lakehouses, Warehouses, and Data Engineering pipelines).
• Build robust ingestion frameworks for batch and streaming data (e.g., ADLS, EventHub, APIs, SFTP) with lineage and governance.
• Manage data security, privacy, and compliance (HIPAA/PHI; role ‑ based access, masking, tokenization, de ‑ identification ).

Data Modeling & Integration

• Design conceptual/logical/physical models (normalized, dimensional/star, data vault where appropriate).
• Implement data mapping and transformations for structured (claims, eligibility, provider, enrollment) and unstructured (clinical notes, PDFs) data.
• Harmonize healthcare data using FHIR/HL7/ C ‑ CDA , X12/EDI 837/835, NCPDP, and CMS standards; reconcile and link records across EHR and HIE sources.
• Build ML pipelines for risk stratification, cost/utilization forecasting, fraud/waste/abuse detection, quality measure computation (e.g., HEDIS), and care gap identification.
• Operationalize models with MLOps (experiment tracking, reproducibility, CI/CD, monitoring, drift detection).
• Leverage LLMs/AI tools for data quality, entity resolution, summarization, and clinical insights—ensuring safety, bias checks, and auditability.

Governance & Observability

• Implement data cataloging, lineage, and metadata (e.g., Microsoft Purview or equivalent).
• Establish quality SLAs, validation rules, profiling, and automated anomaly detection.
• Instrument pipelines for cost, performance, and reliability (e.g., Snowflake resource monitors, Fabric capacities).
• Work with product owners, clinicians, actuaries, and analytics teams to translate requirements into scalable solutions.
• Produce clear documentation, data dictionaries, and mapping specs; mentor engineers and analysts.
• Contribute to architectural roadmaps, reference patterns, and best practices across the enterprise.

Maintains and enhances professional skills.

Adheres to high standards of personal and professional conduct.

Minimum Qualifications

• 8+ years in data engineering/analytics; 5+ years hands ‑ on with Snowflake (compute, storage, virtual warehouses, tasks, streams, Snowpipe, Time Travel, RBAC, row/column masking, data sharing, Dynamic Tables).
• 2+ years with Microsoft Fabric (including OneLake, Lakehouses, Warehouses, Dataflows Gen2, Notebooks, Pipelines; capacity management).
• Data integration & transformation proficiency: SQL (advanced), dbt or Fabric Dataflows/Power Query M, ADF/Synapse/Fabric Pipelines, Python for ETL/ELT.
• Mapping from CMS data (e.g., Medicare datasets, claims/encounters), X12/EDI, FHIR/HL7, provider and eligibility.
• Experience with structured (tables, CSV, Parquet) and unstructured (clinical notes, PDFs, blobs) data; NLP pipelines (optional but valued).
• Machine learning: feature engineering, model training/evaluation, and deployment (e.g., scikit ‑ learn , PyTorch/TensorFlow, Fabric ML/Notebook, Azure ML); production monitoring.
• Security & compliance: HIPAA, PHI handling, auditing, data residency, BAAs; practical access control in Snowflake/Fabric.
• Strong communication; ability to author mapping specs, lineage docs, and present trade ‑ offs to technical and non ‑ technical stakeholders.

Preferred Qualifications

• Interoperability: FHIR R4, HL7 v2, X12/EDI (837/835), NCPDP; experience with HIEs and EHR integrations (Epic, Cerner, etc.).
• CMS & payer/provider data: Medicare fee ‑ for ‑ service , MA, Medicaid, CCW, APCD, and quality programs; risk adjustment (HCC), HEDIS measures.
• MLOps & DevOps: MLflow, DVC, GitHub Actions/Azure DevOps, containerization (Docker), orchestration (Airflow, Fabric Pipelines, or ADF).
• Governance: Microsoft Purview (catalog, lineage, classifications), data quality tools.
• Visualization: Power BI and Fabric Direct Lake; semantic modeling and row ‑ level security.
• Cloud: Azure (ADLS, Event Hub, Functions, Key Vault, Databricks), optional AWS/GCP exposure.
• Certifications: Snowflake SnowPro Core/Advanced, Microsoft Certified (Azure Data Engineer Associate, Fabric Analytics Engineer).

Hospice of the Valley is an equal employment opportunity employer. EOE/M/F/D/V