Shape and lead mission-critical data platform capabilities across ingestion, transformation, orchestration, and serving at SCP Health.
Responsibilities
- Define and evolve reference architectures and standards for ingestion, transformation, orchestration, and serving layers (Snowflake + dbt and adjacent tooling); lead design reviews and set guardrails for scalable, secure, observable, and maintainable delivery.
- Own end-to-end delivery and operational excellence for critical datasets and pipelines supporting revenue cycle, physician scheduling, billing, and performance monitoring; define SLAs/SLOs, error budgets (where applicable), and support models to sustain reliability.
- Lead strategy and implementation for complex, multi-facility integrations (EHR extracts, HL7, FHIR, APIs, flat files), including backfills, reconciliation, and long-term maintainability.
- Establish repeatable onboarding playbooks and reusable patterns that teams adopt across facilities and domains.
- Own and enforce platform-wide conventions across Bronze/Silver/Gold layers including naming, modeling, testing, documentation, lineage, and certification.
- Escalate and lead resolution for major incidents impacting critical pipelines or multiple domains; coordinate triage, drive cross-team fixes, run blameless post-incident reviews, and prevent recurrence via alerting, runbooks, resilience patterns, and backlog prioritization.
- Drive Snowflake performance and cost optimization initiatives (warehouse/workload design, scheduling, resource monitors, query tuning); establish decision frameworks balancing reliability, latency, and consumption and communicate tradeoffs to stakeholders.
- Architect and implement HIPAA-aligned controls for PHI/PII including least-privilege RBAC, masking, row/column policies, auditing, and secure sharing; partner with Security/Compliance on access patterns, periodic reviews, audits, and remediation.
- Define and operationalize platform-level data quality strategy (tests, reconciliation, anomaly detection, freshness/completeness targets) and observability standards; ensure measurable coverage for critical pipelines and guide consistent adoption.
- Lead technical discovery with stakeholders: clarify ambiguous requirements, propose options, align on definitions, acceptance criteria, change impacts, and rollout plans.
- Mentor Data Engineers I–III through coaching, pairing, and feedback; raise the engineering bar with code/design reviews, reusable libraries/macros, documentation standards, and pragmatic guidance on tradeoffs.
- Improve data CI/CD and release practices using testing gates, automated checks, environment promotion, release strategy, and rollback planning to reduce defects and improve delivery predictability.
- Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap, identify systemic risks and dependencies, and propose investments that improve scalability, reliability, governance, and team velocity.
Requirements
- Expert-level ability to design, optimize, and troubleshoot complex SQL workloads; diagnose performance at query and system levels; define scalable data access and transformation patterns.
- Deep expertise in Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring; ability to set standards and coach others using usage and query analytics.
- Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion; define, enforce, and evolve conventions that scale across teams.
- Ability to define canonical models and data products across domains (including dimensional/domain-oriented patterns), manage change over time (SCDs), and drive alignment on definitions.
- Ability to define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems; drive systemic improvements through problem management.
- Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet); build reusable onboarding patterns adopted across multiple facilities and domains.
- HIPAA-aligned design experience for PHI/PII including least-privilege access models, masking and row/column policies, auditability, and secure sharing; partner with Security/Compliance and lead remediation when gaps are found.
- Lead discovery and design reviews; make pragmatic tradeoffs; influence without authority; drive adoption through enablement (documentation, office hours, templates) and consistent standards.
- Identify systemic issues and investment opportunities; articulate multi-quarter technical plans; evaluate build vs. buy and sequence work to reduce risk and increase long-term leverage.
- Communicate clearly with technical and non-technical partners; align on definitions and expectations; provide transparent status, risk, and tradeoff updates.
- Bachelor’s degree (BA/BS) in MIS, Computer Science, or a related field; or equivalent combination of education and experience.
- 8+ years of progressive professional experience in Data Engineering, Analytics Engineering, or related roles, including ownership of production data pipelines and data products across multiple domains and leadership of complex cross-domain initiatives.
- 4+ years hands‑on experience building and operating solutions within the Snowflake ecosystem, including performance tuning and practical cost management.
- Healthcare, Revenue Cycle (RCM), and/or integrating clinical data feeds strongly preferred; experience working with PHI/PII and regulated data expected.
- Experience in Agile/Scrum, including technical leadership across initiatives and mentoring engineers through implementation and support.
- HIPAA Security/Privacy training required and/or related healthcare compliance certifications preferred.
- Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
Technologies
- Snowflake, dbt, SQL
- HL7, FHIR, APIs, EHR extracts, Flat files
- HIPAA, RBAC
- JSON, Parquet
- CDC
Benefits
- Comprehensive benefits package
- Competitive compensation
- Medical, dental, vision insurance
- 401(k) plan with company match
- Paid time off and holidays
- Professional development support
- Employee wellness resources
- Work‑life balance
Certificates and Licenses
- Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
- SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification.
- dbt Analytics Engineering Certification (preferred), with demonstrated experience operating dbt in production.
- HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).
Work Environment and Physical Demands
- Professional setting
- Continuous sitting
- Continuous oral, written communication, and listening skills
- Continuous computer use
- Occasional bending, kneeling, lifting, pulling, and pushing up to 10 pounds
- Minimum travel, when applicable
- High level of mental awareness required
Location
- Lafayette, LA (onsite) - Corporate HQ
- Secondary locations: Atlanta, GA; Dallas, TX
Compensation
- USD 86,539 - 128,101 per year
Why You Will Love Working Here
- Strong track record of providing excellent work-life balance
- Comprehensive benefits package and competitive compensation
- Inclusive culture built on collaboration, courage, agility, and respect