Senior Data Engineer

SCP Health

Lafayette (LA)

On-site

USD 87,000 - 128,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Comprehensive benefits package
Competitive compensation
401(k) plan with company match
Paid time off and holidays
Professional development support
Employee wellness resources
Work‑life balance

Job summary

SCP Health is seeking a Senior Data Engineer to shape and lead mission-critical data platform capabilities across ingestion, transformation, orchestration, and serving at our Lafayette, LA headquarters. You will own end-to-end data delivery for revenue cycle, scheduling, and performance monitoring, while defining SLAs/SLOs and enforcing HIPAA-aligned controls.

You will collaborate with Security/Compliance, lead cross-team initiatives, and evolve scalable patterns for multi-facility data

Qualifications

  • Expert-level design, optimization, and troubleshooting of complex SQL workloads.
  • Deep Snowflake architecture knowledge including governance, performance tuning, and cost optimization.
  • Advanced dbt project organization, macros, testing, and environment promotion.
  • Ability to define canonical models and handle SCDs across domains.
  • Define SLAs/SLOs and implement monitoring and runbooks.
  • HIPAA-aligned design for PHI/PII with least-privilege access and auditing.
  • Experience with batch and near-real-time patterns (CDC, backfill) and APIs.
  • Lead design reviews and enable adoption through templates and documentation.
  • Identify systemic issues and articulate multi-quarter technical plans.
  • Strong communication with technical and non-technical partners.
  • Bachelor’s degree or equivalent field experience.
  • 8+ years in Data/Analytics Engineering with cross-domain ownership.
  • 4+ years hands-on Snowflake experience including performance tuning.
  • Healthcare/RCM experience and Agile/Scrum leadership a plus.
  • Relevant certifications in Data/Analytics/Cloud are advantageous.

Responsibilities

  • Define and evolve reference architectures for ingestion, transformation, orchestration, and serving.
  • Own end-to-end delivery for datasets supporting revenue cycle, scheduling, and billing.
  • Lead multi-facility integrations (HL7, FHIR, APIs, flat files) and backfills.
  • Establish onboarding playbooks and reusable patterns across teams.
  • Enforce platform conventions across Bronze/Silver/Gold layers.
  • Coordinate incident response and postmortems to drive improvements.
  • Drive Snowflake performance and cost optimization and communicate tradeoffs.
  • Architect HIPAA-aligned controls and partner with Security/Compliance.
  • Define data quality strategy and observability standards.
  • Mentor engineers and improve CI/CD with gates and automated checks.
  • Shape platform roadmap with stakeholders for scalability and governance.

Skills

SQL workloads
Snowflake architecture
dbt project organization
SCD data modeling
SLA/SLO design
HIPAA-aligned design
Batch/real-time patterns
Cross-team leadership
Agile/Scrum
Stakeholder communications

Education

Bachelor’s degree in MIS/CS or related field

Tools

Snowflake
dbt
SQL

Job description

Shape and lead mission-critical data platform capabilities across ingestion, transformation, orchestration, and serving at SCP Health.

Responsibilities
  • Define and evolve reference architectures and standards for ingestion, transformation, orchestration, and serving layers (Snowflake + dbt and adjacent tooling); lead design reviews and set guardrails for scalable, secure, observable, and maintainable delivery.
  • Own end-to-end delivery and operational excellence for critical datasets and pipelines supporting revenue cycle, physician scheduling, billing, and performance monitoring; define SLAs/SLOs, error budgets (where applicable), and support models to sustain reliability.
  • Lead strategy and implementation for complex, multi-facility integrations (EHR extracts, HL7, FHIR, APIs, flat files), including backfills, reconciliation, and long-term maintainability.
  • Establish repeatable onboarding playbooks and reusable patterns that teams adopt across facilities and domains.
  • Own and enforce platform-wide conventions across Bronze/Silver/Gold layers including naming, modeling, testing, documentation, lineage, and certification.
  • Escalate and lead resolution for major incidents impacting critical pipelines or multiple domains; coordinate triage, drive cross-team fixes, run blameless post-incident reviews, and prevent recurrence via alerting, runbooks, resilience patterns, and backlog prioritization.
  • Drive Snowflake performance and cost optimization initiatives (warehouse/workload design, scheduling, resource monitors, query tuning); establish decision frameworks balancing reliability, latency, and consumption and communicate tradeoffs to stakeholders.
  • Architect and implement HIPAA-aligned controls for PHI/PII including least-privilege RBAC, masking, row/column policies, auditing, and secure sharing; partner with Security/Compliance on access patterns, periodic reviews, audits, and remediation.
  • Define and operationalize platform-level data quality strategy (tests, reconciliation, anomaly detection, freshness/completeness targets) and observability standards; ensure measurable coverage for critical pipelines and guide consistent adoption.
  • Lead technical discovery with stakeholders: clarify ambiguous requirements, propose options, align on definitions, acceptance criteria, change impacts, and rollout plans.
  • Mentor Data Engineers I–III through coaching, pairing, and feedback; raise the engineering bar with code/design reviews, reusable libraries/macros, documentation standards, and pragmatic guidance on tradeoffs.
  • Improve data CI/CD and release practices using testing gates, automated checks, environment promotion, release strategy, and rollback planning to reduce defects and improve delivery predictability.
  • Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap, identify systemic risks and dependencies, and propose investments that improve scalability, reliability, governance, and team velocity.
Requirements
  • Expert-level ability to design, optimize, and troubleshoot complex SQL workloads; diagnose performance at query and system levels; define scalable data access and transformation patterns.
  • Deep expertise in Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring; ability to set standards and coach others using usage and query analytics.
  • Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion; define, enforce, and evolve conventions that scale across teams.
  • Ability to define canonical models and data products across domains (including dimensional/domain-oriented patterns), manage change over time (SCDs), and drive alignment on definitions.
  • Ability to define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems; drive systemic improvements through problem management.
  • Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet); build reusable onboarding patterns adopted across multiple facilities and domains.
  • HIPAA-aligned design experience for PHI/PII including least-privilege access models, masking and row/column policies, auditability, and secure sharing; partner with Security/Compliance and lead remediation when gaps are found.
  • Lead discovery and design reviews; make pragmatic tradeoffs; influence without authority; drive adoption through enablement (documentation, office hours, templates) and consistent standards.
  • Identify systemic issues and investment opportunities; articulate multi-quarter technical plans; evaluate build vs. buy and sequence work to reduce risk and increase long-term leverage.
  • Communicate clearly with technical and non-technical partners; align on definitions and expectations; provide transparent status, risk, and tradeoff updates.
  • Bachelor’s degree (BA/BS) in MIS, Computer Science, or a related field; or equivalent combination of education and experience.
  • 8+ years of progressive professional experience in Data Engineering, Analytics Engineering, or related roles, including ownership of production data pipelines and data products across multiple domains and leadership of complex cross-domain initiatives.
  • 4+ years hands‑on experience building and operating solutions within the Snowflake ecosystem, including performance tuning and practical cost management.
  • Healthcare, Revenue Cycle (RCM), and/or integrating clinical data feeds strongly preferred; experience working with PHI/PII and regulated data expected.
  • Experience in Agile/Scrum, including technical leadership across initiatives and mentoring engineers through implementation and support.
  • HIPAA Security/Privacy training required and/or related healthcare compliance certifications preferred.
  • Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
Technologies
  • Snowflake, dbt, SQL
  • HL7, FHIR, APIs, EHR extracts, Flat files
  • HIPAA, RBAC
  • JSON, Parquet
  • CDC
Benefits
  • Comprehensive benefits package
  • Competitive compensation
  • Medical, dental, vision insurance
  • 401(k) plan with company match
  • Paid time off and holidays
  • Professional development support
  • Employee wellness resources
  • Work‑life balance
Certificates and Licenses
  • Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
  • SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification.
  • dbt Analytics Engineering Certification (preferred), with demonstrated experience operating dbt in production.
  • HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).
Work Environment and Physical Demands
  • Professional setting
  • Continuous sitting
  • Continuous oral, written communication, and listening skills
  • Continuous computer use
  • Occasional bending, kneeling, lifting, pulling, and pushing up to 10 pounds
  • Minimum travel, when applicable
  • High level of mental awareness required
Location
  • Lafayette, LA (onsite) - Corporate HQ
  • Secondary locations: Atlanta, GA; Dallas, TX
Compensation
  • USD 86,539 - 128,101 per year
Why You Will Love Working Here
  • Strong track record of providing excellent work-life balance
  • Comprehensive benefits package and competitive compensation
  • Inclusive culture built on collaboration, courage, agility, and respect
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

TSG Resources, Inc. • Louisiana

On-site
USD 87,000 - 128,000
Medical insurance
Dental insurance
Vision insurance
+1
Senior Data Engineer
Senior Data Engineer

RxSense LLC • Oregon

Hybrid
USD 145,000 - 165,000
Senior Data Engineer
Senior Data Engineer

MISUMI Americas • Schaumburg (IL)

On-site
USD 167,000 - 202,000
Comprehensive medical and dental
401(k) plan
Generous PTO and leave programs
Senior Data Engineer
Senior Data Engineer

Syndesus, Inc. • New York (NY)

On-site
USD 170,000 - 190,000
Senior Data Engineeer
Senior Data Engineeer

BuildOps • Los Angeles (CA)

On-site
USD 120,000 - 197,000
Data Engineer III
Data Engineer III

Seminole Hard Rock Support Services • Florida

On-site
USD 130,000 - 190,000
Benefits package
Information Technology - Senior Data Engineer (USA)
Information Technology - Senior Data Engineer (USA)

DiversiTech Corporation • Duluth (GA)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

TSG Resources • Lafayette (LA)

On-site
USD 140,000 - 180,000
Senior Data Engineer
Senior Data Engineer

RxSense • Boston (MA)

On-site
USD 150,000 - 190,000
Senior Data Engineer Schaumburg, IL
Senior Data Engineer Schaumburg, IL

Fictiv • Schaumburg (IL)

Remote
USD 167,000 - 202,000
Comprehensive medical and dental
401(k) plan
Generous PTO and leave programs