Senior Data Engineer - Lakehouse & AI Platform, Remote

Careforth; United States; Remote; USD 112,000 - 170,000; Full time

Benefits offered by this job

Remote-first culture

Wellness program

Flexible schedules

Job summary

Careforth in the United States is seeking a Senior Data Engineer to architect and operate our cloud-native lakehouse data platform powering AI and analytics products for clinical and caregiver workflows.

You will own end-to-end data pipelines using Databricks, Spark, and AWS services, ensuring HIPAA‑compliant, scalable data infrastructure, while mentoring engineers and collaborating with data science teams.

Qualifications

• 7–10 years of professional data engineering experience.
• 3+ years with modern cloud-based data lake/lakehouse architectures.
• Deep expertise in Apache Spark and Databricks across Delta Lake, Unity Catalog, and Workflows.
• AWS data services familiarity (S3, Redshift, Athena, Glue, Lambda, Step Functions, Kinesis).
• Experience in healthcare or regulated data environments; HIPAA safeguards required.
• Experience building ML feature stores and model pipelines.

Responsibilities

• Architect scalable data pipelines using Databricks and AWS.
• Evolve lakehouse architecture and semantic data layer.
• Build ETL/ELT and streaming pipelines ingesting healthcare data.
• Collaborate with data scientists on feature stores and models.
• Develop data infra for LLM/NLP use cases and audits.
• Create APIs and integrations for dashboards and CRMs.
• Ensure HIPAA-compliant data handling and security.
• Lead code reviews, mentor juniors, explore new tools.
• Participate in design discussions across product lines.

Skills

Python

SQL

Spark

Databricks

Airflow

dbt

Kubernetes

AWS

HIPAA

Communication

Education

Bachelor's or Master's in Computer Science / Data Engineering

Tools

Delta Lake

Unity Catalog

Workflows

S3

Redshift

Athena

Glue

Lambda

Step Functions

Kinesis

Job description

Careforth in the United States is seeking a Senior Data Engineer to architect and operate our cloud-native lakehouse data platform powering AI and analytics products for clinical and caregiver workflows.

You will own end-to-end data pipelines using Databricks, Spark, and AWS services, ensuring HIPAA‑compliant, scalable data infrastructure, while mentoring engineers and collaborating with data science teams.