Senior Data Engineer — AI-Driven Health Data Platform

swoopishiring; Redwood City (CA); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Swoop is hiring a Senior Data Engineer to own NimbleRx's data platform, shaping how data informs product, analytics, and compliance. You’ll scale pipelines and ensure robust data infrastructure across teams.

You’ll work at the intersection of production and data engineering, building streaming and batch workflows, and mentoring engineers while advancing data security and performance. Join a fast-growing, patient-first tech company.

Qualifications

• 5+ years building production data pipelines and platforms.
• Strong Python (PySpark) and SQL fluency; tuning Spark jobs at scale.
• Experience with distributed compute and streaming services.
• Ability to partner with product, analytics, and operations to deliver reliable pipelines.
• Security, compliance, and data governance are core concerns.

Responsibilities

• Own the NimbleRx data platform end-to-end from ingestion to access.
• Build batch and streaming pipelines using PySpark/EMR, Kinesis, Lambda, Step Functions.
• Model the warehouse with SCD/event tables and conventions.
• Collaborate with stakeholders to translate data requests into reliable pipelines.
• Lead data security and audit logging; ensure compliance controls.
• Improve backend query performance, including indexing and caching.
• Mentor engineers and analysts on data platform usage.
• Explore AI-assisted tooling to accelerate development.

Skills

Production data pipelines

Python (PySpark)

SQL

Cross-functional collaboration

Data platform ownership

Tools

Java

Spring Boot

Kinesis

Spark/EMR

Iceberg

Trino

PostgreSQL

Terraform

CI/CD

S3

Job description

Swoop is hiring a Senior Data Engineer to own NimbleRx's data platform, shaping how data informs product, analytics, and compliance. You’ll scale pipelines and ensure robust data infrastructure across teams.

You’ll work at the intersection of production and data engineering, building streaming and batch workflows, and mentoring engineers while advancing data security and performance. Join a fast-growing, patient-first tech company.