Senior Data Platform Engineer (Hybrid) – Scale Data Ops

DataJobs; Redwood City (CA); Hybrid; USD 205,000 - 240,000; Full time

Job summary

MyHealthTeam is seeking a Senior Data Engineer in a hybrid role based in Redwood City, CA. You will own the data platform end-to-end, building and operating ingestion, transformation, storage, and access while guiding the platform roadmap to support product, analytics, and operations teams.

You will design batch and streaming pipelines, model the warehouse, and ensure security, compliance, and scalable data operations. Collaboration across teams and mentoring others are key aspects of the role.

Qualifications

• 5+ years of production data pipelines and platforms experience.
• Strong Python (PySpark) and SQL skills with Spark tuning.
• Experience with Java and Spring Boot services.
• Hands-on with Spark/EMR, Kinesis, and S3.
• Postgres performance and indexing expertise.
• Experience with Iceberg and Trino.
• Familiar with CI/CD and Terraform.
• Experience using AI to accelerate pipelines.

Responsibilities

• Own the data platform end-to-end and its roadmap.
• Build and evolve batch and streaming pipelines.
• Model the warehouse with SCD and event tables.
• Collaborate with cross-functional teams and provide self-serve tooling.
• Ensure security and compliance with audit logging and access controls.
• Optimize backend query performance and IO instrumentation.
• Lead incident remediation for data infra issues.
• Mentor engineers and analysts.
• Use AI tooling to accelerate pipelines.

Skills

Python (PySpark)

SQL

Distributed computing

AI tooling

Tools

EMR

Kinesis

Lambda

Step Functions

Postgres

Salesforce

Iceberg

Trino

S3

Java

Spring Boot

CI/CD

Terraform

Job description

MyHealthTeam is seeking a Senior Data Engineer in a hybrid role based in Redwood City, CA. You will own the data platform end-to-end, building and operating ingestion, transformation, storage, and access while guiding the platform roadmap to support product, analytics, and operations teams.

You will design batch and streaming pipelines, model the warehouse, and ensure security, compliance, and scalable data operations. Collaboration across teams and mentoring others are key aspects of the role.