Senior Data Engineer- Data Platform

vida; United States; Remote; USD 160,000 - 170,000; Full time

Benefits offered by this job

Remote-eligible role

US-based role (visa not sponsor)

Job summary

vida seeks a senior data platform engineer to own end-to-end production data systems—from ingestion through delivery—shaping architecture, pipelines, and downstream tooling.

You will design robust batch and asynchronous pipelines, ensure data correctness, and collaborate with product, analytics, and operations to meet evolving requirements.

Remote-eligible in the United States; compensation range is $160,000–$170,000 per year.

Qualifications

• Bachelor's degree and 5+ years building production data systems.
• Strong SQL and data modeling fundamentals, including grain, keys, history, dimensional modeling.
• Experience designing and operating batch and asynchronous pipelines, with understanding of failure modes in distributed systems.
• Experience with a cloud data platform and knowledge of storage, query performance, and cost tradeoffs.
• Strong data correctness instincts, including validation, idempotency, late-arriving records, schema evolution, backfills, and reprocessing.
• Proficiency in Python for pipelines, services, tooling, and tests, with careful production deployment practices.
• Clear written communication, including documenting technical decisions for non-engineering audiences.

Responsibilities

• Own production data systems and domains end-to-end from ingestion to delivery.
• Design ingestion patterns that tolerate incomplete, duplicated, delayed, malformed, or evolving upstream data.
• Define and maintain contracts between source systems, ingestion, transformation, and analytics consumers.
• Model data with clear grain, keys, history, and definitions to keep metrics consistent.
• Evolve schemas, pipelines, and datasets safely with retries, backfills, and replay strategies.
• Improve pipeline performance, observability, and failure handling, collaborating with engineering, product, operations, and analytics.

Skills

SQL

Data modeling

Batch pipelines

Asynchronous pipelines

Python

Education

Bachelor's degree

Job description

Role overview

A senior-level position on the data platform team, owning the systems that move, validate, and serve business-critical data end to end. The work spans ingestion through transformation and delivery, with influence over architecture, operational practices, and downstream tooling. It suits an engineer who enjoys designing robust pipelines for messy real-world data and partnering with product, analytics, and operations counterparts.

Responsibilities

• Own production data systems and assigned domains from ingestion through delivery, including storage, transformation, and downstream consumption.
• Design ingestion patterns that tolerate incomplete, duplicated, delayed, malformed, or evolving upstream data.
• Define and maintain the contracts between source systems, ingestion layers, transformation logic, and analytics consumers.
• Model data with clear grain, keys, history, and definitions so that shared metrics remain consistent.
• Evolve schemas, pipelines, and datasets safely, using retries, backfills, and replay strategies that avoid corrupting existing data.
• Improve pipeline performance, observability, and failure handling, and partner with Engineering, Product, Operations, and Analytics when requirements are incomplete or evolving.

Requirements

• Bachelor's degree at a minimum and 5+ years of experience building production data systems.
• Strong SQL and data modeling fundamentals, including grain, keys, history, dimensional modeling, and awareness of how modeling decisions influence interpretation.
• Hands-on experience designing and operating batch and asynchronous pipelines, including an understanding of failure modes in distributed systems.
• Experience with a cloud data platform and working knowledge of storage, query performance, and cost tradeoffs.
• Strong instincts around data correctness, including validation, idempotency, late-arriving records, schema evolution, backfills, and reprocessing.
• Working proficiency in Python for pipelines, services, tooling, and tests, plus the judgment to ship changes to production in ordered, reversible steps.
• Clear written communication, including documenting technical decisions and explaining changes to non-engineering audiences.

Nice to have

• Prior healthcare or regulated-industry data experience is not required.
• Familiarity with the full technology stack used by the team is not expected.

Benefits and work setup

• Remote-eligible role; must be based in and authorized to work in the United States, as visa sponsorship is not available.
• Listed compensation range of $160,000 to $170,000 per year.
• Commitment to equal opportunity employment and reasonable accommodations for candidates with disabilities.