Senior Data Engineer

Gravie; Oregon; Híbrido; USD 140.000 - 190.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

401(k) plan

Paid parental leave

Flexible PTO

Descripción de la vacante

Gravie is seeking a Senior Data Engineer to own and operate a near real-time streaming data platform on Kafka and Flink. You will drive architecture, production readiness, and latency/throughput targets as part of a hands-on role in a regulated environment.

You will lead end-to-end data pipelines, transform and enrich data with Flink, and ensure secure, governed access to PHI data while maintaining observability and reliable operations.

Formación

• 6+ years in production data systems with ownership of streaming pipelines.
• Hands-on Kafka production experience and replay/backfill under load.
• Experience with Flink or similar stateful stream processor.

Responsabilidades

• Own the streaming platform lifecycle from architecture to production operations.
• Manage latency/throughput SLOs, monitoring, and runbooks (Datadog, CloudWatch).
• Build pipelines transforming CDC events into contract-validated data models.
• Implement event-time processing and exactly-once sinks in Flink/JVM.
• Collaborate on data access controls, PHI governance, and security.

Conocimientos

Streaming platform ownership

Kafka/MSK proficiency

Flink/stateful processing

Java or JVM languages

Python and SQL

REST APIs

Observability and incident response

CI/CD and IaC (CDK/Terraform)

AWS data services

Communication and collaboration

Educación

Bachelor's degree in Computer Science, Information Systems or equivalent

Herramientas

Apache Kafka (MSK)

Apache Flink

AWS CDK / Terraform

Descripción del empleo

Hi, we're Gravie. Our mission is to create health benefits that actually benefit small and midsize businesses and their employees. Our innovative benefit solutions and services are developed and delivered by a diverse group of unique people. We encourage you to be your authentic self - we like you that way.We're building a near real-time streaming data platform on Kafka and Flink that turns operational data from across the business into canonical, contract-validated models, serving both operational applications and agentic workloads. We seek a Senior Data Engineer to build, extend, and operate it, owning the platform in production against its latency and throughput SLOs. This is a hands-on role with meaningful ownership of a live production platform.You are self-driven, calm under production pressure, and comfortable owning streaming systems in a regulated environment.

You Will:

• Share full-lifecycle ownership of the streaming platform - architecture, implementation, production operations.
• Run the platform in production: own latency/throughput SLOs, monitoring and alerting (e.g. Datadog) - including replays, per-source backfills, connector-failure recovery, Flink checkpoint/savepoint recovery, dead-letter triage, and tuning for spiky load from batch-driven upstream sources.
• Build and extend streaming pipelines that ingest CDC events from OLTP databases and SaaS sources into canonical, contract-validated form, and define standards to govern changes to them over time.
• Transform and enrich in Apache Flink, including stateful processing and cross-stream joins that correlate events into unified lifecycle entities, with event-time handling for late and out-of-order data.
• Enable secure, governed data access over PHI: classification and row/column controls applied as data is served to consumers, in partnership with Security and Compliance.
• Make it reliable and observable: idempotent/replayable pipeline design, data-quality validation, runbooks, and observability the broader data team can rely on.
• Provision as code: define the platform (streaming, processing, storage, and catalog services on AWS) in CDK with CI/CD for data pipelines, and right-size for cost against the latency SLO.
• Partner across teams: work with upstream producers on source changes and contracts, with downstream consumers on access and data needs, and with stakeholders to turn requirements into what the platform delivers.
• Demonstrate commitment to our core competencies of being authentic, curious, creative, empathetic and outcome oriented.

You Bring:

• 6+ years building and operating production data systems , including demonstrated ownership of streaming or event-driven pipelines - on-call, incident response, SLOs, runbooks, and recovery, not just development.
• Deep, production experience with Apache Kafka (MSK preferred) - partitioning, consumer groups, idempotent semantics, Kafka Connect, and replay/backfill under load.
• Strong, hands-on production experience with Apache Flink or a comparable stateful stream processor, in Java or another JVM language - state management, checkpointing, watermarks, and exactly-once sinks.
• AWS-native data engineering across streaming, processing, storage, and catalog services (e.g. MSK, EMR, Glue, S3, Athena), with infrastructure-as-code - AWS CDK (preferred) or Terraform - CI/CD for data pipelines, and cost awareness.
• Comfort debugging distributed data pipelines (consumer lag, data skew, backpressure, checkpoint failures, late/out-of-order events) with observability tooling (e.g. Datadog/CloudWatch).
• SQL and Python , and experience building and consuming REST APIs.
• An AI-forward engineering mindset , with demonstrated hands-on use of AI-assisted and agentic development tools, an opinion on where AI adds value (and where it doesn't), and an understanding of agentic data consumption patterns of trusted operational data - including context management, lineage, provenance, permissions, freshness.
• Change data capture and open table formats - CDC (e.g. Debezium) plus Iceberg or Delta Lake: schema evolution, partitioning, and table maintenance.
• Data contracts and schema governance - schema registries and technical metastore (e.g. Glue Data Catalog, Unity Catalog), compatibility rules, Avro or Protobuf, and dead-letter handling.
• Degree in Computer Science, Information Systems or another quantitative field, and comfort on the command line / a Unix-based OS (we are 100% Mac+Linux at Gravie).
• Excellent communication skills and demonstrated success in driving results through influence and collaboration.

Extra Credit:

• Health insurance domain knowledge, including HIPAA Protected Health Information (PHI) and compliance frameworks governing it.
• Familiarity with serving data to AI and agentic consumers - exposing canonical data as low-latency context or inputs for automated/agentic workloads.
• Experience with a governance & data discovery catalog (e.g. Atlan, Alation, Collibra).
• Previous venture-backed start-up company experience.

A Little More About Us:

• We know healthcare. Our company was founded and is still led by industry veterans who have started and grown several market-leading companies in the space.
• We have raised money from top tier investors who share the same long-term vision as we do of building an industry defining company that will endure over the long run. We are well capitalized.
• Our clients love us. Customer satisfaction rates among employees using Gravie health plans consistently rank above 80% - nearly 40 points above the industry average.
• Our culture is unique. We tend to be non-hierarchical, merit-driven, opinionated but kind people who thrive working in a high-performance, fast-paced environment. People at Gravie care deeply about making a positive impact in the lives of the people we serve.

Benefits

• Our unique benefits program is the gravy, i.e., the special sauce that sets our compensation package apart. In addition to standard health and wellness benefits, Gravie's package includes alternative medicine coverage, flexible PTO, up to 16 weeks paid parental leave, paid holidays, a 401k program, transportation perks, education reimbursement, and 2 days of paid paw-ternity leave.

Job Applicants

If you apply for employment with Gravie, personal information collected via our applicant tracking vendor is subject to our standalone California Job Applicant Notice at Collection, accessible directly within the application workflow and separate from this Policy.