Senior Data Engineer — Real-Time Streaming in Production

Gravie; United States; Remote; USD 130,000 - 175,000; Full time

Benefits offered by this job

Alternative medicine coverage

Flexible PTO

16 weeks parental leave

Paid holidays

401k program

Transportation perks

Education reimbursement

Paw-ternity leave

Job summary

Gravie is hiring a Senior Data Engineer to own a near real-time streaming platform for operational data. You will build, extend and operate pipelines ingesting CDC events, transform with Spark, and enforce PHI governance. This is a hands-on role requiring production ownership and collaboration across teams.

You will manage latency SLOs, implement observability, and drive cost-aware infrastructure as code on AWS. Strong SQL/Python and on-call experience are essential for success at Gravie.

Qualifications

• 6+ years building and operating production data systems.
• Production experience with Kafka including exactly-once semantics.
• Strong PySpark experience for streaming and batch transformation.
• AWS-native data engineering across streaming, processing, storage, and catalog services.
• Infrastructure-as-code with AWS CDK or Terraform and CI/CD for data pipelines.
• Excellent SQL and Python skills.
• Experience with data contracts, schema governance, and cataloging.
• Health data/PHI domain knowledge is a plus.

Responsibilities

• Run the platform in production, owning latency/throughput SLOs and monitoring.
• Build and extend streaming pipelines ingesting CDC events.
• Transform and enrich data using Spark and related tools.
• Enable secure, governed data access over PHI.
• Ensure reliability with idempotent, replayable pipelines and runbooks.
• Provide code-defined platform in AWS with CDK and cost-conscious sizing.
• Collaborate with upstream/downstream teams to meet data needs.

Skills

Kafka

Spark (PySpark)

SQL

Python

AWS CDK

REST APIs

Datadog / CloudWatch

Data governance

On-call / incident response

Education

Degree in CS/IS or quantitative field

Tools

MSK

EMR

Glue

S3

Athena

Debezium

Iceberg

Delta Lake

Schema Registry

Glue Data Catalog

Unity Catalog

Atlan

Alation

Collibra

Datadog

CloudWatch

Job description

Gravie is hiring a Senior Data Engineer to own a near real-time streaming platform for operational data. You will build, extend and operate pipelines ingesting CDC events, transform with Spark, and enforce PHI governance. This is a hands-on role requiring production ownership and collaboration across teams.

You will manage latency SLOs, implement observability, and drive cost-aware infrastructure as code on AWS. Strong SQL/Python and on-call experience are essential for success at Gravie.