Staff Software Engineer, Data Platform Migration Lead

Apply; Northern (KY); Hybrid; USD 180,000 - 250,000; Full time

Benefits offered by this job

Health, dental, vision benefits

Remote work stipend

Parental leave 16 weeks

Flexible PTO

401(k) matching

Job summary

Vanta is seeking a Staff Software Engineer to lead the migration of the data layer from Mongo-centric to a schema-aware Postgres-backed architecture. You will coordinate across teams to preserve API contracts while migrating data at scale, with a focus on correctness, consistency, and auditable evidence.

You will mentor engineers, shape streaming infrastructure, and improve reliability across the Foundations stack, leveraging AWS, Kafka, Redis, and Postgres in a distributed environment.

Qualifications

• Proven track record leading platform migrations while maintaining backward compatibility and availability.
• Strong command of streaming and queuing infrastructure (Kafka) including partitioning, redelivery, and idempotency.
• Deep experience in distributed systems and data pipelines at enterprise scale (terabytes, high throughput).
• Fluency in relational and document data modeling at scale (Postgres and MongoDB).
• Experience shaping multi-quarter tech roadmaps with leadership alignment.
• Solid AWS fundamentals and proficiency with TypeScript/Node.js.

Responsibilities

• Lead migration of Vanta's resource data model from Mongo-centric to schema-aware Postgres-backed with parallel generations.
• Drive cross-team solutions requiring platform-wide coordination.
• Design for correctness under eventual consistency with idempotent sessions and out-of-order delivery.
• Evolve data ingestion and pipelines for reliable, high-throughput processing of large data streams.
• Advance the Query API to production with schema versioning, tenant isolation, and stable latency.
• Build auditable data infrastructure for production evidence.

Skills

Platform migrations

Kafka

Postgres

MongoDB

Distributed systems

AWS

TypeScript

Node.js

Data pipelines

Leadership

Tools

Kafka

Postgres

MongoDB

Redis

AWS

Job description

Vanta is seeking a Staff Software Engineer to lead the migration of the data layer from Mongo-centric to a schema-aware Postgres-backed architecture. You will coordinate across teams to preserve API contracts while migrating data at scale, with a focus on correctness, consistency, and auditable evidence.

You will mentor engineers, shape streaming infrastructure, and improve reliability across the Foundations stack, leveraging AWS, Kafka, Redis, and Postgres in a distributed environment.