Staff Software Engineer: Data Platform Migration Lead

Vanta; San Francisco (CA); Hybrid; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Equity

Remote stipend

Parental leave

Health coverage

Flexible PTO

Office London

Job summary

Vanta is seeking a Staff Software Engineer to lead the re-platforming of the data layer underpinning the compliance product, migrating from Mongo to a schema-aware Postgres-based architecture while preserving every public API contract.

The Foundations data platform ingests vast security and compliance data, handles multi-tenant workloads, and aims for correctness under eventual consistency; you will drive cross-team solutions and mentor others.

Qualifications

• Strong track record leading platform migration initiatives with backward compatibility.
• Deep experience with streaming and queuing (Kafka) and partitioning strategies.
• Distributed systems expertise at enterprise scale (TB-scale ingestion).
• Fluent relational and document data modeling (Postgres and MongoDB).
• Ability to define multi-quarter technical roadmaps with leadership.
• Solid AWS fundamentals; proficient in TypeScript and Node.
• Able to communicate complex tradeoffs to technical and non-technical audiences.
• Willingness to apply AI responsibly to improve efficiency.

Responsibilities

• Lead migration of resource data model from Mongo to schema-aware Postgres while maintaining backward compatibility.
• Drive cross-team solutions that depend on platform built by your team.
• Design for correctness under eventual consistency with idempotent sessions.
• Evolve data ingestion and pipeline architecture for high-throughput terabyte-scale streams.
• Take Query API to production with multi-tenant isolation and predictable latency.
• Build data infrastructure where correctness is auditable by auditors.
• Mentor engineers and set architectural direction for streaming and storage.
• Champion reliability, observability, and operational hygiene across foundations.

Skills

Platform migration

Postgres

MongoDB

Kafka

Data pipelines

TypeScript

Node.js

AWS

Observability

Leadership

Tools

Redis

Postgres

MongoDB

S3

Kafka

Job description

Vanta is seeking a Staff Software Engineer to lead the re-platforming of the data layer underpinning the compliance product, migrating from Mongo to a schema-aware Postgres-based architecture while preserving every public API contract.

The Foundations data platform ingests vast security and compliance data, handles multi-tenant workloads, and aims for correctness under eventual consistency; you will drive cross-team solutions and mentor others.