Remote Backend Engineer, Data Collection Platform

Vannevar; United States; Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Remote friendly with WeWork access

Unlimited PTO

401(k) match

Wellbeing stipend

Military reserve duty salary top-up

Fully paid parental leave

Child care reimbursement

Pet care reimbursement

Job summary

Vannevar builds mission software for national security and defense, owning web scrapers, data pipelines, and third-party integrations. You will ensure complete, correct, and timely data despite upstream unreliability, partnering with mission teams, product managers, and engineers to balance quality, scale, and cost.

The role emphasizes designing robust data collection systems, monitoring data completeness, and shaping the data platform to support evolving mission requirements across multiple

Qualifications

• 4+ years of backend engineering experience, including production web scraping, data ingestion, ETL, or third-party integrations.
• Proficiency writing production software in Python and familiarity with relational databases and API design.
• Ability to maintain data quality across large, changing datasets.
• Experience designing systems that tolerate upstream failures and changing external interfaces.
• Ability to make thoughtful tradeoffs among reliability, scalability, performance, maintainability, and cost.
• Strong communication of technical decisions across teams.

Responsibilities

• Build and operate production web scrapers, third-party integrations, and data pipelines.
• Design for schema changes, rate limits, authentication, and partial failures.
• Implement reliable retry, backfill, deduplication, idempotency, and replay mechanisms.
• Define and monitor data completeness, correctness, freshness, duplication, and provenance.
• Develop APIs, databases, and shared services for collection workflows.
• Collaborate with mission teams, platform teams, and product managers to evaluate sources and support new data requirements.
• Influence architecture, technology selection, and engineering standards for collection systems.

Skills

Backend engineering

Python

APIs

Relational databases

ETL

Data quality

System design

Clear communication

Tools

PostgreSQL

REST APIs

Git

Job description

Vannevar builds mission software for national security and defense, owning web scrapers, data pipelines, and third-party integrations. You will ensure complete, correct, and timely data despite upstream unreliability, partnering with mission teams, product managers, and engineers to balance quality, scale, and cost.

The role emphasizes designing robust data collection systems, monitoring data completeness, and shaping the data platform to support evolving mission requirements across multiple