Remote Backend Engineer - Data Collection Platform

InvestedintheMission; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Remote friendly with WeWork access

Unlimited PTO

401(k) match

Wellbeing stipends

Parental leave

Travel reimbursements

Job summary

Vannevar is building mission software for the national security, defense, and intelligence communities. The Collection Platform team builds the systems that acquire mission-critical data from websites, APIs, feeds, and third-party platforms.

In this role, you’ll own web scrapers, third-party integrations, and data pipelines that deliver complete, correct, and timely data despite unreliable upstream systems.

Qualifications

• 4+ years of backend engineering experience including production web scraping, data ingestion, ETL, or third-party integrations.
• Proficient in Python and familiar with relational databases and API design.
• Experience maintaining data quality across large, changing datasets.
• Designs systems tolerant to upstream failures and changing external interfaces.
• Ability to balance reliability, scalability, performance, maintainability, and cost.

Responsibilities

• Build and operate production web scrapers, third-party integrations, and data pipelines.
• Design for schema changes, rate limits, authentication, and partial failures.
• Implement retry, backfill, deduplication, idempotency, and replay mechanisms.
• Define and monitor data completeness, correctness, freshness, duplication, and provenance.
• Develop APIs, databases, and shared services for collection workflows.
• Collaborate with mission teams, platform teams, and product managers to evaluate sources and support new data requirements.
• Influence architecture, technology selection, and engineering standards for collection systems.

Skills

Backend engineering

Python

Relational databases

API design

Data quality

System resilience

Tools

PostgreSQL

Job description

Vannevar is building mission software for the national security, defense, and intelligence communities. The Collection Platform team builds the systems that acquire mission-critical data from websites, APIs, feeds, and third-party platforms.

In this role, you’ll own web scrapers, third-party integrations, and data pipelines that deliver complete, correct, and timely data despite unreliable upstream systems.