Staff Backend Engineer, Collection Platform

Vannevar

United States

Remote

USD 160,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health, dental, and vision insurance
Remote friendly with WeWork access
Unlimited PTO and year-end downtime
401(k) match
Salary top-up during military reserve
Fully paid parental leave
Child and pet care reimbursement

Job summary

Vannevar is seeking a hands-on technical leader for the Collection Platform team to design and operate production collection and ingestion systems. You will build web scrapers, data pipelines, and integrations to ensure complete, correct data even with unreliable upstream sources.

You will mentor engineers, Collaborate across product, mission, and platform teams, and shape long-term architectural choices to improve reliability and scalability in national security data systems.

Qualifications

  • 8+ years of backend engineering experience with hands-on work building production collection or ingestion systems.
  • Led the design and delivery of large services or major infrastructure with cross-team impact.
  • Experience improving stability, performance, and data quality across changing datasets.

Responsibilities

  • Shape architecture and technical direction for collection and ingestion systems, planning 6–12 months ahead.
  • Build and operate production web scrapers, third-party integrations, and data pipelines with broad impact.
  • Design for schema changes, rate limits, authentication, partial failures; set schedules based on change frequency and cost.
  • Develop reliable retry, backfill, deduplication, idempotency, and replay mechanisms.
  • Define and monitor data completeness, correctness, freshness, duplication, and provenance.
  • Develop APIs, databases, and shared services for collection workflows to simplify systems.

Skills

Backend engineering
Distributed systems
Data pipelines
Mentorship

Job description

Remote

Vannevar builds AI systems for the Department of War's most consequential missions. We have 125 deployments across every branch and combatant command spanning our core platform and five distinct products. An example of how we work, when major combat operations started with Iran, we fielded a new product supporting 24/7 operations and 9,000+ users in three months.
How we build is our advantage: we deploy forward with the people who own the mission. Our engineers, product team, and CTO deploy forward to the point of friction, including visiting units in Ukraine. We focus on embedding directly with operational units supporting great power competition with China, combat operations with Iran, and counter-narcotics missions.

About the Role

At Vannevar, we build mission software for the national security, defense, and intelligence communities. The Collection Platform team builds the systems that acquire mission-critical data from websites, APIs, feeds, and third-party platforms.

In this role, you’ll be a hands-on technical leader for collection and ingestion systems. You’ll build web scrapers, third-party integrations, and data pipelines that produce complete, correct, and timely data despite unreliable upstream systems. You’ll partner across engineering, product, and mission teams to meet mission needs.

What you’ll do
  • Shape the architecture and technical direction of collection and ingestion systems, looking 6–12 months ahead to identify needs and develop plans to address them.
  • Build and operate production web scrapers, third-party integrations, and data pipelines, delivering major services and infrastructure with impact across the organization.
  • Design for schema changes, rate limits, authentication requirements, and partial failures. Set collection schedules based on source change frequency, user needs, downstream capacity, and cost.
  • Build reliable retry, backfill, deduplication, idempotency, and replay mechanisms.
  • Define and monitor data completeness, correctness, freshness, duplication, and provenance.
  • Develop APIs, databases, and shared services for collection workflows; simplify systems and processes so teams can deliver more with less work.
  • Make sustained improvements to the stability, performance, and scalability of mission-critical collection systems.
  • Partner with mission, product, and platform teams to evaluate sources, prioritize what to collect or repair, and measure whether collected data meets user needs.
  • Guide engineers through design and code reviews, technical mentorship, and clear communication of decisions and standards.
What we’re looking for
  • You have 8+ years of backend engineering experience, including deep, hands-on experience building and operating production collection or ingestion systems—for example, web crawlers, third-party data integrations, ETL pipelines, or change data capture systems.
  • You have led the design and delivery of large services, complex libraries, or major infrastructure, with impact beyond a single team.
  • You have a record of improving the stability, performance, and scalability of business-critical systems and maintaining data quality across large, changing datasets.
  • You have designed systems that tolerate upstream failures and changing external interfaces.
  • You make thoughtful architectural tradeoffs among reliability, scalability, performance, maintainability, and cost.
  • You communicate technical decisions clearly and work well across engineering, product, and mission teams.
  • U.S. Person status is required, as this role requires access to U.S.-only data systems and the ability to obtain a security clearance.
Additional Qualifications
  • Experience with distributed task processing, workflow orchestration, or large-scale data pipelines.
What we offer

The base salary range for this position is $160,000 - $240,000. We hire engineers at multiple levels based on their experience, technical capabilities, and scope of responsibility. This range reflects the base salaries we typically expect to offer for this role, with individual offers determined by the candidate's qualifications and level.

Equity is offered in addition to base salary.

We’re proud to offer competitive benefits that support our employees. Some key highlights of our benefits package include:

  • Health, dental, and vision insurance
  • Remote friendly with WeWork access
  • Unlimited PTO, shared downtime during the federal holiday calendar, and company-wide off time at the end of each year
  • 401(k) match
  • Salary top-up during military reserve duty
  • Fully paid parental leave
  • Child and pet care reimbursement during travel

Vannevar is an equal opportunity employer, and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Vannevar’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Backend Engineer, Collection Platform
Staff Backend Engineer, Collection Platform

Vannevar Labs • United States

Hybrid
USD 160,000 - 240,000
Health insurance
Remote friendly with WeWork access
Unlimited PTO with federal holiday dow
+2
Forward Deployed Engineer (Secret Clearance Required)
Forward Deployed Engineer (Secret Clearance Required)

Vannevar • United States

Remote
USD 160,000 - 240,000
Health, dental, and vision insurance
Remote friendly with WeWork access
Unlimited PTO, downtime during federal
+4
Senior Full-Stack Engineer - Product (TS/SCI Required)
Senior Full-Stack Engineer - Product (TS/SCI Required)

Vannevar • United States

Remote
USD 140,000 - 195,000
Health, dental, vision insurance
Remote friendly with WeWork access
Unlimited PTO and federal holiday dow
Senior Business Operations Manager
Senior Business Operations Manager

Vannevar Labs • United States

Hybrid
USD 185,000 - 230,000
Health insurance
Remote friendly with WeWork access
Unlimited PTO
+4
DevOps Engineer
DevOps Engineer

Vannevar • Washington

Hybrid
USD 140,000 - 190,000
Health insurance
100% remote first culture (US)
Unlimited PTO
+2
Mission Lead - Economic Security (Clearance Required)
Mission Lead - Economic Security (Clearance Required)

Vannevar Labs • Washington

On-site
USD 120,000 - 180,000
Health, dental, and vision insurance
Remote friendly with WeWork access
Unlimited PTO and federal holiday down
+4
Senior Backend Engineer, Collection
Senior Backend Engineer, Collection

vannevarlabs • United States

Hybrid
USD 120,000 - 180,000
Health, dental, and vision insurance
Remote friendly with WeWork access
Unlimited PTO
+5
Product Manager - Digital Forensics (Clearance Required)
Product Manager - Digital Forensics (Clearance Required)

Vannevar • United States

Remote
USD 140,000 - 190,000
Health, dental, and vision insurance
100% remote first culture
Unlimited PTO
+4
Mission Strategist - San Diego (Clearance Required)
Mission Strategist - San Diego (Clearance Required)

Vannevar • San Diego (CA)

On-site
USD 140,000 - 230,000
Health, dental, and vision insurance
Remote friendly with WeWork access
Unlimited PTO and year-end downtime
+4
Senior Software Engineer
Senior Software Engineer

Vannevar Labs • United States

Hybrid
USD 120,000 - 180,000
Health insurance
Remote friendly with WeWork access
Unlimited PTO
+3