Senior Backend Engineer: Data Pipelines & Scrapers (NYC)

Midpage; New York (NY); On-site; USD 90,000 - 130,000; Full time

Job summary

Midpage is seeking a technical generalist to join our in-person team in SoHo, NYC. The ideal candidate will build data pipelines, ensure system accuracy, and optimize core utilities that extract and resolve citations.

Proficiency in Python and SQL is required, while experience with technologies like PostgreSQL and ElasticSearch is highly valued. We offer competitive salaries and benefits.

Qualifications

• Technical generalist comfortable working with backend systems.
• Experience with data pipelines and basic to intermediate infra/devops.

Responsibilities

• Build pipelines augmenting documents with metadata.
• Ensure reliability and accuracy of web scrapers.
• Optimize core utilities for extracting and resolving citations.
• Expose core services on data via APIs and websockets.
• Benchmark and evaluate core tasks.

Skills

Python

PostgreSQL

ElasticSearch

Playwright

GCP

Pinecone

Prefect

NeonDB

Job description

Midpage is seeking a technical generalist to join our in-person team in SoHo, NYC. The ideal candidate will build data pipelines, ensure system accuracy, and optimize core utilities that extract and resolve citations.

Proficiency in Python and SQL is required, while experience with technologies like PostgreSQL and ElasticSearch is highly valued. We offer competitive salaries and benefits.