Ingestion Engineer →

NewsMesh; Northern (KY); Hybrid; USD 165,000 - 220,000; Full time

Benefits offered by this job

Remote across the US

Real ownership: ship work customers依赖

Small, senior team with high standards

Job summary

NewsMesh is seeking a backend engineer to own the ingestion pipeline from fetch to stored records. You will ensure high-volume, reliable data processing, deduplication, and accurate enrichment for real-time access via API.

The role emphasizes Python/SQL proficiency, Celery/RabbitMQ experience, and a bias for correctness. Remote work across the United States is supported, with a senior, low-process team driving quality.

Qualifications

• Strong backend engineering and fluency in Python and SQL.
• Experience with high-volume ETL, queues, or distributed workers.
• Bias for correctness and measuring before trusting results.
• Ability to own a system end to end from fetch to stored record.
• Experience with RSS, crawling, or document parsing at scale.
• Familiarity with Celery, RabbitMQ or similar task queues.
• History of identifying gnarly data-quality bugs.

Responsibilities

• Own and improve the Celery-based ingestion pipeline across thousands of changing sources.
• Keep articles fresh, deduplicated, and correct as source count grows.
• Harden fetching against blocks, rate limits, and feeds that quietly change shape.
• Build the monitoring that catches a broken source in minutes, not days.
• Own reliability: this pipeline runs continuously and customers notice when it stops.

Skills

Backend engineering

Python

SQL

ETL

Distributed workers

Data quality

Crawling

Document parsing

RSS

Bug hunting

Tools

Celery

RabbitMQ

Task queues

Job description

NewsMesh ingests thousands of feeds continuously and turns them into clean, structured articles that customers query in real time. You would own that pipeline end to end: the fetchers, the proxy layer, the dedup, and the observability that tells us the moment a source breaks or drifts. It is unglamorous, high-leverage work, and everything else we sell is built on it.

About NewsMesh

NewsMesh turns the world's news into clean, structured, real-time data. We ingest thousands of sources continuously, enrich every article with category, topics, people, and country relevance, and serve it through an API used by developers and, increasingly, by AI agents that discover and pay for it on their own. We are a small, senior team, and the work is measured by one thing: whether the data is right, current, and easy to use.

What you'll do

• Own and improve the Celery-based ingestion pipeline across thousands of changing sources
• Keep articles fresh, deduplicated, and correct as source count grows
• Harden fetching against blocks, rate limits, and feeds that quietly change shape
• Build the monitoring that catches a broken source in minutes, not days
• Own reliability: this pipeline runs continuously and customers notice when it stops

What we look for

• Strong backend engineering, fluent in Python and SQL
• Experience with high-volume ETL, queues, or distributed workers
• A real bias for correctness, and the instinct to measure before trusting
• Comfortable owning a system end to end, from fetch to stored record
• Worked with RSS, crawling, or document parsing at scale
• Experience with Celery, RabbitMQ, or similar task queues
• A history of hunting down the gnarly, intermittent data-quality bug

Compensation

Depending on experience, the expected pay range is $165K–$220K.

What we offer

• Competitive pay, in the range listed above
• Remote across the US
• Real ownership: you will ship work customers depend on
• A small, senior team with high standards and little process

How we hire

We read every application. If there is a fit, expect a short intro call, a practical exercise rooted in the kind of work you would actually do, and a few conversations with the people you would work with. A link to something you have built beats a resume.