Remote Software Engineer - Content Integration & Pipelines

Remote; San Francisco (CA); Remote; USD 54,000 - 79,000; Full time

Benefits offered by this job

Remote work

Health benefits

RRSP matching

Life insurance

EAP

Paid vacation

Week off Christmas–New Year

No meetings Fridays

Career development

Team collaboration

Inclusive workplace

Job summary

Remote is seeking a Software Developer (Content Integration & Data Pipelines) to build production-grade data pipelines that collect, process, enrich, and deliver online news content. You will connect thousands of sources to search, analytics, and AI-powered capabilities using TypeScript, Java, Kafka, and Solr.

The role spans web scraping, content integration, backend services, and event-driven processing to ensure reliable, scalable ingestion while adhering to responsible crawling practices.

Qualifications

• Degree in Computer Science or related field or equivalent practical experience.

Responsibilities

• Build scalable web scrapers and crawlers with responsible crawling practices.
• Develop content integration services for parsing, extraction, and data normalization.
• Design event-driven pipelines using Kafka for near real-time processing.
• Integrate external content sources via RSS, Atom feeds and APIs.
• Develop Java-based RESTful services for content processing and delivery.
• Improve data quality, validation, and fault-tolerant pipeline operations.
• Monitor and optimize pipeline performance and observability.

Skills

TypeScript

JavaScript

Problem solving

Analytical thinking

Content processing

Data pipelines

Distributed systems

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

Kafka

Solr

Java

Maven

Git

Linux

Job description

Remote is seeking a Software Developer (Content Integration & Data Pipelines) to build production-grade data pipelines that collect, process, enrich, and deliver online news content. You will connect thousands of sources to search, analytics, and AI-powered capabilities using TypeScript, Java, Kafka, and Solr.

The role spans web scraping, content integration, backend services, and event-driven processing to ensure reliable, scalable ingestion while adhering to responsible crawling practices.