Remote Software Engineer: Content Pipelines & Data

Agility PR Solutions; United States; Remote; USD 75,000 - 110,000; Full time

Benefits offered by this job

Fully remote work

Health, Dental & Vision benefits

RRSP matching

Life Insurance

Employee Assistance Program (EAP)

Career Development & Progression

Job summary

Agility PR Solutions is seeking a Software Developer (Content Integration & Data Pipelines) to design, build, and scale production-grade pipelines delivering online news and web content across our platform. You will shape how content flows from thousands of sources into search and analytics systems, powering monitoring, insights, and AI-driven features used by PR professionals.

You’ll work on content acquisition and integration, backend and pipeline systems, and contribute to system design,

Qualifications

• Degree in Computer Science or related field or equivalent experience.
• 3+ years of software development experience.
• Proficiency in TypeScript/JavaScript and Java or similar languages.
• Hands-on experience with web scraping and crawling in production environments.

Responsibilities

• Build and maintain scalable web scrapers and crawlers that follow web scraping standards and best practices (robots.txt, rate limiting, polite crawling).
• Develop content integration and parsing logic using TypeScript.
• Design and build event-driven services using Kafka to process, enrich, and route content in near real time.
• Integrate with third-party content providers, feeds (RSS/Atom), and external APIs.
• Design and implement RESTful services (Java) to support content processing and delivery.
• Define and enforce best practices for scraping compliance, pipeline reliability, errors, and data quality.
• Optimize performance, cost, and reliability of pipeline workloads.
• Contribute to architectural decisions and technical direction.
• Mentor junior developers and contribute to team knowledge sharing.

Skills

TypeScript/JavaScript

Java

Web scraping

Kafka

HTML parsing

Data pipelines

Education

Bachelor's degree in Computer Science or related field

Tools

Kafka

Solr

Maven

RSS/Atom feeds

Git

Job description

Agility PR Solutions is seeking a Software Developer (Content Integration & Data Pipelines) to design, build, and scale production-grade pipelines delivering online news and web content across our platform. You will shape how content flows from thousands of sources into search and analytics systems, powering monitoring, insights, and AI-driven features used by PR professionals.

You’ll work on content acquisition and integration, backend and pipeline systems, and contribute to system design,