Senior Backend & Data Platform Engineer (Distributed Data)

RedGraphs, Inc.; United States; Remote; USD 29,000 - 62,000; Full time

Benefits offered by this job

Remote work

Job summary

RedGraphs is expanding its senior software engineering team to build reliable backend and distributed data systems for time-aware economic datasets. You will own core services, data processing pipelines, and cloud infrastructure, driving end-to-end delivery from design to production.

The role emphasizes data quality, provenance, and robust, scalable architectures, with collaboration against AI-focused engineers to ensure safe integration of probabilistic outputs into deterministic systems.

Qualifications

• Six+ years of senior software engineering ownership or equivalent scope.
• Proficiency in Python, Java, or Scala with strong backend skills.
• Strong SQL and relational data modeling for backend services and data processing.

Responsibilities

• Design and operate services and pipelines for validation, storage, versioning, analytics, and delivery.
• Build safeguards for data quality, lineage, provenance, and publication control.
• Develop reliable asynchronous workflows using queues, workers, orchestration, retries, checkpoints, timeouts, idempotency, and safe reprocessing.
• Improve query performance, throughput, observability, deployment workflows, and cloud cost efficiency without compromising correctness.
• Ensure compatibility of current workflows with point-in-time reconstruction and safe replays of past data.
• Collaborate with AI engineers to safely integrate probabilistic outputs into production systems.

Skills

Python

Java

Scala

SQL

Asynchronous processing

Distributed systems

Backend services

APIs

Git

Linux

CI/CD

AWS

Tools

Docker

CI/CD tools

Git

Linux

AWS

RDS/PostgreSQL

Athena/Glue/CloudWatch

Job description

RedGraphs is expanding its senior software engineering team to build reliable backend and distributed data systems for time-aware economic datasets. You will own core services, data processing pipelines, and cloud infrastructure, driving end-to-end delivery from design to production.

The role emphasizes data quality, provenance, and robust, scalable architectures, with collaboration against AI-focused engineers to ensure safe integration of probabilistic outputs into deterministic systems.