Senior Integration Engineer: Real-Time Data Pipelines

Remote Jobs; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Visa sponsorship

Job summary

Remote Jobs in New York, NY is seeking an experienced Data Integrations Engineer to own the platform’s integration layer, connecting the AI decision engine to ERPs, data warehouses, and other data sources. You’ll ensure reliable, scalable data flows and end‑to‑end ownership.

You will collaborate with CP operators and IT teams, ship robust connectors, and evolve the layer to make adding new sources a configuration task rather than a rebuild.

Qualifications

• 3+ years producing data pipelines and integrations in Python.
• Experience integrating third‑party systems via REST, SOAP, and API calls with OAuth, rate limits, and pagination.
• Proficiency with Python backend stack: FastAPI, SQLAlchemy, and Pydantic.
• Advanced SQL skills including high‑volume upserts and complex queries.
• Designing idempotent, re‑runnable pipelines with fetch/validate/normalize/upsert patterns.
• Experience building safe write paths with auditability and failure capture.

Responsibilities

• Build, extend, and maintain integrations across ERP systems, data warehouses, object storage, and custom data sources.
• Design near‑realtime syncs handling millions of records per customer with minimal manual intervention.
• Deeply investigate external APIs and build resilient connectors.
• Write end‑to‑end integration tests protecting read/update/write lifecycles.

Skills

Python

FastAPI

SQLAlchemy

Pydantic

REST

OAuth

Data pipelines

SQL

Tools

Temporal

Hatchet

Snowflake

BigQuery

Databricks

Job description

Remote Jobs in New York, NY is seeking an experienced Data Integrations Engineer to own the platform’s integration layer, connecting the AI decision engine to ERPs, data warehouses, and other data sources. You’ll ensure reliable, scalable data flows and end‑to‑end ownership.

You will collaborate with CP operators and IT teams, ship robust connectors, and evolve the layer to make adding new sources a configuration task rather than a rebuild.