Remote Data Engineer: Real-Time Ingestion & Pricing

Alt Platform Inc; New York (NY); On-site; USD 155,000 - 165,000; Full time

Benefits offered by this job

Medical, dental, vision coverage

HSA/FSA available

Generous PTO

Parental leave

Wellness stipend

Home office stipend

DoorDash Pass

Remote-first with WeWork access

401(k)

Alt Equity

Job summary

Alt Platform Inc. is seeking a data engineer to own end-to-end ingestion pipelines that pull transaction and listing data from major sources, enabling real-time pricing at scale.

You will design reusable components, monitor latency and coverage, and drive cost efficiency while collaborating with pricing, ML, and analytics teams. The role requires 3–4 years in data engineering, strong Python and SQL, and hands-on orchestration with Airflow or Dagster.

Qualifications

• 3-4 years in data engineering or a closely adjacent seat.
• Modern web scraping at scale — Playwright or comparable, plus the ability to impersonate a real browser at the network layer (TLS/request fingerprinting) when a plain HTTP client gets flagged.
• Python proficiency: 3+ years hands-on, strong SQL for analysis and transformation.
• Owned an end-to-end pipeline in the past two years, not just contributed to.
• Judgment on generalize vs bespoke — avoid one-size-fits-all infra.
• Orchestrated data flows with Airflow, Dagster, or similar DAG system.
• Cloud development experience (AWS, GCP).
• LLM-based extraction and processing at scale, not only UI Q&A.
• Startup experience and adaptability to changing roadmaps.
• Pragmatic bias: deliver incrementally over perfect rebuild.
• Bonus: large-scale dataframe processing (Pandas, Polars, PySpark) and interest in collectibles market.

Responsibilities

• Own ingestion pipelines that scrape, normalize, and land transaction and listing data for pricing model.
• Build reusable ingestion stack with auth, retries, session and proxy management, monitoring.
• Develop monitoring/alerts for latency, uptime, and coverage across sources.
• Modernize storage/processing to reduce manual steps and improve cost & reliability.
• Collaborate with pricing, ML, product, and analytics to ensure clean downstream data.

Skills

Data engineering

Web scraping at scale

Python

End-to-end pipelines

Generalization vs bespoke

Orchestration (Airflow/Dagster)

Cloud (AWS/GCP)

LLM-based extraction

Startup experience

Incremental delivery bias

Tools

Airflow

Job description

Alt Platform Inc. is seeking a data engineer to own end-to-end ingestion pipelines that pull transaction and listing data from major sources, enabling real-time pricing at scale.

You will design reusable components, monitor latency and coverage, and drive cost efficiency while collaborating with pricing, ML, and analytics teams. The role requires 3–4 years in data engineering, strong Python and SQL, and hands-on orchestration with Airflow or Dagster.