Senior Data Platform Engineer - Backend & Pipelines

Red Dot Capital Partners; Palo Alto (CA); Hybrid; USD 132,916 - 212,665; Full time

Job summary

Red Dot Capital Partners is seeking a Senior Backend Engineer to join our data platform initiative. You will design core systems powering data ingestion, processing, and serving, and own data pipelines across environments.

You will work with APIs, lakehouse/warehouse tech, cloud platforms, and collaborate with product and R&D teams to ensure scalable, reliable data foundations across the product.

Qualifications

• 6+ years building production backend systems.
• Hands-on Python or similar.
• End-to-end data pipelines: ingestion, processing, serving.
• Data modeling for transactional vs analytical systems.
• Lakehouse and warehouse tech: Iceberg, Athena, Delta Lake, Snowflake/BigQuery/Redshift.
• Postgres and at least one NoSQL DB.
• Spark or Dataflow.
• Airflow or Temporal.
• AWS, GCP, or Azure.
• System design for scale, reliability, data correctness.

Responsibilities

• Design core systems powering the data platform.
• Own architecture of data pipelines across systems.
• Work with APIs, distributed processing, analytics storage.
• Decide data modeling, storage formats, boundaries.
• Build backend services for operational and analytic data.
• Improve reliability, performance, scalability.
• Collaborate with product and R&D on data-driven features.
• Participate in design discussions, mentor others, raise engineering bar.

Skills

Python

Data pipelines

Backend design

Cloud platforms

Databases

Spark

Airflow

System design

Job description

Red Dot Capital Partners is seeking a Senior Backend Engineer to join our data platform initiative. You will design core systems powering data ingestion, processing, and serving, and own data pipelines across environments.

You will work with APIs, lakehouse/warehouse tech, cloud platforms, and collaborate with product and R&D teams to ensure scalable, reliable data foundations across the product.