Sr Software Engineer - Data Platform

Scion Staffing, Inc.; San Francisco (CA); Remote; USD 190,000 - 240,000; Full time

Benefits offered by this job

Competitive compensation

Remote, full-time

Greenfield data platform

Autonomy and visibility

Job summary

Scion Staffing, Inc. is seeking a Senior Data Platform Engineer for a fast-growing tech company delivering AI-powered solutions. This fully remote role requires US residency and PST hours.

The engineer will design a scalable data platform from the ground up and transform sensor/telemetry data into reliable datasets for ML teams. The role calls for autonomy and collaboration to tackle ambiguous challenges and deliver high-impact systems in a growing environment.

Qualifications

• 5+ years in data engineering or data platform roles.
• Architect and deploy high-throughput data pipelines.
• Strong cloud experience, AWS preferred.
• Ownership of datasets as products with lineage and quality monitoring.

Responsibilities

• Architect and deploy high-throughput cloud data pipelines that process large volumes of sensor, telemetry, and other complex data.
• Build post-processing workflows that align, resample, calibrate, and restructure multi-source data for machine-learning applications.
• Develop scalable backfill and reprocessing frameworks for updated filters, synchronization, labeling corrections, and metadata enrichment.
• Establish dataset lineage, versioning, documentation, quality monitoring, and reproducibility standards.
• Create dataset discovery and access APIs/SDKs for searches by time, region, modality, labels, and quality.
• Optimize data storage and build tools for ML teams.

Skills

Python

Go

Rust

TypeScript

AWS

Data pipelines

PyArrow

Polars

Pandas

NumPy

Tools

Airflow

Prefect

MLflow

Weights & Biases

Job description

POSITION OVERVIEW

Scion Staffing has been engaged to conduct a search for a Senior Data Platform Engineer for an innovative, rapidly growing technology company developing AI-powered systems that transform complex real-world data into actionable insights. This is a full-time, remote position working PST hours. Must be located in the United States. The Senior Data Platform Engineer will serve as an early member of the data engineering team, designing a scalable data platform from the ground up. This individual will transform complex sensor and telemetry data into reliable, well-documented datasets used by machine-learning and perception teams. The position is ideal for an autonomous, collaborative engineer who enjoys solving ambiguous technical challenges and building high-impact systems in a growing environment.

PERKS

• Competitive compensation and a comprehensive benefits package with a long-term equity incentive program
• Fully remote, full-time position
• Opportunity to architect and influence a greenfield data platform
• Highly collaborative environment with significant autonomy and visibility

RESPONSIBILITIES

• Architect and deploy high-throughput cloud data pipelines that process large volumes of sensor, telemetry, and other complex data.
• Build post-processing workflows that align, resample, calibrate, and restructure multi-source data for machine-learning applications.
• Develop scalable backfill and reprocessing frameworks for updated filters, synchronization, labeling corrections, and metadata enrichment.
• Establish dataset lineage, versioning, documentation, quality monitoring, and reproducibility standards.
• Create dataset discovery and access APIs or SDKs that support searches by factors such as time, region, modality, labels, and quality indicators.
• Optimize data storage and build supporting tools, potentially including labeling and pre-labeling workflows, for machine-learning teams.

QUALIFICATIONS

• At least 5 years of professional data engineering, software engineering, or data platform experience, with startup, early-stage, or greenfield platform-building experience strongly preferred.
• Demonstrated ability to independently architect and deploy high-throughput data pipelines from the ground up.
• Strong Python skills and experience with tools such as PyArrow, Polars, Pandas, NumPy, or SciPy.
• Experience developing production services with Go, Rust, TypeScript, or a comparable programming language.
• Strong cloud infrastructure experience, preferably with AWS, including deploying and operating production data pipelines.
• Experience owning datasets as products, including lineage, versioning, reproducibility, documentation, backfills, reprocessing, storage optimization, and data-quality monitoring.
• Experience with relevant technologies or data domains such as Airflow, Prefect, MLflow, W&B, labeling workflows, edge or multi-source data, time synchronization, or geospatial data.

COMPENSATION AND BENEFITS

This full-time opportunity offers competitive base up to $240k/yr (DOE) plus equity (long-term equity incentive program), and 401k and flexible PTO / Holidays / Sick Time.

Scion Staffing, Inc. is an equal opportunity employer and service provider and does not discriminate based on race, religion, gender, gender identity, national origin, citizenship status, sexual orientation, disability, political affiliation or belief, or any other protected class. We are committed to the principles of Equal Opportunity Employment and are dedicated to making employment decisions based on merit and value, for ourselves, our client companies, and the candidates we represent. For opportunities located in a region that have enacted fair chance, arrest or conviction-based employment ordinances, Scion Staffing proactively follows the enacted guidance and considers for employment all qualified applications with arrest and conviction records. We engage in socially conscious business practices and believe that diverse, inclusive, and non-biased talent and recruitment processes are foundational to the success of Scion as well as every client organization with whom we partner.