Staff Data Engineer

Socket.dev; Tempe (AZ); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive compensation

401K match

Parental leave

Career development

Benefits

Job summary

RevolutionParts is seeking a senior data engineer to lead architectural ownership of our data ingestion pipeline for catalog, pricing, and inventory. You will define strategy and standards across data contracts, schema design, and observability, guiding multiple teams toward scalable, reliable systems.

You will mentor engineers, drive multi-quarter initiatives, and push for production-grade tooling with strong data quality and measurable SLAs.

Qualifications

• 10+ years in data or software engineering with 3+ years in staff-level architecture.
• Python and Spark/PySpark at petabyte scale — production systems, not notebooks.
• Designed and operated distributed job execution systems and data pipelines in production.
• Deep experience with production message queues (SQS, Kafka) and data contracts.
• Built observability with monitoring, lineage, and pipeline health from the ground up.
• BS or MS in Computer Science, Engineering, or equivalent.

Responsibilities

• Own the 2-3 year architectural vision for data ingestion and migration.
• Define the reliability bar for data across the organization with monitoring and SLAs.
• Set engineering standards for core data infrastructure: schema design, data contracts, and observability.
• Shape technical strategy across Product, BI, Platform Engineering, and Exec Leadership.
• Mentor Senior Engineers on distributed systems, high-volume data processing, and data modeling at scale.
• Lead migration from legacy batch infrastructure to modern architecture without production impact.

Skills

Data architecture

Python

Spark/PySpark

Distributed systems

AWS

Kubernetes

SQL / Data modeling

Observability

Leadership

Education

BS/MS in Computer Science or related field

Tools

SQS

RDS

EKS

EC2

Snowflake/BigQuery/Databricks

Kafka

Flink

Kinesis

Job description

RevolutionParts is not just a pioneering force in the automotive eCommerce realm; we're actively seeking passionate and talented individuals to join our squad of Revolutionaries (yes, that's what we call ourselves!). As leaders in providing streamlined, user-friendly solutions, we empower automotive brands to maximize online sales. Our commitment to technology, top-notch customer service, and a profound understanding of the automotive market sets us apart. If you're ready to revolutionize the eCommerce space for automotive parts and accessories, consider joining our dynamic team of Revolutionaries.

The Role

Most data engineering roles hand you a Jira board. This one hands you a whiteboard and asks what should be on it.RevolutionParts powers parts and accessories commerce for thousands of automotive dealers and OEMs across North America. The data behind all of it (catalog, pricing, inventory) moves through a high-volume ingestion system that has scaled with the business. It was the right architecture for where we were. It isn’t the right architecture for where we’re going.

Responsibilities

Strategic Leadership & Architectural Ownership

• You are the technical authority for data ingestion at RevolutionParts. You lead through expertise, not authority.
• Own the 2-3 year architectural vision for data ingestion. That means the destination, the migration sequence, the tradeoffs at each stage, and the criteria that determine when the current system has earned its retirement.
• Set the engineering standards that govern how every team builds on and interfaces with core data infrastructure: schema design, data contracts, query optimization, observability. What you establish here becomes the organization’s baseline.
• Shape technical strategy across Product, BI, Platform Engineering, and Executive Leadership. Not as an advisor. As the person who drives alignment, cuts through ambiguity, and owns the outcomes of complex multi-quarter initiatives from discovery through delivery.
• Take ownership of the highest‑severity, most ambiguous problems in the data domain: the ones that cross team boundaries, have no clear owner, and have already resisted resolution.

Execution & Operational Excellence

• Hold ultimate accountability for the architecture and production performance of our catalog, pricing, and inventory ingestion systems, with the technical depth to make decisions no one else in the organization is positioned to make.
• Define the reliability bar for data across the organization. Build the monitoring, alerting, and validation frameworks that turn data quality from a best‑effort into a contractual commitment with clear SLAs and owners.
• Make final, binding technical debt decisions for the ingestion domain, weighing immediate stability against long‑term architectural health. Document the reasoning with enough clarity that it survives organizational change 18 months from now.
• Elevate the technical ceiling of the data engineering organization through direct mentorship of Senior Engineers on distributed systems, high‑volume database performance, and data modeling at scale. Your impact here compounds beyond your own output.

Requirements

10+ years in data or software engineering, at least 3 at Staff level or equivalent owning architectural decisions on high‑volume production systems.

Python and Spark/PySpark at petabyte scale — production systems, not notebooks. You tune Spark from first principles: partition strategy, join optimization, dynamic allocation, skew diagnosis.

• Designed and operated distributed job execution systems: dynamic compute provisioning, variable workload profiles, job isolation, and resource contention at scale.
• Deep experience with message queue architectures in production: fan‑out patterns, poison pill handling, dead letter queues, consumer lag at scale.
• Built observability into systems that had none — monitoring, alerting, lineage, and pipeline health designed in from the ground up, not dashboards bolted on afterward.

Built pipeline orchestration infrastructure, not just DAGs. You have strong opinions about operability because you've inherited systems that weren't.

• You set the engineering quality bar. Reliable, efficient, documented, testable, maintainable — and you hold the team to the same standard.

Led a migration from legacy batch infrastructure (custom schedulers, daemon‑based systems, cron pipelines) to modern architecture without taking down production. We'll go deep on this in the interview.

• Deep AWS in production: EKS, EC2 fleet management, SQS, RDS. Operated at scale, not just deployed into it.
• Kubernetes in production — workload behavior, compute right‑sizing for variable job profiles, failure modes under load.
• Streaming in production: Kafka, Flink, Kinesis, or Redpanda. You've made the batch‑vs‑streaming call in both directions and can defend either.
• Cloud data warehouse architecture — Snowflake, BigQuery, or Databricks. Clustering, partitioning, cost management, mixed analytical and operational workloads.
• You use AI coding tools daily and have shipped production work because of it.
• You write architecture docs engineers trust and can brief a VP on the same decision. Both matter at this level.
• BS or MS in Computer Science, Engineering, or equivalent.

AI Fluency & Modern Tooling

• Using AI tools responsibly to accelerate research, analysis, documentation, and problem-solving
• Exercising strong judgment around data privacy, accuracy, and ethical use
• Continuously learning and adapting as AI capabilities evolve

Proven examples of using AI to improve outcomes in prior roles is expected.

RevolutionParts is proud to provide all full‑time Revolutionaries with a comprehensive employment package including competitive compensation, career development, benefits, 401K match, parental leave, and many more valuable perks. You can learn more about our core‑value driven culture at our career page.

RevolutionParts is an Equal Opportunity Employer; we value diversity. We do not discriminate on the basis of race, religion, color, national origin, gender, gender orientation, gender identity or expression, sexual identity, sexual orientation, age, marital status, family status, genetic information, veteran status, or disability status.

Please Note:

You will only receive correspondence through the GEM ATS or from a @revolutionparts.com email address. If you are receiving communication through any other platform or domain, it may be fraudulent, and we urge you to ignore the communication.