Data Engineer, Basketball Data Systems — In-Game & Cloud

Socket.dev; El Segundo (CA); On-site; USD 120,000 - 130,000; Full time

Job summary

Socket.dev in El Segundo, CA is seeking a Data Engineer for Basketball Data Strategy to build, maintain, and operate cloud data pipelines spanning ingestion, transformation, storage, and serving layers for web and mobile products.

You will work with senior engineers to ensure data quality, implement bronze/silver/gold datasets, run backfills, and support in-game data delivery while growing toward platform ownership.

Qualifications

• 2 to 4 years of experience in a data engineering or a similar role.
• Strong SQL and relational DB design; familiarity with nonrelational stores is a plus.
• Experience building cloud data pipelines in AWS; orchestration with Airflow or Prefect.
• Proficiency in Python and Spark (PySpark) for data transformation.
• Exposure to columnar formats (Parquet, Iceberg) and near real‑time data processing.

Responsibilities

• Build and maintain bronze, silver, and gold data pipelines from multiple sources.
• Deliver the serving layer and data marts in PostgreSQL for web and mobile apps.
• Run idempotent backfills and routine reprocessing to ensure data freshness.
• Support live and in-game data flows with near‑real‑time processing patterns.
• Maintain lakehouse with partitioning, compaction, and file management for performance.
• Implement data quality controls and automated validation across pipelines.
• Contribute to the data catalog and lineage documentation.
• Onboard new reference and entity data sources and assist data ingestion.

Skills

SQL

Python

PySpark

Airflow

PostgreSQL

Data Pipelines

Education

Bachelor's degree in Statistics/CS/Engineering or equivalent

Tools

PostgreSQL

Airflow

Prefect

Spark

Docker

Job description

Socket.dev in El Segundo, CA is seeking a Data Engineer for Basketball Data Strategy to build, maintain, and operate cloud data pipelines spanning ingestion, transformation, storage, and serving layers for web and mobile products.

You will work with senior engineers to ensure data quality, implement bronze/silver/gold datasets, run backfills, and support in-game data delivery while growing toward platform ownership.