Technical Lead, Data Platform & Inference (In-Person SF)

Primer; Mission (KS); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Unlimited vacation

Generous parental leave

Professional development support

Annual team offsite

Job summary

A cutting-edge tech startup in Kansas is seeking an experienced data engineering lead to design and scale its data platform. The role involves building reliable, scalable data pipelines from diverse APIs and ensuring high uptime. Candidates should have 6+ years of experience in data systems, expert SQL and Python skills, and a proactive mindset. This position offers competitive benefits and the chance to work in a collaborative environment.

Qualifications

• 6+ years building and scaling production-grade data systems.
• Hands-on experience with Spark/Flink/Kafka.
• Familiarity with columnar databases like DuckDB and Clickhouse.

Responsibilities

• Design and ship scalable batch + streaming pipelines.
• Own reliability and cost of data pipelines.
• Scale integrations with third-party APIs.

Skills

Expert SQL

Strong Python

Distributed data technology experience

Leadership experience in data teams

Concurrency and parallelization understanding

Education

BS/MS in CS/CE/EE or similar

Tools

Kubernetes

Airflow/Dagster/Prefect

dbt

Job description

A cutting-edge tech startup in Kansas is seeking an experienced data engineering lead to design and scale its data platform. The role involves building reliable, scalable data pipelines from diverse APIs and ensuring high uptime. Candidates should have 6+ years of experience in data systems, expert SQL and Python skills, and a proactive mindset. This position offers competitive benefits and the chance to work in a collaborative environment.