Data Flywheel Engineer: Equity & Scalable Eval Pipelines

Pantera Capital; San Francisco (CA); Hybrid; USD 210,000 - 385,000; Full time

Job summary

A leading technology investment firm in San Francisco is seeking an experienced Data Engineer to build systems that enable various teams to access data efficiently. The candidate should have over 3 years of experience in software engineering, strong skills in Python and SQL, and familiarity with big data systems and AWS. The position offers a compensation range of $210K to $385K based on skills and experience, along with a hybrid work model and a comprehensive benefits package.

Qualifications

• 3+ years of software engineering experience shipping production systems.
• Strong proficiency in Python and SQL with production-grade code writing skills.
• Experience with big data systems including distributed compute and storage.

Responsibilities

• Build systems and pipelines enabling independent access to eval verdicts.
• Own the 'evals-to-product' loop for turning signals into datasets.
• Build a robust simulator pipeline for user interaction replay.
• Implement monitoring and quality checks to maintain data trust.
• Shape how the company measures and improves Answer Quality.

Skills

Python

SQL

Big Data Systems

Data Modeling

System Design

Debugging distributed systems

AWS

Databricks

AI-assisted development tools

Job description

A leading technology investment firm in San Francisco is seeking an experienced Data Engineer to build systems that enable various teams to access data efficiently. The candidate should have over 3 years of experience in software engineering, strong skills in Python and SQL, and familiarity with big data systems and AWS. The position offers a compensation range of $210K to $385K based on skills and experience, along with a hybrid work model and a comprehensive benefits package.