Senior Software Engineer, AI Data Infrastructure

Apply; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Equity in a fast-growing company

401(k) match

Parental leave

Medical, dental, and vision

Wellness stipend

Learning stipend

Office in SF

Job summary

Handshake is hiring a Senior Software Engineer for the Coding Pod in San Francisco. You will lead the design and development of data infrastructure powering frontier AI coding models, building large-scale datasets, evaluation frameworks, and execution environments.

You will own end-to-end platform investments, partner with ML researchers, and translate research goals into production-ready systems that enhance model development and evaluation quality.

Qualifications

• 6+ years of professional software engineering experience building backend systems or distributed platforms.
• Strong programming skills in Python, TypeScript, Java, or similar languages.
• Experience designing and operating large-scale data pipelines, distributed systems, or workflow orchestration platforms.
• Strong system design skills focusing on scalability, reliability, observability, and maintainability.
• Experience building cloud-native systems using AWS, GCP, or similar cloud platforms.
• Familiarity with containerized execution environments (Docker, Kubernetes) and distributed job processing.
• Strong understanding of relational and/or NoSQL databases, data modeling, and storage systems.
• Ability to translate evolving research or product requirements into scalable engineering solutions.
• Excellent communication and collaboration with researchers, product managers, and cross-functional teams.
• Experience mentoring engineers and leading technical projects from design through production.

Responsibilities

• Architect and build scalable data infrastructure for large-scale coding datasets and evaluation pipelines.
• Design end-to-end evaluation systems including automated grading, benchmarking, and quality assurance workflows.
• Guide developer-facing tooling and integrations with engineering ecosystems (GitHub, CI/CD, code execution environments).
• Build backend services and APIs supporting dataset generation and experiment infrastructure.
• Drive architectural decisions around distributed systems, orchestration, and data quality.
• Collaborate with ML researchers to translate evaluation methodologies into scalable systems.
• Improve platform reliability, observability, and performance through monitoring and debugging.
• Mentor engineers through design reviews and code reviews to raise engineering standards.
• Standardize reusable infrastructure and frameworks to accelerate future model development.

Skills

Python

TypeScript

Java

Distributed systems

Tools

Docker

Kubernetes

GitHub APIs

Airflow

Temporal

Dagster

Job description

Handshake is hiring a Senior Software Engineer for the Coding Pod in San Francisco. You will lead the design and development of data infrastructure powering frontier AI coding models, building large-scale datasets, evaluation frameworks, and execution environments.

You will own end-to-end platform investments, partner with ML researchers, and translate research goals into production-ready systems that enhance model development and evaluation quality.