Senior AI Infrastructure Engineer — Scalable Data Platforms

InCommon; San Francisco (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

InCommon, an applied research lab in San Francisco, seeks a Senior Software Engineer - Infrastructure to design and build the core infrastructure powering data generation, evaluation, and AI workflows.

You will enable researchers and engineers to run large-scale human-in-the-loop workflows and data pipelines, ensuring scalability, reliability, and high throughput as the platform evolves with frontier AI development.

Qualifications

• Strong experience building production distributed systems
• Experience designing and operating systems in cloud environments (GCP or AWS)
• Experience with message queues and event-driven systems (Kafka, RabbitMQ, Pub/Sub, etc.)
• Experience working with high-throughput data pipelines and asynchronous processing systems
• Strong understanding of system scalability, performance, and reliability
• Experience owning systems running in production environments

Responsibilities

• Design and build core infrastructure systems: Architect and develop the shared infrastructure powering the company's data generation platforms, human-in-the-loop systems, and evaluation pipelines.
• Develop scalable distributed systems: Build systems capable of processing large-scale datasets and high-throughput workloads with strong reliability guarantees.
• Build internal platforms and shared services: Create reusable infrastructure and APIs that enable product engineers and researchers to build quickly and reliably on top of core systems.
• Optimize performance and reliability: Design systems with strong observability, monitoring, and fault tolerance to support production workloads at scale.
• Own infrastructure architecture: Help define long-term system architecture across data pipelines, compute infrastructure, task orchestration, and storage systems.
• Collaborate across engineering and research: Work closely with engineers and researchers to support new AI experimentation workflows and platform capabilities.
• Establish engineering best practices: Define standards for system design, deployment, reliability, and infrastructure operations.

Job description

InCommon, an applied research lab in San Francisco, seeks a Senior Software Engineer - Infrastructure to design and build the core infrastructure powering data generation, evaluation, and AI workflows.

You will enable researchers and engineers to run large-scale human-in-the-loop workflows and data pipelines, ensuring scalability, reliability, and high throughput as the platform evolves with frontier AI development.