Data Infrastructure Engineer — Scale ML Pipelines

Maven Ventures; San Francisco (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

The Bot Company in San Francisco is seeking a Data Infrastructure Engineer to design and build the data backbone that feeds our autonomous robots. You will own large-scale data processing pipelines and collaborate with ML and Platform teams.

You should be proficient in Python, Go, and C++, with hands-on experience operating production systems handling trillions of events. Knowledge of Kubernetes, cloud networks, and scalable architectures is essential.

Qualifications

• Strong coding ability with Python, Go, and/or C++.
• Experience building production systems that process PBs of data on thousands of machines.
• Experience with cloud networking (performance, reliability, scale, and security).
• Experience serving ML models at scale is a plus, but not required.
• Strong knowledge in Kubernetes clusters is a plus.

Responsibilities

• Design, build, and maintain large-scale data processing systems.
• Collaborate with other functions (e.g. ML, Platform, etc).
• Independently triage and solve complex infrastructure problems across our stack.

Skills

Python

Go

C++

Production data processing

Distributed systems

Cloud concepts

Tools

Kubernetes

Docker

Cloud platforms

Job description

The Bot Company in San Francisco is seeking a Data Infrastructure Engineer to design and build the data backbone that feeds our autonomous robots. You will own large-scale data processing pipelines and collaborate with ML and Platform teams.

You should be proficient in Python, Go, and C++, with hands-on experience operating production systems handling trillions of events. Knowledge of Kubernetes, cloud networks, and scalable architectures is essential.