Member of Technical Staff, Infrastructure

The Token Company; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Equity

Housing

Food

Laundry and cleaning in SF

Visa sponsorship

Job summary

The Token Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure.

The ideal candidate will have solid experience in cloud infrastructure, including AWS and Docker, and a proven track record in building production environments. Additional benefits include equity, housing, food, and visa sponsorship.

Qualifications

• Strong in cloud infrastructure with experience in AWS, Terraform, Docker, and CI/CD.
• Experience in building and operating production infrastructure.
• A quick learner able to adapt to new solutions and technologies.

Responsibilities

• Own the cloud systems that serve our compression API end-to-end.
• Build global low-latency, high-throughput GPU ML inference infrastructure.
• Constantly improve and research the best technologies.

Skills

AWS

Terraform

Docker

CI/CD

Performance and reliability at scale

Job description

The Token Company (YC W26, HF0 S26) is a seed stage startup in San Francisco, CA, and has raised ~$12M from First Round Capital, NEA, YC and SV Angel along with investors such as founders of Dropbox, Slack, Supercell and Huggingface and key people from OpenAI, xAI and DoorDash.

The Token Company trains machine learning models to compress raw LLM inputs before they are passed to the expensive LLMs. Our models are able to recognize parts of inputs that are unimportant, reducing inference costs for scale-ups and enterprises that integrate LLMs into their products. The team is 5 people with a research and product focus.

As a Member of Technical Staff on our infrastructure team, you'll own the cloud systems that serve our compression API end-to-end. You'd get to build global low-latency, high-throughput GPU ML inference infra that sits in the critical path of customer traffic, from deployment and scaling to reliability and cost-efficiency. This is a very high ownership role where you'd need to learn a lot of new solutions and technologies, constantly improving and researching what's best. The ideal candidate fits our culture and is:

A quick learner: grasping the product and the systems around it and moving fast is important

Strong in cloud infrastructure: comfortable with AWS, Terraform, Docker and CI/CD, and building for performance and reliability at scale

Have owned an infra stack end-to-end: have built and operated production infrastructure yourself before, at a startup or a larger company

In addition to base salary, this role is eligible for significant equity. We also provide housing, food, laundry and cleaning in SF, visa sponsorship, and a position to build the team around you with our resources.

Our website: thetokencompany.com