Founding Public AI Infrastructure Engineer

Metagov; Indiana (PA); On-site; USD 507,780 - 608,220; Full time

Job summary

Metagov is seeking a Public AI Founding Infrastructure Engineer to enhance the Public AI Inference Utility. This is a fully remote role funded by Current AI, with a commitment to building public infrastructure. The engineer will be the first dedicated infrastructure hire, reporting to the CTO and responsible for the platform's operational backbone.

The ideal candidate will have significant experience in production inference or ML serving infrastructure and a passion for nonprofit initiatives. Compensation starts at $50,000 over three months, with the potential for full-time employment.

Qualifications

• Significant experience with vLLM, model routing, GPU-backed services or comparable.
• Strong understanding of observability, incident response, and capacity planning.
• Experience in maintaining and integrating systems for operational excellence.

Responsibilities

• Build end‑to‑end observability across various systems.
• Implement routing transparency and endpoint provenance.
• Improve platform speed and reliability for public access.

Skills

Experience operating production inference or ML serving infrastructure

Strong distributed systems and SRE instincts

Experience orchestrating many stacks

Maintainer and integrator energy

Ability to work mostly autonomously

Job description

Metagov is seeking a Public AI Founding Infrastructure Engineer to enhance the Public AI Inference Utility. This is a fully remote role funded by Current AI, with a commitment to building public infrastructure. The engineer will be the first dedicated infrastructure hire, reporting to the CTO and responsible for the platform's operational backbone.

The ideal candidate will have significant experience in production inference or ML serving infrastructure and a passion for nonprofit initiatives. Compensation starts at $50,000 over three months, with the potential for full-time employment.