Fractional AI Infrastructure Architect

Active Parks; Boston (MA); Hybrid; USD 344,400 - 688,800; Part time

Job summary

An innovative AI company is seeking a Principal-level AI Infrastructure Engineer to enhance their architecture and systems. The role involves reviewing current systems, designing scalable architectures, and supporting implementations. Applicants should have significant experience with LLM-agnostic systems and scalability under high loads. This position starts as a fractional advisory role with an opportunity to transition into a full-time position. Located in the Boston area for occasional meetings, this role offers a chance to significantly influence the company's technology direction.

Qualifications

• Experience in building and scaling LLM-agnostic systems.
• Strong background in API-heavy systems during production loads.
• Expertise in token-efficient architecture design.

Responsibilities

• Review and pressure-test current architecture.
• Design next-generation scalable architecture.
• Support implementation and guide technical decisions.

Skills

Built and scaled LLM-agnostic systems

Scaled AI or API-heavy systems

Experience operating at billion-token-per-day scale

Deep expertise in rate limits and batching

Designed token-efficient architectures

Worked with closed and open-model providers

Job description

An innovative AI company is seeking a Principal-level AI Infrastructure Engineer to enhance their architecture and systems. The role involves reviewing current systems, designing scalable architectures, and supporting implementations. Applicants should have significant experience with LLM-agnostic systems and scalability under high loads. This position starts as a fractional advisory role with an opportunity to transition into a full-time position. Located in the Boston area for occasional meetings, this role offers a chance to significantly influence the company's technology direction.