Technical Architect

OpenKrill; United States; Remote; USD 190,000 - 270,000; Full time

Job summary

Boon AI is seeking a Technical Architect to own the end-to-end technical architecture across the Rails product app, Python ML/CV services, the agent SDK layer, and the data platform. You will balance enterprise requirements with shipping speed and set cross‑system tradeoffs.

This role leads scalability, reliability, and cost architecture for our computer vision/LLM pipelines, defines direction for model infrastructure, and mentors senior engineers.

Qualifications

• 10+ years building production software
• 3+ years in senior staff, principal, architect, or CTO roles
• Experience with Rails or Python monoliths, CV pipelines, or LLM/agent systems
• Fluency with cloud infrastructure (AWS/GCP), PostgreSQL at scale, RabbitMQ/SideKiq
• Led architectural decisions during high growth

Responsibilities

• Own end-to-end technical architecture across Rails app, Python ML/CV services, agent SDK, and data platform
• Drive scalability, reliability, and cost for vision/LLM/VLM pipelines
• Set technical direction for model infrastructure and eval harnesses
• Lead architectural reviews and mentor senior engineers
• Partner with CEO and product on 12–18 month technical roadmap
• Still write code and participate in incident response and PR reviews

Skills

Production software experience

Leadership at senior staff

Cloud infrastructure

PostgreSQL at scale

Background job systems

Kubernetes & CI/CD

Architectural decision leadership

Tools

Rails monoliths

Python ML/CV pipelines

LLM/Agent systems

MLflow registry

GPU budgeting

Kubernetes

CI/CD tooling

Job description

ABOUT BOON

Boon is the professional AI platform built specifically for construction. Founded in the San Francisco Bay Area in 2023 by product and engineering leaders from Samsara, Apple, Google and DoorDash. Boon is backed by leading Silicon Valley venture capitalists.

Our AI agents embed directly into existing workflows, from preconstruction estimating to bid management. They automate the repetitive tasks that drain time and margins while surfacing the insights leaders need to make faster and more confident decisions.

The result is measurable impact. Teams move faster, bids are submitted sooner, win rates increase, and costs are reduced. Boon enables construction companies to build more, generate more revenue, and grow with confidence.

ABOUT THE ROLE

Boon AI is building the agentic operating system for construction preconstruction — the layer that reads blueprints, specs, and bid documents, and does the estimator's work with them. Our platform spans a Rails product monolith, Python computer-vision services (DINOv3/SAM-class vision models reading drawings), an LLM agent runtime orchestrating multi-step construction workflows, and a model/eval infrastructure that keeps accuracy honest. We're live with GCs and subs across the country, shipping daily, and scaling from thousands to hundreds of thousands of drawings per month. The Technical Architect sits across every one of those surfaces and makes sure the system we're building this quarter is the system we can still build on three years from now.

IN THIS ROLE, YOU WILL:

• Own the end-to-end technical architecture across the Rails product app, Python ML/CV services, agent SDK layer, and data platform — including the hard tradeoffs between enterprise customer requirements and shipping speed
• Drive scalability, reliability, and cost architecture of our computer vision/LLM/VLM inference pipelines as we scale blueprint throughput by 100×
• Set the technical direction for our model infrastructure — vision models, LLM orchestration, agent runtime, MLflow registry, eval harnesses, and GPU budget
• Lead architectural review, raise the engineering bar through code review and design docs, and mentor senior engineers on cross-system tradeoffs
• Partner with the CEO and product on the 12–18 month technical roadmap: what we build in-house, what we buy, what we deprecate, and when to invest in platform vs. features
• Still write code — this is a working architect role; you'll be in incident response, PR review, and the hardest technical problems on a weekly basis

YOU’RE A GREAT FIT IF:

• You've shipped production systems that handle messy real-world input — documents, PDFs, images, OCR, user-generated chaos — not just clean API-to-API services
• You have strong opinions on monolith vs. services, model-in-the-loop UX, when to add complexity, and when "just add another microservice" is the wrong answer
• You've built or deeply operated computer vision or LLM/agent systems in production, and you understand eval infrastructure as a first-class engineering discipline
• You move fast without breaking the foundations — comfortable shipping daily, comfortable saying "stop, we need to rebuild this part" and similarly “stop, we should NOT reinvent the wheel and use battle-tested open-source/paid solutions”
• You thrive in flat, direct, high-velocity teams where the architect sets the technical path and defends it with code and data, not slides
• Bonus: construction, AEC, or other vertical-SaaS experience; or you've taken a company from Series A to C technically
• Culturally, you embody working as “one team” and strive to “get things done”, instead of passing the buck around

REQUIREMENTS FOR THE ROLE:

• 10+ years building production software; 3+ years as senior staff, principal, architect, or CTO at a product company
• Deep experience with at least two of: large Rails or Python monoliths, computer vision pipelines in production, LLM / agent systems at scale, data-intensive B2B SaaS
• Hands-on fluency with cloud infrastructure (AWS and/or GCP), PostgreSQL at scale, background job systems (RabbitMQ, SideKiq), and modern deployment practices
• Track record of leading architectural decisions that held up under 10×+ growth
• Has written and shipped production code in the last 6 months — and plans to keep doing so
• Familiar with some SRE (Service Reliability) and DevOps - Kubernetes, Helm, CI/CD and ability to drive and collaborate with Boon’s dedicated SRE teammates.

COMPENSATION

At Boon, we want to attract and retain the best employees and compensate them in a way that appropriately and fairly values their individual contribution to the company. With that in mind, we carefully consider a number of factors to determine the appropriate starting pay for an employee, including their primary work location and an assessment of a candidate’s skills and experience, as well as market demands and internal parity. This estimate can vary based on the above mentioned factors, so the actual starting annual base salary may be above or below this range. A Boon employee may be eligible for additional forms of compensation, depending on their role, including sales incentives, discretionary bonuses, and/or equity in the company.

BOON IS AN EQUAL OPPORTUNITY EMPLOYER

As an equal-opportunity employer, Boon is committed to providing employment opportunities to all individuals. All applicants for positions at Boon will be treated without regard to race, color, ethnicity, religion, sex, gender, gender identity and expression, sexual orientation, national origin, disability, age, marital status, veteran status, pregnancy, or any other basis prohibited by applicable law.