Lead AI Architect - Greenfield AWS Platform at Banyan

Banyan Software

United States

Remote

USD 128,000 - 149,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% Remote
Competitive compensation with long‑er‑
Long-term equity upside

Job summary

Banyan Software seeks a Lead AI Architect to design, build, and run a centralized data and AI platform powering its growing portfolio. You’ll define the target-state architecture and own the platform from code to governance, while leading a small team over time.

With 10+ years in data/AI at scale, you’ll leverage deep AWS expertise and Python/SQL to deliver secure, observable systems and impactful AI use cases across Finance, M&A, and Business Development.

Qualifications

  • 10+ years building data and AI platforms in production at meaningful scale.
  • Deep AWS expertise with hands-on S3, IAM, KMS, networking, Glue, Lake Formation, Athena, Redshift, SageMaker, Bedrock, and EKS/ECS.
  • Strong data architecture chops: lakehouse patterns, open table formats (Iceberg, Delta, or Hudi).
  • Real experience with modern AI/ML platform patterns: feature stores, model registries, experiment tracking, RAG, evaluation, guardrails.
  • AI safety perspective: data classification, PII handling, access tiering, governance.
  • Hands-on coder: strong Python and SQL; Terraform or AWS CDK.
  • Player-coach leadership, mentoring and hiring focus.
  • Bachelor's degree in computer science, engineering, or related field.

Responsibilities

  • Define and own the target-state data and AI architecture for Banyan.
  • Design and build the AWS-centric data lake with patterns for storage, cataloging, ingestion, modeling, and lineage.
  • Stand up the AI experimentation layer with Anthropic, OpenAI and other LLMs.
  • Establish data contracts, schema standards, naming conventions, and a domain model.
  • Partner with Senior Business Analysts to translate use cases into platform requirements.
  • Define security, privacy, and AI safety guardrails for PII and confidential data.
  • Stay hands-on: write code, ship infrastructure, review PRs, fix issues.
  • Build and mentor a platform team of data/ML engineers.
  • Own platform reliability, observability, cost, and set SLOs.
  • Represent Banyan's AI/data architecture to executives, portfolio companies, and external partners.

Skills

AWS
Data architecture
Python
SQL
Leadership
Hands-on coding
Cloud platforms

Education

Bachelor's degree in Computer Science or related

Tools

Terraform
AWS CDK
Lake Formation
Glue
Athena
Redshift
Iceberg
Airflow

Job description

Lead AI Architect - Greenfield AWS Platform at Banyan in Athens

This is a rare greenfield architecture opportunity at a holding company with 120+ portfolio companies and real budget — not a maintenance role. Being the first Lead AI Architect means you define the foundation rather than inherit technical debt, which is a significant career accelerator for anyone targeting a VP of Engineering or CTO trajectory.

Compensation context: CAD $180K–$210K plus performance bonus lands roughly in the USD $135K–$160K range. For a Lead AI Architect with 10+ years, US market benchmarks typically sit at USD $175K–$220K at FAANG/scale-ups, and USD $140K–$180K at mid-market. This offer is at the lower end of US benchmarks but competitive within Canadian or remote mid-market ranges — the long-term equity upside mentioned may close the gap.

Skills you'll develop and market value:

  • End-to-end lakehouse architecture on AWS (S3, Iceberg, Lake Formation) — extremely high demand in 2024–2025.
  • AI safety and governance frameworks — an emerging discipline commanding premium rates.
  • RAG pipelines, LLM evaluation, and agentic workflow patterns — the hottest engineering skillset on the market.
  • Player-coach leadership across a multi-BU holding company — strong prep for a Head of Data or CTO role.

Green flags: Inc. 5000 for six years, genuine AI investment (internal tooling already in production), long-term hold philosophy reduces re-org risk. Watch for: "first hire" roles at holding companies can mean slow resourcing — clarify hiring authority and headcount budget before accepting.

Banyan Software is the best permanent home for software businesses that serve specialized industries, their employees, and their customers. With a buy-grow-and-hold-for-life approach and a permanent capital base, Banyan acquires and grows companies worldwide, honoring founder legacies and helping portfolio companies modernize through shared AI expertise and operational discipline. Founded in 2016, Banyan operates more than 120 portfolio companies across North and South America, Europe, and APAC, and has appeared on the Inc. 5000 list for six consecutive years. The Banyan Software Foundation, endowed with $100 million in Banyan stock, leverages technology to build a greener and more equitable world.

The Role

We are hiring our first Lead AI Architect to design, build, and run the centralized data and AI platform that powers Banyan. The cornerstone of the work is a centralized data model — a Banyan data lake — that consolidates the data we already have and unlocks safe AI experimentation for our internal functional teams: Finance, M&A, Business Development, and others.

This role is modeled on a classical Enterprise Architect role and adapted for an AI-first world. You will set the target-state architecture, choose the patterns we standardize on, write code yourself, and own the result. You will partner with our embedded business analysts and the leaders of each functional vertical so the platform stays grounded in real use cases, not abstractions.

This is a player-coach role. You start hands-on. Over time you build and lead a small platform team.

What You Will Build
  • A centralized data lake on AWS: the single, governed source of truth for internal Banyan data. Designed for analytics, ML, and AI experimentation.
  • A reference architecture for AI: patterns and building blocks our verticals use to go from idea to safe production — model selection, RAG, evaluation, observability, cost controls.
  • Guardrails that make experimentation safe: data classification, access tiering, sandboxes, audit logging, and clear rules for what can be sent where.
  • A platform team and operating model: the team, standards, and rituals that keep the platform reliable and improving as adoption grows.
What You Will Do
  • Define and own the target-state data and AI architecture for Banyan. Make the trade-offs explicit and write them down.
  • Design and build the AWS-centric data lake. Set the patterns for storage, cataloging, query, ingestion, modeling, and lineage. Likely stack: S3, Glue, Lake Formation, Athena, Redshift, Iceberg or similar open table formats, plus Terraform or CDK for infrastructure as code.
  • Stand up the AI experimentation layer: model access via Anthropic, OpenAI and other LLMs.
  • Establish data contracts, schema standards, naming conventions, and a domain model that holds up as we add sources and acquire companies.
  • Partner with Senior Business Analysts embedded in Finance, M&A, and Business Development to translate use cases into platform requirements and to unblock their work.
  • Define security, privacy, and AI safety guardrails. Classify data, design access tiering, and set the rules for handling PII, regulated data, and confidential portfolio information.
  • Stay hands-on. Write code, ship infrastructure, run code reviews, and debug production issues. Architects who do not build lose touch.
  • Build the team including vertical-aligned Senior Business AI Analysts. Find suitable contractors for data platform engineers, ML platform engineers, and data engineers. Mentor them. Set the bar for engineering quality.
  • Own platform reliability, observability, and cost. Set SLOs, monitor usage, and keep the bill rational as we scale.
  • Represent Banyan's AI and data architecture to our executive team, our portfolio companies, and external partners.
First-Year Outcomes
  • A production-ready, governed data lake foundation deployed on AWS, with at least three priority data domains landed and modeled.
  • At least two functional verticals onboarded to the platform with safe, audited data access for analytics and AI experimentation.
  • A documented reference architecture, security model, and standards library that new use cases and new hires can plug into.
  • At least one AI use case running in production through the platform, with monitoring, evaluation, and a clear ROI story.
  • First one to two team hires made and ramped.
Who You Are
  • 10+ years building data and AI platforms in production at meaningful scale. You have shipped, not just diagrammed.
  • Deep AWS expertise. Hands-on with S3, IAM, KMS, networking, Glue, Lake Formation, Athena, Redshift, SageMaker, Bedrock, and EKS or ECS.
  • Strong data architecture chops: lakehouse patterns, open table formats (Iceberg, Delta, or Hudi), data modeling, ingestion frameworks (Fivetran, Airbyte, custom), orchestration (Airflow, Dagster, or similar), and lineage.
  • Real experience with modern AI/ML platform patterns: feature stores, model registries, experiment tracking, prompt and evaluation frameworks, retrieval-augmented generation, and basic agentic workflows.
  • A working point of view on AI safety: data classification, PII handling, access tiering, evaluation, and model-risk controls.
  • Hands-on coder. Strong Python and SQL. Comfortable in Terraform or AWS CDK. Reads logs, fixes issues, ships pull requests.
  • Player-coach experience. You have led small teams, mentored engineers, set hiring bars, and grew people.
  • A strong communicator. You can drive an architecture decision review with engineers and explain trade-offs to executives in the same week.
  • Bachelor's degree in computer science, engineering, or a related field. A master's degree is a plus, not a requirement.
Bonus Points
  • Experience in private-equity-backed or holding-company environments with multiple business units and inconsistent source systems.
  • Experience designing AI guardrails for non-public, regulated, or competitively sensitive data.
  • Track record of treating internal platforms as products, with named users, SLAs, and a real adoption strategy.
  • Experience with Snowflake or Databricks. Useful when bridging to portfolio company data without forcing a single stack.
  • Past experience as the first or early platform hire at a growth-stage company.
  • Greenfield with real budget. You set the foundation, you do not inherit a tangle.
  • Real ownership of the AI and data architecture for an entire holding company.
  • A long-term horizon. We do not optimize for the next quarter, so the platform you build can compound.
  • A team that treats AI as a serious capability, not a buzzword. We have already built internal AI tooling we use every day.
  • A culture of accountable autonomy. We trust you to do the work.
  • Competitive compensation, benefits, and meaningful long-term upside.
Quick Facts
  • Team: AI & Data Science
  • Reports to: Head of AI and/or Head of IT
  • Scope: Player-coach. Hands-on architect today, leading a small platform team over time.
  • Location: 100% Remote
  • Type: Full-time
  • Compensation: Competitive base of CAD $180,000 to $210,000 plus performance bonus and benefits. Final offer reflects experience and qualifications.

Diversity, Equity, Inclusion & Equal Employment Opportunity at Banyan: Banyan affirms that inequality is detrimental to our Global Teams, associates, our Operating Companies, and the communities we serve. As a collective, our goal is to impact lasting change through our actions. Together, we unite for equality and equity. Banyan is committed to equal employment opportunities regardless of any protected characteristic, including race, color, genetic information, creed, national origin, religion, sex, affectional or sexual orientation, gender identity or expression, lawful alien status, ancestry, age, marital status, or protected veteran status and will not discriminate against anyone on the basis of a disability. We support an inclusive workplace where associates excel based on personal merit, qualifications, experience, ability, and job performance.

Is this role truly 100% remote with no location restrictions? The job posting states "100% Remote" and lists no specific timezone or city requirement. The location hint suggests the USA, so candidates should confirm with Banyan whether applicants outside the US are eligible before applying. What is the salary for the Lead AI Architect position? The compensation is a competitive base of CAD $180,000 to $210,000, plus a performance bonus and benefits. The final offer reflects experience and qualifications. Is this a management role or an individual contributor position? It is a player-coach role — you start hands-on as an architect writing code and shipping infrastructure, and over time you build and lead a small platform team, including hiring data and ML platform engineers. What is the main technical stack for this role? The primary stack is AWS-centric: S3, Glue, Lake Formation, Athena, Redshift, Iceberg (or similar open table formats), Terraform or AWS CDK for IaC, and LLM access via Anthropic, OpenAI, and other providers. Python and SQL are the core coding languages. What experience does Banyan require for this position? Banyan requires 10+ years building data and AI platforms in production, deep hands-on AWS expertise, strong data lakehouse architecture knowledge, real AI/ML platform experience (RAG, feature stores, model registries), and prior player-coach or team leadership experience.

Remote work & career advice that actually works.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Architect – Data Platform
Lead AI Architect – Data Platform

Banyan Software • United States

Remote
USD 180,000 - 210,000
Lead AI Architect - Data Platform
Lead AI Architect - Data Platform

Banyan Software • United States

On-site
USD 127,967 - 170,623
Lead AI Architect - Data Platform
Lead AI Architect - Data Platform

Bazeta • United States

Remote
USD 180,000 - 260,000
Remote work
Enterprise Architect
Enterprise Architect

Banyan Software • Seattle (WA)

On-site
USD 180,000 - 240,000
Senior AI Engineer - FinTech for Green Infrastructure
Senior AI Engineer - FinTech for Green Infrastructure

Banyan Infrastructure • San Francisco (CA)

On-site
USD 180,000 - 215,000
AI Engineer (Mid-Senior Level)
AI Engineer (Mid-Senior Level)

Banyan Infrastructure • San Francisco (CA)

Hybrid
USD 180,000 - 215,000
Senior AI Architect
Senior AI Architect

Banyan Software • United States

Remote
USD 180,000 - 240,000
VP of Engineering — AI-Driven Platform & Scale
VP of Engineering — AI-Driven Platform & Scale

Banyan Infrastructure • San Francisco (CA)

On-site
Confidential
Forward Deployed Engineer - Applied AI
Forward Deployed Engineer - Applied AI

Banyan Software • United States

On-site
USD 140,000 - 180,000
VP, Engineering
VP, Engineering

Banyan Infrastructure • San Francisco (CA)

On-site
USD 200,000 - 230,000
Top tier health plans
Professional development
Flexible time off policy
+1