Sr. AI Architect

Ethereum Technologies; Illinois; On-site; USD 180,000 - 260,000; Full time

Job summary

Ethereum Technologies seeks a senior platform engineer in Illinois to own the architecture of our enterprise AI platform and lead a hands-on team. You will define control-plane services, SDKs, reusable templates, and tooling to enable scalable GenAI workloads.

You will mentor 3–8 engineers, align with product leadership on roadmaps, and drive reliability, security, and cost efficiency across multi-cloud environments.

Qualifications

• 10–15+ years software engineering or platform experience with leadership.
• Hands-on experience building enterprise AI/GenAI platforms or production ML platforms.
• Deep knowledge of model gateways, RAG, evaluation, observability, governance.
• Experience with Kubernetes, IaC, CI/CD, cloud services, secrets management, secure SDLC.
• Proven architecture ownership and cross-functional leadership.
• Bachelor's degree or equivalent professional experience.

Responsibilities

• Define enterprise AI platform architecture with control-plane services, SDKs, reusable templates, and tooling.
• Design and implement model gateways with multi-provider routing, failover, rate limiting, and cost tracking.
• Build GenAI runtimes with RAG, vector/hybrid search, context/memory stores, tool execution, and model integration.
• Develop model, agent, prompt, and tool registries with versioning, approvals, lineage, auditing.
• Implement AI observability, tracing, evaluation, monitoring, latency tracking, and cost controls.
• Establish responsible AI, security, privacy, guardrails, identity management, and policy enforcement.
• Lead platform engineering using Kubernetes, IaC, CI/CD, cloud services, and reliability engineering.
• Remain hands-on with production code, architecture reviews, standards, and build-versus-buy decisions.
• Mentor and lead a team of approximately 3–8 platform engineers.
• Partner with product leadership to drive AI platform roadmaps, adoption, reliability, and measurable business outcomes.

Education

Bachelor's degree or equivalent experience

Tools

Kubernetes

IaC (Terraform / similar)

CI/CD pipelines

Cloud services

Secret management

Observability / OpenTelemetry

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

• Define enterprise AI platform architecture, including control-plane services, SDKs, reusable templates, and developer tooling.
• Design and implement model gateways supporting multi-provider routing, failover, rate limiting, tenant isolation, and cost tracking.
• Build GenAI runtimes incorporating RAG, vector and hybrid search, context and memory stores, tool execution, and model integration.
• Develop model, agent, prompt, and tool registries with versioning, approvals, lineage, and auditability.
• Implement AI observability, distributed tracing, model evaluation, quality monitoring, latency tracking, and cost controls.
• Establish responsible AI, security, privacy, guardrails, identity management, and policy enforcement.
• Lead platform engineering using Kubernetes, infrastructure-as-code, CI/CD, cloud services, and reliability engineering.
• Remain hands-on with production code, architecture reviews, technical standards, and build-versus-buy decisions.
• Mentor and lead a team of approximately 3–8 platform engineers.
• Partner with product leadership to drive AI platform roadmaps, adoption, reliability, and measurable business outcomes.

Required Qualifications

• 10–15+ years of software engineering, platform engineering, distributed systems, or infrastructure experience, including technical leadership.
• Hands-on experience building and operating enterprise AI/GenAI platforms or comparable production ML, data, or developer platforms.
• Deep knowledge of model gateways, RAG, agent platforms, AI evaluation, observability, traceability, and platform governance.
• Experience with Kubernetes, infrastructure-as-code, CI/CD, cloud services, secrets management, secure SDLC, and production reliability.
• Proven architecture ownership, cross-functional leadership, stakeholder communication, and engineering team development.
• Bachelor's degree in a related field or equivalent professional experience.

Preferred Qualifications

• Experience building multi-model AI platforms, agent registries, prompt management, evaluation frameworks, and GenAI tracing.
• Background in healthcare, med-tech, life sciences, or other regulated enterprise environments.
• Familiarity with HIPAA, GxP, PII/PHI protection, auditability, validation, and change control.
• Experience with responsible AI, security policies, FinOps, MCP, OpenTelemetry, and cloud-native platform engineering.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.