Senior LLM Systems Architect

CCC Information Services; Chicago (IL); On-site; USD 180,000 - 250,000; Full time

Benefits offered by this job

401K Match

Paid time off

Annual Incentive Plan

Performance Bonus

Comprehensive health insurance

Adoption Assistance

Tuition Reimbursement

Wellness Programs

Stock Purchase Plan

Employee Resource Groups

Job summary

CCC Intelligent Solutions Inc. is seeking a senior software engineer to lead LLM-powered systems and agentic workflows.

You will own end-to-end architecture, from problem framing with product managers to production operation, with a strong emphasis on security, privacy, and auditability. You will design NLP pipelines, set evals and guardrails, and build durable event-driven services in a multi-tenant environment.

Qualifications

• 6+ years of professional software engineering experience with LLM-powered systems.
• Experience designing and shipping production-grade AI-powered workflows.
• Proficient in Python and TypeScript with emphasis on scalable, secure design.
• Proven ability to define evals, guardrails, and measurement for AI features.
• Experience with CI/CD, infrastructure as code, and cloud platforms.

Responsibilities

• Own delivery of LLM-powered systems and agentic workflows from problem to production.
• Define evals, guardrails, and production signals for releases.
• Sharpen specifications, prompts, and policies for agentic tools.
• Design NLP pipelines blending semantic search and classical NLP with LLMs.
• Build and operate durable, multi-tenant, event-driven systems.
• Ensure tracing, auditability, and data provenance for model calls.
• Set privacy/security baselines including tenant isolation and redaction.
• Author design documents, review code, and mentor engineers.
• Participate in on-call rotation and incident response.

Skills

Python

TypeScript

LLM systems

Security & privacy

Azure/AWS

CI/CD & IaC

Temporal

Observability

Data modeling

On-call & audit

Tools

PostgreSQL

MongoDB

Neo4j

OpenTelemetry

LangSmith

Arize

Braintrust

Kubernetes

GitHub Copilot

Job description

CCC Intelligent Solutions Inc. is seeking a senior software engineer to lead LLM-powered systems and agentic workflows.

You will own end-to-end architecture, from problem framing with product managers to production operation, with a strong emphasis on security, privacy, and auditability. You will design NLP pipelines, set evals and guardrails, and build durable event-driven services in a multi-tenant environment.