Agent Architect

Pencil

Deutschland

Remote

EUR 90,000 - 130,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

25 days PTO plus public holidays with,
Health insurance / private medical
Monthly wellness stipend
Remote - work from home
Enhanced parental leave
Office access in The Shard (UK)
Flexible working hours

Job summary

Pencil is hiring an Agent Architect to design the brain of Pencil—the agent logic, tool-calling structures, and evaluation loops powering our creative engine. You will bridge creative intent and machine execution, ensuring robust, predictable outputs across text, image, and video.

You will architect core systems and client workflows for brands requiring brand DNA and complex creative logic, collaborating with AI Engineering and Product teams to determine prompting, RAG, or fine-tuning solutions.

Qualifications

  • 3+ Years of Direct GenAI Experience with LLMs (GPT-4, Claude, Gemini) and multimodal models.
  • Systems thinking across prompts, agents, and context to optimize workflows.
  • Proficiency with Python, JSON structures, and API documentation; familiarity with orchestration frameworks.

Responsibilities

  • Agent Architecture: Design and implement multi-agent workflows, including task decomposition, state management, and tool-use (RAG, API integration).
  • Systematic Optimization: Implement rigorous evaluation frameworks to measure and improve agent performance at scale.
  • Scalable Frameworks: Develop reusable agents and prompt libraries for 1,000+ brands with unique voices.

Skills

GenAI Experience
Systems Thinking
Technical Literacy
Evaluation & Benchmarking
Creative/Technical Bridge
Orchestration Mindset

Tools

Python
JSON
APIs
LangChain
CrewAI
AutoGen

Job description

At Pencil, we’re building the agentic OS for marketing. We aren’t just using generative AI; we are building the machine that makes it professional, brand-safe, and scalable. We’re moving beyond simple text-in/text-out interfaces toward complex multi-agent architectures that can handle the nuanced demands of global brands and the agility of small businesses.

We are looking for an Agent Architect who thinks in systems, not just sentences. You will be responsible for the "brain" of Pencil—designing the agent logic, tool-calling structures, and evaluation loops that power our core creative engine and bespoke client solutions.

The Role

Architecting the Creative Brain

You won’t just be promptsing; you will be engineering behavior. You will bridge the gap between creative intent and machine execution, ensuring that our agents are robust, predictable, and capable of high-fidelity output across text, image, and video.

Your Work Will Fall Into Two High-impact Pillars
  • Core Systems: Designing and scaling the foundational agents that power the Pencil SaaS platform.
  • Client Solutions: Architecting custom workflows for world-class brands that require specific "brand DNA" and complex creative logic.
Job Responsibilities
  • Agent Architecture: Design and implement multi-agent workflows, including task decomposition, state management, and tool-use (RAG, API integration, etc.).
  • Systematic Optimization: Move beyond "vibe-based" testing. Implement rigorous evaluation frameworks (e.g., using LLM-as-a-judge, promptfoo, or DSPy) to measure and improve agent performance at scale.
  • Scalable Frameworks: Develop reusable agents and prompt libraries that allow the platform to serve 1,000+ brands with unique voices simultaneously.
  • Cross-Functional Engineering: Partner with AI Engineering and Product teams to determine which behaviors should be handled via prompting, RAG, or fine-tuning.
  • Client Architecture: Act as the technical lead for complex client deployments, translating high-level creative briefs into deterministic AI workflows.
What We’re Looking For
  • 3+ Years of Direct GenAI Experience: You have a deep, intuitive, and technical understanding of LLMs (GPT-4, Claude, Gemini) and multimodal models (Stable Diffusion, Midjourney, Video Gen).
  • Systems Thinking: You don’t just write a prompt; you think about the latent space, the context window, and how one agent's output becomes another’s input.
  • Technical Literacy: While this isn’t a "Software Engineer" role, you should be comfortable with Python, JSON structures, and API documentation. Experience with orchestration frameworks (LangChain, CrewAI, AutoGen) is a major plus.
  • Evaluation Obsession: You believe that if you can’t measure a prompt’s performance, you shouldn’t ship it. You are familiar with benchmarking and A/B testing AI outputs.
  • The "Creative/Technical" Bridge: You can sit in a room with a Creative Director and translate "make it feel more punchy" into a temperature adjustment and a few-shot prompting strategy.
You’ll Thrive Here If...
  • You find "hallucinations" to be a logic puzzle to be solved, not just a bug.
  • You are excited by the challenge of making an AI follow a 50-page brand book with 100% fidelity.
  • You want to build the infrastructure that defines how the next generation of advertising is created.
KPI & Success Measures
  • System Reliability: Reducing the "failure rate" of complex agent workflows.
  • Architectural Efficiency: Minimizing token usage/latency while increasing output quality.
  • Brand Alignment: Scoring of agent outputs against specific brand guidelines using automated evaluation tools.
  • Scale: Successful rollout of core agents used by the entire Pencil user base.
Benefits
  • 25 days PTO plus public holidays, although we operate a Flexible Time Off scheme
  • Health insurance / private medical cover
  • Monthly stipend towards wellness, fitness, and learning and development
  • Remote - work from anywhere in your home country
  • Enhanced parental leave policies, whether you become a parent through birth, adoption or surrogacy
  • Access to our Pencil office in The Shard, London for our UK employees
  • Flexible working hours
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Agentic Engineer (f/m/d)
Agentic Engineer (f/m/d)

OH-SO Digital GmbH • Germany

On-site
USD 90,000 - 130,000
Agentic Tooling Engineer EU/UK remote (m/f/d) remote
Agentic Tooling Engineer EU/UK remote (m/f/d) remote

Pliant • Berlin

Remote
EUR 110,000 - 160,000
Remote work flexibility
Monthly mobility benefit
Wellhub Membership
+2
Agentic AI Engineer: Build AI-driven, multi-project systems
Agentic AI Engineer: Build AI-driven, multi-project systems

OH-SO Digital GmbH • Germany

Remote
USD 90,000 - 130,000
Agentic Systems Engineer (Digital Services)
Agentic Systems Engineer (Digital Services)

Cambridgeconsultantslimited • Germany

On-site
EUR 90,000 - 140,000
AI Image Designer
AI Image Designer

Puffy • Germany

Remote
EUR 47,000 - 80,000
Remote First
Flexible work location
Comprehensive benefits
+2
AI Creative Technologist (m/f/d)
AI Creative Technologist (m/f/d)

Voy • Berlin

Hybrid
EUR 90,000 - 130,000
28 days vacation
NAVIT/Urban Sports Club membership
Employee discounts on our products
+4
Creative Technology & AI Manager (all genders)
Creative Technology & AI Manager (all genders)

Publicis One Touch • Hamburg

On-site
EUR 70,000 - 110,000
Creative Technology & AI Manager (all genders)
Creative Technology & AI Manager (all genders)

Publicis Groupe Holdings B.V • Hamburg, Berlin, Köln

On-site
EUR 70,000 - 110,000
VP of Product Design
VP of Product Design

Jobgether • Germany

Remote
EUR 150,000 - 190,000
25 days paid time off
Health insurance
Wellness stipend
+4
AI Platform Engineer
AI Platform Engineer

4IRW • Germany

Remote
EUR 90,000 - 135,000
Remote-first work environment
Health insurance
Home office allowance
+6