Senior Software Engineer, AI Agents

The General Intelligence Company of New York; United States; On-site; USD 250,000 - 300,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Flexible work setup

Job summary

A leading technology company in the United States is seeking a Senior Software Engineer for AI Agents. The ideal candidate will have strong backend engineering skills, hands-on experience with LLM, and a track record of delivering features to production. Responsibilities include designing agent improvements, building evaluation pipelines, and enhancing core backend systems. Competitive salary of $250,000 - $300,000 plus equity and comprehensive benefits are offered in a dynamic, fast-paced environment.

Qualifications

• 4+ years backend engineering experience, preferably Python.
• Experience shipping LLM features to production.
• Strong concurrency, reliability, performance knowledge.

Responsibilities

• Design and implement agent improvements end-to-end.
• Build robust evaluation pipelines for the agent.
• Improve core backend systems and job orchestration.

Skills

Backend engineering experience

Hands-on LLM experience

Building evaluation harnesses

Solid distributed systems fundamentals

Excellent debugging skills

Tools

Redis

Postgres/Supabase

Event-driven designs

Job description

Senior Software Engineer, AI Agents

Join to apply for the Senior Software Engineer, AI Agents role at The General Intelligence Company of New York.

Pay range

Base pay: $250,000.00/yr - $300,000.00/yr

This range is provided by The General Intelligence Company of New York. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

What You’ll Do

• Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths
• Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
• Productionize applied LLM techniques: function/tool-calling orchestration, self-reflection, retrieval/RAG, multi-agent handoffs, caching/embedding strategies, and hallucination reduction
• Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability; scalable memory and context routing; data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.; observability and tracing for agent actions/outcomes
• Partner with product and infra to define success metrics and ship fast, safe iterations
• Write clean, well-tested code; document design decisions and runbooks

What You’ll Bring

• 4+ years backend engineering experience, preferably Python (we care about impact over years)
• Hands‑on LLM experience: prompt engineering, function‑calling, retrieval, embeddings, evaluation design; you’ve shipped LLM features to production
• Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)
• Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management
• Excellent debugging and instrumentation skills; you enjoy finding and fixing edge cases in the wild

Nice To Have

• Experience with agent frameworks, tool orchestration, and memory architectures
• RAG systems in production (chunking, retrieval quality, freshness strategies)
• Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event‑driven designs
• Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization

Why Join Us

• Mission: build autonomous agents that run entire businesses
• Impact: ship core agent improvements that users feel immediately
• Velocity: small, senior team; fast decision cycles; high ownership
• Stack: modern tooling across AI orchestration, integrations, and memory systems

Compensation

• $250,000 - $300,000 base salary and meaningful equity
• Comprehensive benefits and flexible work setup

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Technology, Information and Internet and Software Development

Referrals increase your chances of interviewing at The General Intelligence Company of New York by 2x