Senior AI Engineer: Architect & Scale Agentic LLMs

Socket.dev; New York (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

Obin is seeking AI Engineers to join as one of its earliest hires in New York. You’ll work directly with the founders (ex-Google) and own critical architectural decisions from day one.

You’ll design and deploy LLM-powered agents, collaborate with customers, and own production infrastructure. You’ll balance performance, cost, and safety while shaping core platform design and engineering culture at scale.

Qualifications

• 8-12+ years of software engineering experience.
• 2-3+ years building AI/ML systems, LLM-based agents, or RAG in production.
• Logging, evaluating, optimizing AI applications.
• Sets architecture for agentic AI systems across products; solves non-deterministic challenges.
• Expert in agent-to-agent orchestration, self-correcting agent loops, prompt-routing middleware; mentors senior engineers.
• Proficiency in Python and cloud infrastructure (GCP preferred).
• Experience with cloud infra and APIs.
• Hunger to move fast, own outcomes, and build something enduring.
• Strong intuition around system architecture, performance, and scaling.
• Clear communication in ambiguous, high-stakes problem spaces.

Responsibilities

• Designing and deploying LLM-powered agents using prompt design and orchestration.
• Working directly with customers to co-develop AI solutions tied to ROI.
• Owning production infrastructure and APIs with high availability and observability.
• Evaluating and optimizing systems balancing accuracy, latency, cost, and explainability.
• Contributing to core platform design and reusable deployment infrastructure.
• Setting engineering culture, hiring bar, and long-term technical roadmap.

Skills

Python

LLM frameworks

Agent orchestration

System design

MLOps

Performance optimization

Production tooling

Cloud infrastructure

Tools

GCP

PydanticAI

LlamaIndex

Claude Agent SDK

Job description

Obin is seeking AI Engineers to join as one of its earliest hires in New York. You’ll work directly with the founders (ex-Google) and own critical architectural decisions from day one.

You’ll design and deploy LLM-powered agents, collaborate with customers, and own production infrastructure. You’ll balance performance, cost, and safety while shaping core platform design and engineering culture at scale.