Principal AI Engineer

Socket.dev

New York (NY)

On-site

USD 180,000 - 240,000

Full time

3 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Socket.dev is seeking AI Engineers to join as one of the earliest hires, working directly with the founders to own key technical decisions from day one.

You will help design and deploy agentic AI systems, build scalable infrastructure, and collaborate with customers to deliver AI-enabled credit workflow solutions that drive ROI.

Qualifications

  • 10-15+ years of software engineering experience.
  • 5-8+ years building AI/ML systems, LLM-based agents, or RAG in production.
  • Logging, evaluating, and optimizing AI applications.
  • Sets architecture for agentic AI systems across products; solves non-deterministic problems (context pollution, runtime state handoffs, safety).
  • Expert in agent-to-agent orchestration, self-correcting loops, prompt-routing middleware; mentors senior engineers.
  • Proficiency in Python and cloud infrastructure (GCP preferred).
  • Experience with cloud infra and APIs.
  • Clear communication in ambiguous, high-stakes problem spaces.

Responsibilities

  • Own agentic AI strategy across the company's product suite; sets governance standards for agent evaluation, safety and autonomy.
  • Designing and Deploying LLM-Powered Agents; build agentic systems using LLMs and RAG to automate complex credit workflows.
  • Working directly with customers to understand workflow pain points and co-develop AI solutions that tie to ROI.
  • Owning production infrastructure; architect and maintain backend systems and APIs with high availability and observability.
  • Evaluating and optimizing systems; balance accuracy, latency, reliability, cost, and explainability; lead experiments.
  • Contributing to core platform design; define technical architecture and reusable infrastructure for agent deployment.
  • Setting culture and standards; help define engineering culture, hiring bar, and long-term technical roadmap.

Skills

Python
AI systems
LLM-based agents
Agent orchestration
Cloud infrastructure
Performance tuning
Mentoring
Communication

Tools

LlamaIndex
Claude Agent SDK
Google ADK
PydanticAI

Job description

The Role:

We're looking for AI Engineers who can help us build and scale intelligent agents from the ground up. You’ll join our team as one of our earliest hires. You'll work directly with the founders (ex-Google) and own key technical decisions from day one.

  • Owning agentic AI strategy across the company's product suite; sets governance standards for agent evaluation, safety and autonomy.
  • Designing and Deploying LLM-Powered AgentsBuild agentic systems using LLMs and RAG to automate complex credit workflows. This includes prompt design, tool use, orchestration logic, and system evaluation.
  • Working Directly with CustomersPartner with technical and non-technical stakeholders at major credit firms to understand workflow pain points and co-develop AI solutions that directly tie to ROI.
  • Owning Production InfrastructureArchitect and maintain backend systems and APIs that connect to data sources and customer platforms. Ensure high availability, performance, and observability.
  • Evaluating and Optimizing SystemsBalance accuracy, latency, reliability, cost, and explainability in our agentic systems. Lead rigorous experimentation and improvement cycles.
  • Contributing to Core Platform DesignDefine technical architecture, build reusable infrastructure for agent deployment, and shape the foundation of Obin’s AI engineering best practices.
  • Setting Culture and StandardsHelp define Obin’s engineering culture, hiring bar, and long-term technical roadmap

We believe great AI Engineers come from diverse backgrounds and are unified by deep curiosity, pragmatism, and engineering excellence.

Experience Required:
  • 10-15+ years of software engineering experience
  • 5-8+ years of hands-on experience building AI/ML systems/frameworks , LLM-based agents and/or RAG systems in production
  • Logging, evaluating, optimizing AI applications
  • Sets architecture for agentic AI systems across products; solves ambiguous problems inherent to non-deterministic systems (context pollution, runtime state handoffs, safety).
  • Expert in agent-to-agent (A2A) orchestration protocols, self-correcting agent loops, prompt-routing middleware; drives AI safety/reliability practices and evaluation standards; mentors senior engineers.
  • Proficiency in Python and experience with modern AI/ML frameworks and cloud infrastructure (GCP preferred)
  • Experience with cloud infra (preferably GCP) and APIs
  • Hunger to move fast, own outcomes, and build something enduring
  • Strong intuition around system architecture, performance, and scaling
  • Clear communication, especially in ambiguous, high-stakes problem spaces
Bonus:
  • Experience with human-in-the-loop systems, feedback loops, and long-horizon agentic task execution
  • Background in financial systems, risk modeling, or decision automation
  • Familiarity with PydanticAI, LlamaIndex, Google ADK, Claude Agent SDK, or similar frameworks
  • You’ve built or contributed to an internal AI platform or reusable LLM tooling
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff AI Engineer
Staff AI Engineer

Socket.dev • New York (NY)

On-site
USD 180,000 - 260,000
Principal AI Engineer
Principal AI Engineer

Obin AI • New York (NY)

On-site
USD 180,000 - 260,000
Staff AI Engineer
Staff AI Engineer

Obin AI • New York (NY)

On-site
USD 180,000 - 260,000
Agentic AI Engineer
Agentic AI Engineer

Obin AI • New York (NY)

On-site
USD 140,000 - 210,000
Senior AI Engineer
Senior AI Engineer

Obin AI • New York (NY)

On-site
USD 150,000 - 230,000
AI Engineer
AI Engineer

Obin AI • New York (NY)

On-site
USD 120,000 - 160,000
Lead AI Agent Systems Architect (LLM-Powered)
Lead AI Agent Systems Architect (LLM-Powered)

Obin AI • New York (NY)

On-site
USD 180,000 - 260,000
Lead AI Engineer for Agentic Systems
Lead AI Engineer for Agentic Systems

Obin AI • New York (NY)

On-site
USD 180,000 - 260,000
Forward Deployed AI Engineer
Forward Deployed AI Engineer

Obin AI • New York (NY)

On-site
USD 170,000 - 230,000
Senior AI Engineer - LLM Agents & Scalable Systems
Senior AI Engineer - LLM Agents & Scalable Systems

Obin AI • New York (NY)

On-site
USD 150,000 - 230,000