AI Engineer: Backend & LLM Systems Architect

Socket.dev; Atlanta (GA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Health coverage

Retirement plan

PTO 15 days

Wellhub access

Sports incentive

Global trip after 4 years

Job summary

TRACTIAN is seeking an AI Engineer to join the Software Team and help build scalable backend systems and AI-driven features. You will work across departments to coordinate project planning, architecture decisions, and deployments, contributing to high-performance and reliable software.

The role emphasizes collaboration, robust testing, and deploying cutting-edge LLM applications, with a focus on RAG, GPT-based solutions, and API integrations.

Qualifications

• 5+ years of backend development with scalable system design, API architecture (DDD), and microservices (gRPC/REST); databases Postgres, MongoDB, Redis, ClickHouse; AWS.
• Proficient in TypeScript and Golang with extensive testing (unit, E2E, load) using Cypress, Playwright, k6.
• Skilled in containerization (Docker, Kubernetes) and DevOps: CI/CD, IaC, monitoring via Datadog/Grafana.
• Experience building and optimizing LLM apps: Retrieval-Augmented Generation (RAG), GPT-based solutions, deployment patterns, API integration (OpenAI, Anthropic, Gemini).
• Proficient with PyTorch, model optimization (quantization, distillation), and vector DBs (pgvector, Weaviate, Pinecone).
• Experience with LLM inference stacks (TensorRT-LLM, VLLM, llama.cpp) and building RAG systems.
• Strong problem-solving, communication, and cross-functional collaboration; track record delivering complex backends on time.
• Experience in startups or high-growth environments; deep expertise in optimization tools and processes.
• Bachelor's degree in CS or Engineering.

Responsibilities

• Contribute to planning and execution of software projects to deliver on time and with high quality.
• Collaborate with developers, sharing knowledge and fostering high performance.
• Support decisions on backend architecture, scalability, and infrastructure.
• Coordinate with software, product, engineering, and other departments for seamless execution.
• Streamline workflows, tackle technical challenges, and improve productivity.
• Assist deployments to ensure smooth, efficient releases and robust system performance.

Skills

TypeScript

Golang

API design (DDD)

Microservices

PostgreSQL

MongoDB

Redis

ClickHouse

AWS

Unit testing

E2E testing

Load testing

Cypress

Playwright

k6

Docker

Kubernetes

CI/CD

IaC

Datadog

Grafana

RAG

GPT integration

OpenAI

Anthropic

Gemini

PyTorch

Quantization

Model distillation

Vector databases

pgvector

Weaviate

Pinecone

LLM inference

TensorRT-LLM

VLLM

llama.cpp

Prompt engineering

API integration

Education

Bachelor's degree in Computer Science or Engineering

Tools

Docker

Kubernetes

Terraform

Prometheus

Datadog

Grafana

OpenAI API

Anthropic API

Gemini API

LLM tooling

pgvector

Weaviate

Pinecone

Job description

TRACTIAN is seeking an AI Engineer to join the Software Team and help build scalable backend systems and AI-driven features. You will work across departments to coordinate project planning, architecture decisions, and deployments, contributing to high-performance and reliable software.

The role emphasizes collaboration, robust testing, and deploying cutting-edge LLM applications, with a focus on RAG, GPT-based solutions, and API integrations.