AI Engineer

PhoenixTeam

Arlington (VA)

Remote

USD 140,000 - 210,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

PhoenixTeam is seeking a Senior AI Engineer to lead the design and delivery of production AI features using LLMs. You will build end-to-end solutions, including RAG pipelines, AI agents, and prompt-driven workflows.

The role requires 4+ years in software engineering with 1-2+ years building production LLM applications, and strong Python skills. You will evaluate providers, manage costs, and ensure quality while mentoring peers.

Qualifications

  • Bachelor's degree in Computer Science or equivalent practical experience.
  • 4+ years of professional software engineering, 1-2+ years building production LLM apps.
  • Strong Python skills with web/backend stack experience.
  • Hands-on with RAG architectures, vector databases, and embeddings.
  • Experience with prompt engineering and evaluation of non-deterministic systems.
  • Solid fundamentals: testing, CI/CD, production monitoring, and collaboration.

Responsibilities

  • Design, build, and ship LLM-powered features end to end, incl. RAG systems and AI agents.
  • Evaluate LLM providers, embeddings, and orchestration frameworks for quality and cost.
  • Create prompt engineering pipelines with automated testing and regression checks.
  • Design and maintain retrieval systems grounding model outputs in data.
  • Collaborate with product/design to translate problems into testable AI features.
  • Instrument systems for observability: monitor quality, latency, and failures.
  • Mentor engineers on LLM patterns and evaluation best practices.
  • Partner with backend to integrate AI services via clean APIs.

Skills

Python
LLM apps
RAG systems
Vector DBs
API design
CI/CD
Remote work

Education

Bachelor's in CS

Tools

Pinecone
Weaviate
pgvector
FastAPI
Django
Git

Job description

Description: The Senior AI Engineer leads the design and delivery of production AI features for PhoenixTeam, translating ambiguous product problems into reliable, well-tested LLM-powered solutions. The role prototypes and ships large language model applications end to end, including retrieval-augmented generation (RAG) pipelines, AI agents, and prompt-driven workflows; evaluates model, embedding, and orchestration options against quality, latency, and cost; builds evaluation and observability pipelines to monitor production AI systems; and partners closely with product, design, and backend engineering to integrate AI services into PhoenixTeam's applications. The engineer also mentors other team members on LLM application patterns and evaluation best practices. This role requires 4+ years of professional software engineering experience with at least 1-2 years building production LLM applications, strong Python skills, excellent written and verbal communication, sound engineering judgment, and the ability to work independently in a fully remote, asynchronous-friendly environment.

Key Functions
  • Design, build, and ship LLM-powered features end to end, from prototype to production, including RAG systems, AI agents, and prompt-driven workflows.
  • Evaluate and select LLM providers, embedding models, and orchestration frameworks, balancing quality, latency, and cost.
  • Build robust prompt engineering and evaluation pipelines, including automated testing and regression checks for model outputs.
  • Design and maintain retrieval systems (vector databases, chunking strategies, hybrid search) that ground model outputs in reliable data.
  • Partner with product and design to translate ambiguous problems into scoped, testable AI features.
  • Instrument AI systems for observability, tracking quality, latency, cost, and failure modes in production.
  • Mentor other engineers on LLM application patterns, prompt design, and evaluation best practices.
  • Collaborate with backend engineers to integrate AI services into existing application infrastructure via clean, well-documented APIs.
  • Stay current with the rapidly evolving LLM and agent ecosystem, bringing new techniques into the team's toolkit.
Minimum Qualifications
  • Bachelor's degree in Computer Science, a related field, or equivalent practical experience.
  • 4+ years of professional software engineering experience, including 1-2+ years building production applications on top of LLMs (OpenAI, Anthropic, or similar).
  • Strong Python skills, with comfort in at least one modern web or backend stack (e.g., Node.js, Django, FastAPI).
  • Hands-on experience with RAG architectures, vector databases (e.g., Pinecone, Weaviate, pgvector), and embedding models.
  • Practical experience with prompt engineering, structured output generation, and evaluation methodologies for non-deterministic systems.
  • Solid understanding of software engineering fundamentals: testing, code review, CI/CD, and production monitoring.
  • Excellent verbal and written communication skills, with the ability to work independently in a remote, asynchronous-friendly environment.
Preferred Qualifications or Skills
  • Familiarity with agent frameworks and tool-use patterns (e.g., LangChain, LlamaIndex, or custom orchestration).
  • Experience fine-tuning or evaluating open-source LLMs.
  • Background in traditional ML (classification, ranking, or recommendation systems).
  • Experience with cloud infrastructure (AWS, GCP, or Azure) and containerized deployments.
  • Prior experience in a startup or fast-moving product environment.
Position Details
  • Employment type: Full-Time
  • Location: 100% Remote (US-based)
  • Hours: 40 hours/week with availability during core business hours
  • Start date: ASAP
  • Compensation: Competitive salary, equity, and benefits (details provided upon offer)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer Remote Worker - N/A View role (opens in a new tab)
AI Engineer Remote Worker - N/A View role (opens in a new tab)

Phoenixoutcomes • United States

Remote
USD 180,000 - 260,000
AI Engineer
AI Engineer

PhoenixTeam • Arlington (TX)

Remote
USD 120,000 - 180,000
Remote AI Engineer for Production LLMs & Agentic Systems
Remote AI Engineer for Production LLMs & Agentic Systems

7Seventy • United States

Hybrid
USD 130,000 - 150,000
Remote work nationwide
Health benefits
Competitive compensation package
+2
AI Engineer
AI Engineer

Fluency • San Francisco (CA)

On-site
USD 180,000 - 250,000
US$1,000 per month food and commuting allowance
Laptop of choice
ESOP available
AI Engineer / AI Agent Engineer
AI Engineer / AI Agent Engineer

Lab3 • United States

Remote
USD 100,000 - 150,000
AI Engineer
AI Engineer

datadotorg • Union City (NJ)

Remote
USD 105,000 - 125,000
AI Engineer
AI Engineer

Compunnel Inc. • Phoenix (AZ)

Hybrid
USD 120,000 - 190,000
Hybrid work arrangement
AI Engineer Intern
AI Engineer Intern

Spatium Lab LLC • Bellevue (WA)

On-site
USD 83,000 - 152,000
Direct mentorship from founders
Ownership of production projects
Remote | AI/ML Engineer, Internal Platforms — $220,000–$300,000/year
Remote | AI/ML Engineer, Internal Platforms — $220,000–$300,000/year

24-MAG • United States

Remote
USD 220,000 - 300,000
Fully remote
AI Engineer
AI Engineer

Moring AI • Texas

On-site
USD 60,000 - 80,000