Senior AI Software Engineer (Agentic Systems & LLM Infrastructure) (Remote)

MAP SSG; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

A growing health tech company in the United States is seeking a Senior AI Software Engineer to own the design and development of end-to-end AI systems. This role requires ensuring technical excellence in building distributed backend systems while collaborating closely with product, data, and infrastructure teams. The ideal candidate will have extensive experience in backend systems, AI/ML infrastructure, and a hands-on approach to problem-solving. Attractive compensation and significant autonomy are offered.

Benefits

Competitive compensation

Equity

Benefits

Qualifications

• 5+ years of experience building production-grade backend systems.
• Deep experience with distributed systems and microservices.
• Strong grasp of AI/ML infrastructure and model serving.
• Experience deploying in cloud-native environments using Kubernetes, Terraform, and Docker.

Responsibilities

• Design, build, and scale distributed backend systems.
• Integrate AI/LLM models into product systems.
• Develop high-reliability APIs and services for AI inference.
• Collaborate with product, infra, and research teams.

Skills

Python

Go

Distributed systems

Event-driven architecture

API design

Cloud-native environments

Monitoring and logging

Scrappy problem solving

Tools

PostgreSQL

Redis

Kubernetes

Terraform

Docker

FastAPI

Flask

Job description

As aSenior AI Software Engineer, you will own the design and development ofend-to-end AI systems, spanning backend infrastructure, model orchestration, and production-grade deployment. You’ll work closely with product, data, and infrastructure teams tointegrate LLMs, agentic frameworks (LangGraph, LangChain, AutoGen), computer vision models, and vector-based reasoning systemsinto consumer-facing and internal tools. This role is highly technical, hands-on, and requires bothdeep systems expertise and practical AI application skills. If you’re a high-ownership engineer excited to ship AI-powered products at scale, this is your opportunity to make a real impact.

Key Responsibilities

• Design, build, and scale distributed backend systemsthat power LLMs, agents, and AI infrastructure.
• Integrate AI/LLM models into product systems(e.g., LangGraph, Agentic APIs, vector stores, orchestration layers).
• Develop high-reliability APIs and servicesfor real-time AI inference, telemetry, usage metering, and monitoring.
• Own backend architecture decisionsacross authentication, billing, deployments, and developer platforms.
• Collaborate closely with product, infra, and research teamsto translate cutting-edge AI into production systems.
• Ensure production-readinessthrough observability, CI/CD pipelines, and SRE-style reliability engineering.
• Drive continuous improvement, pushing for faster iteration, scalability, and throughput.
• Mentor peers and lead by examplewith a hands-on, high-ownership, startup-style mindset.

Must-Have Qualifications

• 5+ years of experiencebuilding production-grade backend systems inPython, Go, or similar.
• Deep experience withdistributed systems, microservices, and event-driven architecture.
• Strong grasp ofAI/ML infrastructure, model inference, model serving, and agentic frameworks.
• PostgreSQL, Redis, or similar data store expertise, including performance tuning and scaling.
• Familiarity withvector databases, embeddings, and LLM-specific storage/search systems.
• Experience deploying incloud-native environments(AWS, GCP) usingKubernetes, Terraform, Docker.
• Proficiency withAPI design, backend frameworks (e.g., FastAPI, Flask), and load balancing.
• Hands-on experience withtelemetry, monitoring, logging, and production issue triage.
• Understanding ofCI/CD workflows, developer tooling, and test automation at scale.
• Ability to work infast-paced, early-stage environments, making tradeoffs and shipping quickly.
• Strong communication skills: clear, concise, and collaborative—even when disagreeing.
• Bias for action: you’re ascrappy problem solverwho thrives in ambiguity.

Nice-to-Have Qualifications

• Experience withLangChain, LangGraph, AutoGen, OpenAI APIs, or other agent-based orchestration frameworks.
• Familiarity withcomputer vision modelsand multimodal AI systems.
• Background inhealth tech, regulated data systems (HIPAA compliance), or medical data pipelines.
• Experience buildingAI-powered consumer applicationswith personalization and real-time inference.
• Exposure toreinforcement learning, retrieval-augmented generation (RAG), or long-term memory agents.
• Motivated by amission-driven product,with excitement for being part of explosive growth.
• Background incompetitive sports, military, or other high-intensity, high-throughput environmentswhere resilience and ownership are key.

Why Join Us

• Work oncutting-edge AI productsthat directly help people improve their health.
• Buildagentic systemsfrom the ground up, influencing technical strategy and architecture.
• Join afast-moving, high-ownership team, with significant autonomy and impact.
• Competitive compensation, equity, and benefits in a rapidly scaling health tech company.