Senior AI Platform Engineer - Build & Own Remote Platform

JustMarkets; United States; Remote; USD 180,000 - 250,000; Full time

Benefits offered by this job

20 paid vacation days per year

10 paid sick leave days per year

Public holidays as per list

Medical insurance

Opportunity to work remotely

Professional education budget

Language learning budget

Wellness budget

Job summary

JustMarkets is seeking a Senior AI Platform Engineer to own and build our company-wide AI platform. You will lead architecture, delivery of the internal LLM gateway, and development of internal SDKs and the Agent Control Plane to orchestrate autonomous workflows.

You will collaborate with squads to translate business use cases into production-grade AI solutions, drive adoption, and evaluate build-vs-buy options while ensuring security and governance for LLM usage.

Qualifications

• 5+ years of backend development experience.
• Proficiency in Python or Go/TypeScript/Rust; Python preferred.
• Deep understanding of distributed systems (async queues, rate limiting, retries, circuit breakers).
• At least 1 year of hands-on AI/LLM experience.
• Experience with AI/LLM APIs (OpenAI, Anthropic, Gemini).
• Hands-on experience building AI agents or agentic workflows.
• Strong observability knowledge: metrics, logs, tracing.

Responsibilities

• Architect, build, and operate the internal LLM Gateway.
• Design and build the agent control plane with context management and task execution.
• Develop and maintain internal SDKs for LLM integration.
• Implement platform observability, monitoring, alerting, tracing, and cost tracking.
• Establish security and governance for LLM usage and AI agents.
• Collaborate with internal teams to translate business needs into AI solutions and drive adoption.
• Evaluate build-vs-buy options and integrate open-source tools where appropriate.

Skills

Backend development

Python

Distributed systems

AI/LLM

Observability

Docker

Kubernetes

AWS

English proficiency

Education

Degree in Computer Science or Software Engineering

Job description

JustMarkets is seeking a Senior AI Platform Engineer to own and build our company-wide AI platform. You will lead architecture, delivery of the internal LLM gateway, and development of internal SDKs and the Agent Control Plane to orchestrate autonomous workflows.

You will collaborate with squads to translate business use cases into production-grade AI solutions, drive adoption, and evaluate build-vs-buy options while ensuring security and governance for LLM usage.