Senior ML Engineer – AI Agent Platform Architect

geico; New York (NY); On-site; USD 105,000 - 230,000; Full time

Job summary

GEICO is seeking a Senior Machine Learning Engineer to join our AI Agent Platform team, driving scalable GenAI workflows for millions of policyholders. You will design, build, and deploy high-performance AI services, including multi-tenant hosting, skill ecosystems, and guardrails, collaborating with data scientists and software engineers.

You should have 5+ years in software development and 3+ years in AI/ML platforms, with cloud-agnostic tooling, Kubernetes, and GPU-enabled infra.

Qualifications

• 5+ years of professional software development experience in Java, Python, C++, or C#.
• 3+ years building AI/ML platforms and systems with open-source/cloud-agnostic components.
• 3+ years' experience in end-to-end software development lifecycles (Git, CI/CD, Kubernetes).
• 3+ years building evaluation and observability systems for AI/LLMs, with GPU infrastructure.
• Bachelor's degree or higher in CS/Engineering.

Responsibilities

• Develop and maintain enterprise AI agent platform services for long-running workflows.
• Build and sustain harness components: tool dispatch, context management, error recovery, session state.
• Extend LLM context management and memory controls; support RAG pipelines and dynamic loading of skills/tools.
• Design and implement guardrails: input validation, data privacy, prompt safety, and audit trails.
• Collaborate with data scientists and software engineers to plan features and guide implementation.

Skills

Software development

Java

Python

C++

Kubernetes

AI/ML platforms

Education

Bachelor's degree in Computer Science

Tools

OpenSearch

Milvus

Kafka

PostgreSQL

Redis

Job description

GEICO is seeking a Senior Machine Learning Engineer to join our AI Agent Platform team, driving scalable GenAI workflows for millions of policyholders. You will design, build, and deploy high-performance AI services, including multi-tenant hosting, skill ecosystems, and guardrails, collaborating with data scientists and software engineers.

You should have 5+ years in software development and 3+ years in AI/ML platforms, with cloud-agnostic tooling, Kubernetes, and GPU-enabled infra.