Sr Generative AI Platform Engineer | Hybrid Jacksonville, FL

gobravvo; Jacksonville (FL); Hybrid; USD 117,000 - 193,000; Full time

Job summary

ARC Group seeks a Senior Generative AI Platform Engineer to lead the architecture, development, and scaling of a next‑gen AI orchestration platform in a hybrid Jacksonville setting.

You will bridge cutting‑edge AI research with enterprise infrastructure, designing RAG pipelines, AI Agents, and MCP‑based tool/data integration while delivering resilient Java/Spring Boot microservices and OpenShift deployments.

Qualifications

• 5+ years of related IT/Engineering experience and technical design.
• Experience with AI/ML orchestration and enterprise infra.
• Strong Python and Java development skills.

Responsibilities

• Architect, deploy, and scale GenAI services in a hybrid cloud.
• Design advanced RAG pipelines and multi-agent systems.
• Implement MCP and interoperable interfaces for tools and data.
• Lead backend microservice development in Java/Spring Boot.

Skills

Python

Java

OpenShift

AWS

MLOps

GenAI frameworks

RAG pipelines

MCP protocol

LangChain

Observability

Education

Bachelor's degree

Tools

LangChain

LlamaIndex

Bedrock

Spring Boot

Job description

SR GENERATIVE AI PLATFORM ENGINEER | HYBRID – JACKSONVILLE, FL

ARC Group has an immediate opportunity for an Sr Generative AI Platform Engineer with Python and Java development experience! This is a contract position running through March 2027 with potential to extend longer or possibly convert to FTE. This is a hybrid position in Jacksonville, FL, working onsite 2-3 days/week and remotely the other days. This is a fantastic opportunity to join a well-respected healthcare organization with excellent career growth potential.

At ARC Group, we are committed to fostering a diverse and inclusive workplace where everyone feels valued and respected. We believe that diverse perspectives lead to better innovation and problem-solving. As an organization, we embrace diversity in all its forms and encourage individuals from underrepresented groups to apply.

Candidates must currently have PERMANENT US work authorization. Sorry, but we are not considering any candidates from outside companies for this position (no C2C, 3rd party / brokering).

JOB SUMMARY:

We are seeking an experienced Senior Generative AI / Platform Engineer to lead the architecture, development, and scaling of our client’s next-generation AI orchestration platform. In this role, you will bridge the gap between cutting-edge AI research and robust enterprise infrastructure.

This resource will be responsible for designing advanced Retrieval-Augmented Generation (RAG) pipelines, building resilient AI Agents, implementing cutting-edge interoperability protocols like MCP, and pioneering multi-agent (Agent-to-Agent) collaboration networks.

The ideal candidate possesses deep expertise in Python for AI/LLM orchestration, a strong backend foundation in Java (Spring Boot), and proven experience deploying and managing containerized workloads across a hybrid-cloud topology consisting of on-premises RedHat OpenShift and Amazon Web Services (AWS).

Core Responsibilities:

• Hybrid Cloud Infrastructure & Deployment: Architect, deploy, and scale GenAI services, vector databases, and model gateways across a hybrid environment utilizing on-premises RedHat OpenShift and public cloud services in AWS (e.g., EKS, Bedrock, EC2).
• Advanced RAG & Retrieval Optimization: Design and optimize enterprise RAG pipelines.
• Implement advanced retrieval strategies, including hybrid search (vector + lexical) and high-precision reranking workflows (using cross-encoders) to minimize LLM context noise, optimize token usage, and eliminate hallucinations.
• Agentic Systems & Tool Orchestration: Build, deploy, and monitor production-grade AI Agents capable of autonomous planning, tool usage, complex multi-step reasoning, and self-correction.
• Context Integration & Interoperability: Architect scalable integrations between LLMs and enterprise data silos using the Model Context Protocol (MCP), establishing clean, standardized interfaces for tool servers and data sources.
• Multi-Agent Networks (A2A): Design and implement Agent-to-Agent (A2A) collaboration systems, enabling specialized, decoupled agents to communicate, delegate tasks, and negotiate state synchronously or asynchronously.
• Enterprise Integration & Backend Development: Build secure, high-throughput, and fault-tolerant microservices in Java/Spring Boot to serve GenAI features, manage data orchestration, and expose robust endpoints.

Required Technical Experience

• Hybrid Cloud & Container Orchestration: RedHat OpenShift: Deep hands-on experience deploying, managing, and troubleshooting containerized enterprise applications in an on-premises OpenShift environment (including managing security contexts, routes, and cluster resources).
• AWS Platform: Strong expertise with core AWS infrastructure and AI/ML services (e.g., IAM, VPC, Amazon Bedrock, EKS, RDS). Dual-Stack Mastery (Python & Java): Python: Expert-level proficiency for AI/ML tasks, asynchronous programming, and data engineering. Java: Deep experience building distributed microservices utilizing the Spring Boot ecosystem (Spring Web, Spring Security, Spring Data).
• Generative AI Frameworks: Practical experience with orchestrating frameworks such as LangChain, LlamaIndex, LangGraph, AutoGen, CrewAI, LangChain4j, or Spring AI.
• Advanced RAG Stack: Experience with vector databases (e.g., Pinecone, Qdrant, Milvus, pgvector) alongside dedicated reranking APIs (such as CohereRerank, BGE, or open-source cross-encoders).
• Protocols & Standards: Solid understanding of MCP (Model Context Protocol) or experience building universal API layer abstractions for LLM tool utilization.
• MLOps, DevSecOps & Observability: Familiarity with LLM evaluation frameworks, CI/CD pipelines targeting OpenShift/AWS, and enterprise observability tools (e.g., Prometheus, Grafana, OpenTelemetry, LangSmith).

Preferred Qualifications

• Experience configuring on-prem OpenShift clusters with GPU acceleration (NVIDIA GPU Operator) for local LLM or embedding model hosting.
• Relevant certifications such as RedHat Certified Specialist in OpenShift or AWS Certified Solutions Architect / Machine Learning Specialty.
• Active contribution to open-source GenAI projects, MCP servers, or multi-agent ecosystem tools.

Required Work Experience:

5+ years related work experience, Professional experience with technical design and coding in the IT industry

Required Education:

Related Bachelor’s degree or additional, related work experience

At ARC Group, we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.

Position is offered with no fee to candidate.