GenAI Architect with Java (17+) [W2 ONLY]
- Job Title: GenAI Architect with Java (17+)
- Location: Austin, TX (Hybrid)
- Experience Level: 12 years
Top Skills Required
- Modern Java & Microservices Core – Java 17+, Spring Boot 3.x, REST/Reactive APIs, distributed microservices architecture
- Enterprise GenAI & LLM Integration – LLM orchestration, Spring AI or LangChain4j, RAG pipelines, prompt engineering, guardrails/security
Role Overview
Seeking an experienced GenAI Architect with deep enterprise engineering roots in modern Java (17+) and Spring Boot microservices. The selected candidate will define the architectural blueprint for integrating enterprise-grade Generative AI capabilities — including LLM orchestration, Retrieval-Augmented Generation (RAG), vector databases, and multi-agent workflows — into resilient, high-throughput microservices ecosystems.
Technical Core & Responsibilities
- Design and govern scalable, secure architectures embedding LLMs and foundation models into core business platforms and microservices backends
- Architect and standardize microservices utilizing Java 17+ / Java 21, Spring Boot 3.x, and reactive patterns (Spring WebFlux), ensuring low latency, high throughput, and seamless integration with distributed caches and databases
RAG & Agentic Workflows
- Design and implement robust RAG pipelines, semantic caching, vector search indexing, and agent orchestration patterns (LangChain4j, Spring AI, Semantic Kernel, or custom orchestrators)
AI Governance, Security & Guardrails
- Establish architectural guardrails for model security, prompt injection defenses, PII masking, DLP, token cost optimization, and model evaluation/observability
Distributed Scalability & Deployment
- Champion event-driven integration using Apache Kafka, container orchestration via Docker and Kubernetes/Helm, and cloud-native AI deployments (AWS/GCP/Azure)
Technical Governance & Mentorship
- Drive code quality, technical roadmaps, architecture review board (ARB) approvals, and guide engineering leads and delivery teams
Required Technical Skills & Qualifications
- Extensive enterprise experience in Java 17+, Spring Boot 3.x, Spring Cloud, and Spring Data
- Hands-on experience integrating with LLM APIs (OpenAI, Anthropic Claude, Azure OpenAI, Bedrock, or open-source models) using Java-native AI frameworks (e.g., Spring AI, LangChain4j) or REST/gRPC wrappers
- Deep understanding of embeddings, chunking strategies, hybrid search, and vector databases (e.g., pgvector, OpenSearch, Pinecone, Milvus, Qdrant)
- Proven expertise in distributed system patterns (SAGA, CQRS, Circuit Breaker, Event Sourcing) and real-time streaming architectures using Apache Kafka
- Hands-on proficiency with relational and NoSQL databases (PostgreSQL, Oracle, MongoDB, Redis)
- Solid background in cloud architectures (AWS/GCP), container platforms (Docker, Kubernetes), and CI/CD automation pipelines
Note
- Hybrid in Austin, TX
- 12 years experience required
- Java 17+, Spring Boot 3.x, and microservices experience required
- GenAI/LLM integration, RAG pipelines, and vector databases experience required
- Kafka, Docker, Kubernetes, and cloud experience required