Gen AI Engineer with Java & Microservices

American IT Systems

Atlanta (GA)

On-site

USD 130,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

American IT Systems in Atlanta is seeking a Gen AI Engineer to design and build production-grade Java microservices that leverage large language models and AI platforms. You will bridge generative models and enterprise systems, delivering scalable, secure AI services.

Collaborate with data scientists, implement RAG and vector DB integrations, and ensure observability, testing, and reliable deployment across cloud environments.

Qualifications

  • Bachelor's degree or equivalent practical experience in computer science or related field.
  • 5+ years of professional software development with emphasis on OOP and enterprise apps.
  • Expert proficiency in Java and advanced concurrency/functional patterns.
  • Deep experience building microservices and using Spring Boot; RESTful APIs and APIs gateways.
  • Proven AI/LLM API integration experience (OpenAI/Anthropic or open-source models).
  • Cloud exposure (AWS/GCP/Azure) with Docker and Kubernetes; familiarity with vector DBs.
  • Strong observability, logging, metrics, and performance optimization skills.

Responsibilities

  • Design, develop, and deploy production-grade Java microservices that integrate with LLMs.
  • Architect RESTful APIs and event-driven patterns for internal/external clients.
  • Develop prompt engineering, context management, and RAG with vector DBs.
  • Build resilient integration layers for model inference, retries, timeouts, and fallbacks.
  • Develop asynchronous processing and streaming for long-running AI tasks.
  • Implement monitoring, logging, and observability for AI services health.
  • Collaborate with data scientists to productionize experimental models and optimize performance.
  • Design and run unit/integration/load tests to ensure reliability under load.
  • Evaluate new AI models/tools and contribute to internal AI frameworks and libraries.

Skills

Java proficiency
Microservices
Spring Boot
API integration
Cloud platforms
Docker
Kubernetes
Vector databases
Observability
Problem solving
Communication

Education

Bachelor's degree in Computer Science or related field

Tools

OpenAI API
Anthropic API
Weaviate
Pinecone
pgvector
Docker
Kubernetes
Spring Boot

Job description

Gen AI Engineer with Java & Microservices

Atlanta is rapidly emerging as a hub for artificial intelligence and enterprise technology, and we are seeking a talented Gen AI Engineer to join a forward-thinking team dedicated to building intelligent, scalable solutions. This role is perfect for a software engineer who combines deep expertise in Java and microservices architecture with a passion for large language models, generative AI, and the practical deployment of these cutting-edge technologies. You will be at the forefront of transforming complex business challenges into innovative, AI-powered products that drive real impact.

As a Gen AI Engineer in Atlanta, you will be responsible for designing and implementing robust, production-ready AI services that integrate seamlessly with existing enterprise systems. Our team values a collaborative, agile culture where engineers are encouraged to experiment, iterate, and own their work from concept to deployment. Your primary focus will be on bridging the gap between theoretical generative models and reliable, high-performance microservices, ensuring that our AI solutions are not only intelligent but also resilient, secure, and maintainable. This is an opportunity to shape the future of our platform and contribute to Atlanta's vibrant tech community.

You will play a key role in the entire lifecycle of AI feature development—from identifying opportunities for generative AI to improving user experience, to designing the APIs and services that make these features accessible. By joining our team, you will help establish best practices for integrating LLMs into microservice-based architectures, tackling challenges like prompt management, response streaming, cost optimization, and model evaluation. Your work will directly influence how our organization leverages generative capabilities to enhance productivity, automate complex workflows, and deliver personalized user experiences.

Key Responsibilities
  • Design, develop, and deploy production-grade microservices in Java (using frameworks like Spring Boot) that integrate with a variety of large language models and AI/ML platforms.
  • Architect and implement RESTful APIs and event-driven communication patterns to expose generative AI capabilities to internal and external clients.
  • Develop robust prompt engineering strategies, including prompt templating, chaining, and dynamic context management, to optimize model output for specific business use cases.
  • Implement features such as Retrieval-Augmented Generation (RAG), integrating vector databases to provide grounded, context-aware responses from proprietary knowledge bases.
  • Build resilient integration layers to handle model inference, including retry logic, timeouts, rate limiting, and fallback mechanisms to ensure high availability.
  • Develop services for asynchronous processing and streaming responses, ensuring efficient handling of long-running inference tasks.
  • Implement comprehensive monitoring, logging, and observability solutions (e.g., tracking token usage, latency, and model performance) to ensure the health of AI services.
  • Collaborate closely with data scientists and ML engineers to convert experimental models into production-ready code, focusing on system architecture and performance optimization.
  • Develop and execute unit, integration, and load tests for AI services, ensuring code quality and system reliability under pressure.
  • Participate in the evaluation of new generative AI models, libraries, and tools, providing technical assessments and recommendations.
  • Write technical documentation and contribute to the maintenance of our internal AI service frameworks and shared libraries.
  • Stay current on the rapidly evolving Gen AI landscape, proactively suggesting improvements to our architecture and development practices.
Required Qualifications
  • Bachelor's degree in Computer Science, Software Engineering, or a related technical field (or equivalent practical experience).
  • 5+ years of professional software development experience, with a strong emphasis on object-oriented programming and enterprise-level application development.
  • Expert proficiency in Java, including advanced concepts like concurrency, functional programming patterns, and robust error handling.
  • Deep hands-on experience building and deploying applications using microservices architecture, including service discovery, API gateways, and distributed tracing.
  • Strong working knowledge of Spring Boot or a similar Java-based micro-service framework, including testing and configuration.
  • Proven experience integrating with third-party AI/LLM APIs (e.g., OpenAI, Anthropic, or open-source models) within a server-side environment.
  • Solid understanding of cloud platforms (AWS, GCP, or Azure) and experience with containerization (Docker) and orchestration (Kubernetes) is highly desirable.
  • Proficiency with databases (SQL and NoSQL) and practical experience using vector databases (e.g., Pinecone, Weaviate, pgvector) for semantic search.
  • Working knowledge of observability tools and practices, including logging frameworks, metrics collection, and monitoring dashboards.
  • Excellent problem-solving, debugging, and analytical skills with a proactive and self-directed work ethic.
  • Strong communication skills with the ability to collaborate effectively in a team environment and translate complex technical concepts to non-technical stakeholders.
  • Passion for learning new technologies, particularly in the field of generative AI and machine learning engineering.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GenAI Engineer
GenAI Engineer

Capgemini • New York (NY)

On-site
USD 140,000 - 200,000
Lead Full Stack Developer
Lead Full Stack Developer

Reqroute, Inc • Texas

On-site
USD 180,000 - 240,000
GenAI Architect
GenAI Architect

Capgemini • New York (NY)

Hybrid
USD 160,000 - 260,000
Senior AI Engineer - Generative AI & Agentic Systems
Senior AI Engineer - Generative AI & Agentic Systems

Life in Pittsburgh • Pittsburgh

On-site
USD 150,000 - 210,000
Lead Full Stack Developer
Lead Full Stack Developer

TechDigital Group • Austin (TX)

On-site
USD 180,000 - 240,000
GenAI Fullstack Engineer
GenAI Fullstack Engineer

Marlabs • Englewood Cliffs (NJ)

On-site
USD 130,000 - 180,000
Gen AI
Gen AI

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 140,000 - 190,000
GenAI Architect with Java
GenAI Architect with Java

New York Technology Partners • Texas

Hybrid
USD 180,000 - 240,000
Gen AI
Gen AI

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 180,000 - 260,000
Generative AI Engineer
Generative AI Engineer

Cloud Pivot Solutions • Denver (CO)

On-site
USD 120,000 - 160,000