Lead AI Software Engineer

Rose International; Chicago (IL); Hybrid; USD 110,000 - 117,000; Full time

Job summary

Rose International in Chicago is seeking a Lead AI Software Engineer to design and orchestrate AI-powered systems, building multi-agent workflows and secure API gateways to integrate foundation models.

You will guide data models for AI-native structures, ensure scalable, testable deployments with CI/CD, and mentor teams while focusing on security and governance.

Qualifications

• 8+ years of professional software engineering experience and 2+ years in a technical leadership role.
• Proven experience designing and delivering large-scale distributed systems.
• Strong expertise in software architecture, APIs, microservices, cloud-native applications, and modern engineering practices.
• Experience influencing multiple engineering teams and leading organization-wide technical initiatives.
• Strong communication, collaboration, and stakeholder management skills.
• Demonstrated ability to mentor engineers and drive technical excellence.
• Experience with Generative AI, AI agents, LLM-powered applications, or intelligent automation platforms.
• Experience with AI development tools, coding assistants, and modern developer productivity platforms.
• Knowledge of security architecture, application security, and cloud security best practices.
• Experience establishing technical governance and engineering standards across multiple teams.

Responsibilities

• Design and orchestrate multi-agent workflows and stateful AI systems using modern frameworks like LangChain, LangGraph, AutoGen, or CrewAI.
• Integrate foundation models via secure API gateways, managing token limits, costs, and rate-limiting.
• Architect data models optimized for AI-native structures, integrating relational databases with vector databases for semantic search and RAG.
• Implement robust white-box testing and continuous evaluation metrics to monitor AI outputs for factual correctness, hallucinations, and safety compliance.
• Champion secure, reliable, and scalable software solutions through architectural leadership, risk management, and continuous improvement of engineering practices.

Skills

AI

API

AWS

Java

LLM

Microservices

RAG

Education

Bachelor's Degree

Tools

Docker

Kubernetes

Pinecone

Milvus

Chroma

pgvector

Job description

Date Posted: 09/15/2026

Hiring Organization: Rose International

Position Number: 507554

Industry: Manufacturing

Job Title: Lead AI Software Engineer

Job Location: Chicago, IL, USA, 60661

Work Model: Hybrid

Work Model Details: 2 days a week in office

Shift: 9:00 a.m. to 5 p.m

Employment Type: Temporary

FT/PT: Full-Time

Estimated Duration (In months): 12

Min Hourly Rate($): 80.00

Max Hourly Rate($): 85.00

Must Have Skills/Attributes: AI, API, AWS, Java, LLM (Large Language Model), Microservices, RAG (Retrieval-Augmented Generation)

Experience Desired: Java Backend Development, Microservices & API Architecture (10+ yrs); Software Architecture & Large-Scale Distributed Systems (8+ yrs); AWS Cloud, Docker & Kubernetes (Cloud-Native Development) (8+ yrs); Generative AI, LLMs, AI Agents, Prompt Engineering & RAG (LangChain/LangGraph/AutoGen/CrewAI) (3+ yrs); Technical Leadership, Engineering Governance & Mentoring Multiple Teams (2+ yrs)

Required Minimum Education: Bachelor’s Degree

Job Description

Required Education/Experience

• Bachelor’s degree in Computer science or Electrical engineering or related field

Required Technical Skills

• 8+ years of professional software engineering experience and 2+ years in a technical leadership role.
• Proven experience designing and delivering large-scale distributed systems.
• Strong expertise in software architecture, APIs, microservices, cloud-native applications, and modern engineering practices.
• Experience influencing multiple engineering teams and leading organization-wide technical initiatives.
• Strong communication, collaboration, and stakeholder management skills.
• Demonstrated ability to mentor engineers and drive technical excellence.
• Experience with Generative AI, AI agents, LLM-powered applications, or intelligent automation platforms.
• Experience with AI development tools, coding assistants, and modern developer productivity platforms.
• Knowledge of security architecture, application security, and cloud security best practices.
• Experience establishing technical governance and engineering standards across multiple teams.

Required Soft Skills

• Ability to work under pressure and within time constraints
• Passion for technology and an eagerness to contribute to a team-oriented environment
• Lead architectural designs and able to work across teams to come up with solutions.

Summary Of Role

• Design and orchestrate multi-agent workflows and stateful AI systems using modern frameworks like LangChain, LangGraph, AutoGen, or CrewAI.
• Integrate foundation models (e.g., Anthropic Claude, OpenAI GPT, Google Gemini) via secure API gateways, managing token limits, costs, and rate-limiting.
• Architect data models optimized for AI-native structures, integrating relational databases with vector databases for semantic search and Retrieval-Augmented Generation (RAG).
• Implement robust white-box testing and continuous evaluation metrics to monitor AI outputs for factual correctness, hallucinations, and safety compliance.
• Champion secure, reliable, and scalable software solutions through architectural leadership, risk management, and continuous improvement of engineering practices.

Technical Leadership & Workflow Optimization

• Mentor and scale an engineering team, establishing engineering standards, best practices and architectural governance for secure coding, continuous integration, and cloud-native deployment.
• Drive AI-assisted engineering velocity by integrating next-gen development tools (e.g., Cursor, Claude Code, Windsurf) into the team's daily Software Development Life Cycle (SDLC).
• Establish governance policies and coach developers on the responsible use of AI, focusing on input data sensitivity, license compliance, and security guardrails.
• Evaluate existing systems, services, APIs, and data models to identify opportunities for modernization, scalability, and performance improvements.

Influence Across Teams & Champion Developer Experience

• Facilitate technical leadership forums with Product Owners, Technical Leads, Architects, and Engineering Managers.
• Drive conversations around architecture, engineering health, technical debt, AI adoption, and continuous improvement.
• Mentor engineers and technical leaders on system design, software architecture, and engineering excellence.
• Foster collaborative decision-making through architecture reviews, RFCs, and technical discussions.
• Promote self-service engineering capabilities and platform enablement.
• Drive automation initiatives that improve productivity and software quality.

Interaction With Team

• Significant interaction required with Scrum team. Interaction during all scrum ceremonies such as Daily Standups, Sprint Planning, Grooming, Retro, Demo etc
• Also need to interact with team for PR Reviews, also need to engage with other teams as needed.

Core Software Engineering

• Backend Systems: Deep proficiency in backend environments, microservices architectures, and API design using Java.
• Cloud & DevOps: Extensive experience with containerization (Docker, Kubernetes) and public cloud infrastructure like AWS AI & LLM Infrastructure
• Orchestration & Tooling: Hands-on experience with production-level AI agents, prompt engineering, and advanced Agentic PDLC patterns.
• Vector Databases: Practical knowledge of vector technologies such as Pinecone, Milvus, Chroma, or pgvector.
• AI Tool Fluency: Demonstrated mastery of AI coding assistants and a firm understanding of Model Context Protocol (MCP) to mediate agent connections with external databases.

Benefits

For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).