Generative AI Software Engineer — LLMs & Enterprise Apps

CloudBigD

Alpharetta (GA)

On-site

USD 98,000 - 139,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD is seeking an AI Software Engineer in Alpharetta, GA to design and build Generative AI-driven software components and APIs. You will work with LLMs, prompt engineering, embeddings, vector databases, and RAG to deliver enterprise AI solutions.

The role requires hands-on experience with LangGraph/LangChain, OpenAI/Claude SDKs, and building AI agents, with strong collaboration across business stakeholders and engineering teams. Familiarity with Azure or AWS and CI/CD is expected.

Qualifications

  • 3 to 5 years of software engineering experience with hands-on application development responsibilities.
  • 1 to 3 years of practical experience developing Generative AI applications, AI assistants, AI agents, copilots, or intelligent automation solutions.
  • Proficiency in Python and experience building APIs, integrations, and enterprise applications.
  • Working knowledge of Large Language Models (LLMs), prompt engineering, embeddings, vector databases, semantic search, Retrieval-Augmented Generation (RAG), and common AI application patterns.
  • Hands-on experience with one or more AI development frameworks, such as LangGraph, LangChain, Claude Code SDK, OpenAI SDK, or similar technologies.
  • Familiarity with Model Context Protocol (MCP), AI gateways, agent-to-agent communication, or tool-calling frameworks.
  • Experience implementing AI agents, orchestration workflows, tool integrations, or agentic applications.
  • Experience building proofs of concept, prototypes, or reference implementations.
  • Experience integrating applications with enterprise systems, data platforms, and APIs.
  • Familiarity with automated testing and evaluation approaches for AI solution quality, safety, reliability, and performance.
  • Awareness of Responsible AI principles, AI governance, security controls, and enterprise data protection requirements.
  • Experience with GitHub, CI/CD pipelines, containers, and modern software engineering practices.
  • Familiarity with Azure or AWS services used to host and operate applications and AI workloads.
  • Ability to work with business stakeholders and application development teams to translate requirements into working software.
  • Strong communication, collaboration, and problem-solving skills.
  • Preferred Qualifications
  • Experience with Azure AI Foundry, AWS Bedrock, Anthropic Claude, OpenAI GPT models, SpaceX Grok Models, Gemini, or similar enterprise AI platforms.
  • Experience building RAG solutions, knowledge assistants, or AI-powered search capabilities.
  • Exposure to multi-agent systems and agent orchestration workflows.
  • Experience integrating applications with ServiceNow, Jira, Confluence, SharePoint, Microsoft Graph, Databricks, Snowflake, or similar enterprise platforms.
  • Familiarity with Kubernetes, containerized application deployment, and cloud-native architectures.
  • Experience working in financial services or another regulated industry

Responsibilities

  • Develop AI-powered software components and APIs.
  • Collaborate with business teams to translate requirements into working AI solutions.
  • Implement and evaluate AI agents, orchestration workflows, and tool integrations.
  • Build PoCs and reference implementations for enterprise AI workloads.
  • Integrate applications with enterprise data platforms and APIs.
  • Apply automated testing and evaluation for AI quality, safety, and performance.
  • Adhere to Responsible AI governance and security controls.
  • Leverage GitHub, CI/CD, and containerization in development workflows.
  • Engage with cloud services (Azure/AWS) for hosting AI workloads.
  • Communicate effectively with stakeholders and cross-functional teams.

Skills

Python
APIs
AI frameworks
LLMs
Prompt engineering
Embeddings
Vector databases
Semantic search
RAG
LangGraph
LangChain
Claude Code SDK
OpenAI SDK
MCP
AI gateways
Agent communication
Tool-calling
Agent orchestration
Tool integrations
POC development
Enterprise integrations
AI testing
Responsible AI
GitHub
CI/CD
Containers
Azure
AWS
Requirements translation
Collaboration

Tools

Azure
AWS
Kubernetes

Job description

CloudBigD is seeking an AI Software Engineer in Alpharetta, GA to design and build Generative AI-driven software components and APIs. You will work with LLMs, prompt engineering, embeddings, vector databases, and RAG to deliver enterprise AI solutions.

The role requires hands-on experience with LangGraph/LangChain, OpenAI/Claude SDKs, and building AI agents, with strong collaboration across business stakeholders and engineering teams. Familiarity with Azure or AWS and CI/CD is expected.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer - Generative AI & LLMs Lead
Senior AI Engineer - Generative AI & LLMs Lead

Robotic Process Automation LLC • Alpharetta (GA)

On-site
USD 83,000 - 117,000
Senior AI Engineer - Generative AI & LLM Architect
Senior AI Engineer - Generative AI & LLM Architect

Ethereum Technologies LLC • Alpharetta (GA)

On-site
USD 77,000 - 110,000
Generative AI/LLM Engineer for Enterprise Apps
Generative AI/LLM Engineer for Enterprise Apps

CloudBigD • Dallas (TX)

On-site
USD 90,000 - 120,000
Senior AI Engineer: Generative AI & LLMs
Senior AI Engineer: Generative AI & LLMs

Quantum Technologies LLC • Alpharetta (GA)

On-site
USD 77,000 - 110,000
Senior AI Engineer: Generative AI & Enterprise Solutions
Senior AI Engineer: Generative AI & Enterprise Solutions

Robotics Technologies LLC • Alpharetta (GA)

On-site
USD 77,000 - 110,000
Senior AI Engineer: Generative AI, LLMs & RAG
Senior AI Engineer: Generative AI, LLMs & RAG

CloudBigD • Dallas (TX)

On-site
USD 150,000 - 190,000
Senior AI Engineer: Generative AI, LLMs & MLOps
Senior AI Engineer: Generative AI, LLMs & MLOps

Rsa Tech Group • United States

On-site
USD 140,000 - 210,000
Senior AI Engineer: Generative AI, LLMs & RAG (Remote)
Senior AI Engineer: Generative AI, LLMs & RAG (Remote)

CloudBigD • Chicago (IL)

Remote
USD 105,000 - 120,000
Generative AI Software Engineer - Alpharetta (Contract)
Generative AI Software Engineer - Alpharetta (Contract)

Robotic Process Automation LLC • Alpharetta (GA)

On-site
USD 98,000 - 139,000
Senior GenAI & Agentic AI Engineer – Enterprise Platforms
Senior GenAI & Agentic AI Engineer – Enterprise Platforms

CloudBigD • New York (NY)

On-site
USD 101,000 - 136,000