AI Software Engineer — Python, LLMs & RAG (Hybrid)

ACA Group; Durham (NC); Hybrid; USD 140,000 - 190,000; Full time

Job summary

ACA Group, a leading GRC advisor, seeks an AI Software Engineer to design and build intelligent applications leveraging LLMs, RAG, and AI agents for financial services. You will work with product, engineering, and compliance teams to deliver scalable AI-powered solutions that solve complex business challenges.

You will design, implement, and optimize AI workflows, RESTful services, and data pipelines, while collaborating across teams to advance the platform and evaluate new AI technologies for

Qualifications

• 7+ years of professional software development experience with Python.
• Experience with LangChain or similar AI orchestration frameworks.
• Experience with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.).
• Experience implementing Retrieval-Augmented Generation (RAG) solutions.
• Experience building and deploying AI agents.
• Strong knowledge of SQL, NoSQL, and vector databases.
• Experience with REST APIs, HTTP, SSH, and SFTP.
• Experience with AWS and/or Azure.
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar).
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar).
• Strong software design, architecture, and problem-solving skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design and develop AI-powered applications using Python.
• Build and maintain RAG-based solutions and AI agent workflows.
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek.
• Develop APIs, services, and integrations that support AI-powered workflows.
• Design and optimize solutions using SQL, NoSQL, and vector databases.
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions.
• Evaluate emerging AI technologies and recommend improvements to the platform.

Skills

Python

LangChain

AI orchestration

LLMs integration

RAG

AI agents

SQL/NoSQL/Vector DB

REST APIs

Cloud (AWS/Azure)

Observability tools

Data pipelines (Airflow/Prefect/Dagsee

Software design/architecture

Communication & collaboration

Tools

Docker

Kubernetes

Octopus Deploy

Azure DevOps Pipelines

Jenkins

GitHub Actions

Job description

ACA Group, a leading GRC advisor, seeks an AI Software Engineer to design and build intelligent applications leveraging LLMs, RAG, and AI agents for financial services. You will work with product, engineering, and compliance teams to deliver scalable AI-powered solutions that solve complex business challenges.

You will design, implement, and optimize AI workflows, RESTful services, and data pipelines, while collaborating across teams to advance the platform and evaluate new AI technologies for