AI Software Engineer (Python, LangChain, LLMs)

ACA Group; Durham (NC); Hybrid; USD 140,000 - 190,000; Full time

Job summary

ACA Group, a leading GRC advisor, seeks an AI Software Engineer to design and build intelligent applications leveraging LLMs, RAG, and AI agents for financial services. You will work with product, engineering, and compliance teams to deliver scalable AI-powered solutions that solve complex business challenges.

You will design, implement, and optimize AI workflows, RESTful services, and data pipelines, while collaborating across teams to advance the platform and evaluate new AI technologies for

Qualifications

• 7+ years of professional software development experience with Python.
• Experience with LangChain or similar AI orchestration frameworks.
• Experience with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.).
• Experience implementing Retrieval-Augmented Generation (RAG) solutions.
• Experience building and deploying AI agents.
• Strong knowledge of SQL, NoSQL, and vector databases.
• Experience with REST APIs, HTTP, SSH, and SFTP.
• Experience with AWS and/or Azure.
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar).
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar).
• Strong software design, architecture, and problem-solving skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design and develop AI-powered applications using Python.
• Build and maintain RAG-based solutions and AI agent workflows.
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek.
• Develop APIs, services, and integrations that support AI-powered workflows.
• Design and optimize solutions using SQL, NoSQL, and vector databases.
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions.
• Evaluate emerging AI technologies and recommend improvements to the platform.

Skills

Python

LangChain

AI orchestration

LLMs integration

RAG

AI agents

SQL/NoSQL/Vector DB

REST APIs

Cloud (AWS/Azure)

Observability tools

Data pipelines (Airflow/Prefect/Dagsee

Software design/architecture

Communication & collaboration

Tools

Docker

Kubernetes

Octopus Deploy

Azure DevOps Pipelines

Jenkins

GitHub Actions

Job description

AI Software Engineer About ACA

ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We're building innovative, AI-powered technology solutions that help financial institutions manage compliance, reduce risk, and improve operational efficiency.

Location: Durham, NC OR Pittsburgh, PA (Hybrid, 2 days per week in office)

Role Overview

We are seeking an AI Software Engineer to design and build intelligent applications leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and AI agents. This role will work closely with product, engineering, and compliance teams to develop scalable AI-powered solutions that solve complex business challenges in the financial services industry.

What You'll Do

• Design and develop AI-powered applications using Python
• Build and maintain RAG-based solutions and AI agent workflows
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek
• Develop APIs, services, and integrations that support AI-powered workflows
• Design and optimize solutions using SQL, NoSQL, and vector databases
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions
• Evaluate emerging AI technologies and recommend improvements to the platform

Required Qualifications

• 7+ years of professional software development experience with Python
• Experience with LangChain or similar AI orchestration frameworks
• Experience working with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.)
• Experience implementing Retrieval-Augmented Generation (RAG) solutions
• Experience building and deploying AI agents
• Strong knowledge of SQL, NoSQL, and vector databases
• Experience with REST APIs, HTTP, SSH, and SFTP
• Experience with AWS and/or Azure
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar)
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar)
• Strong software design, architecture, and problem-solving skills
• Excellent communication and collaboration skills

Preferred Qualifications

• Experience with cloud-native application development and microservices
• Experience building enterprise SaaS applications
• Familiarity with Docker and Kubernetes
• Experience with CI/CD and release orchestration tools (e.g., Octopus Deploy, Azure DevOps Pipelines, Jenkins, GitHub Actions, or similar)
• Experience within financial services, compliance, or regulatory technology
• Experience with AI-powered search, NLP, or automation solutions

Our Technology

Our platform is a fully cloud-native SaaS solution that leverages AI, automation, and modern data technologies to support compliance, surveillance, testing, marketing review, and other regulatory workflows. We combine advanced AI capabilities with human expertise to deliver intelligent, reliable, and accountable solutions.

What working at ACA offers

• We offer a competitive compensation package where you’ll be rewarded based on your performance and recognized for the value you bring to our business.
• Our Total Rewards package includes medical and dental coverage and 401(k) plans, and a wide range of paid time off options as well as a flexible work environment.
• You’ll also be granted time off for designated ACA Paid Holidays, Summer Fridays, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
• We also offer unique benefits such as Student Debt Forgiveness and Pet Insurance.

About ACA

ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlpha® technology platform with the specialized expertise of former regulators and practitioners and our deep understanding of the global regulatory landscape.

What we commit to

ACA is firmly committed to a policy of nondiscrimination, which applies to recruiting, hiring, placement, promotions, training, discipline, terminations, layoffs, transfers, leaves of absence, compensation and all other terms and conditions of employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.