AI Software Engineer (Python, LangChain, LLMs)

ACA Group; Pittsburgh (Allegheny County); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

401(k) plan

Paid time off

Flexible work environment

Student debt forgiveness

Pet insurance

Job summary

ACA Group, a leading governance, risk, and compliance advisor in financial services, seeks an AI Software Engineer in a hybrid role (Pittsburgh or Durham). You will design and build intelligent applications leveraging LLMs, RAG, and AI agents to help clients manage compliance and risk.

Collaborate with product, engineering, and compliance teams to develop APIs and scalable AI-powered workflows using Python, SQL/NoSQL, and vector databases for secure, enterprise-grade solutions.

Qualifications

• 7+ years of professional software development experience with Python.
• Experience with LangChain or similar AI orchestration frameworks.
• Experience with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.).
• Experience implementing Retrieval-Augmented Generation (RAG) solutions.
• Experience building and deploying AI agents.
• Strong knowledge of SQL, NoSQL, and vector databases.
• Experience with REST APIs, HTTP, SSH, and SFTP.
• Experience with AWS and/or Azure.
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar).
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar).
• Strong software design, architecture, and problem-solving skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design and develop AI-powered applications using Python.
• Build and maintain RAG-based solutions and AI agent workflows.
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek.
• Develop APIs, services, and integrations that support AI-powered workflows.
• Design and optimize solutions using SQL, NoSQL, and vector databases.
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions.
• Evaluate emerging AI technologies and recommend improvements to the platform.

Skills

Python

LangChain

LLMs experience

RAG solutions

AI agents

SQL/NoSQL

APIs & Cloud

Observability tools

Workflow orchestration

Team collaboration

Tools

Docker

Kubernetes

Airflow

Dagster

Prefect

Job description

AI Software Engineer About ACA

ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We're building innovative, AI-powered technology solutions that help financial institutions manage compliance, reduce risk, and improve operational efficiency.

Location

Durham, NC OR Pittsburgh, PA (Hybrid, 2 days per week in office)

Role Overview

We are seeking an AI Software Engineer to design and build intelligent applications leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and AI agents. This role will work closely with product, engineering, and compliance teams to develop scalable AI-powered solutions that solve complex business challenges in the financial services industry.

What You’ll Do

• Design and develop AI-powered applications using Python
• Build and maintain RAG-based solutions and AI agent workflows
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek
• Develop APIs, services, and integrations that support AI-powered workflows
• Design and optimize solutions using SQL, NoSQL, and vector databases
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions
• Evaluate emerging AI technologies and recommend improvements to the platform

Required Qualifications

• 7+ years of professional software development experience with Python
• Experience with LangChain or similar AI orchestration frameworks
• Experience working with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.)
• Experience implementing Retrieval-Augmented Generation (RAG) solutions
• Experience building and deploying AI agents
• Strong knowledge of SQL, NoSQL, and vector databases
• Experience with REST APIs, HTTP, SSH, and SFTP
• Experience with AWS and/or Azure
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar)
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar)
• Strong software design, architecture, and problem-solving skills
• Excellent communication and collaboration skills

Preferred Qualifications

• Experience with cloud-native application development and microservices
• Experience building enterprise SaaS applications
• Familiarity with Docker and Kubernetes
• Experience with CI/CD and release orchestration tools (e.g., Octopus Deploy, Azure DevOps Pipelines, Jenkins, GitHub Actions, or similar)
• Experience within financial services, compliance, or regulatory technology
• Experience with AI-powered search, NLP, or automation solutions

Our Technology

Our platform is a fully cloud-native SaaS solution that leverages AI, automation, and modern data technologies to support compliance, surveillance, testing, marketing review, and other regulatory workflows. We combine advanced AI capabilities with human expertise to deliver intelligent, reliable, and accountable solutions.

What working at ACA offers

We offer a competitive compensation package where you’ll be rewarded based on your performance and recognized for the value you bring to our business. Our Total Rewards package includes medical and dental coverage and 401(k) plans, and a wide range of paid time off options as well as a flexible work environment. You’ll also be granted time off for designated ACA Paid Holidays, Summer Fridays, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. We also offer unique benefits such as Student Debt Forgiveness and Pet Insurance.

About ACA

ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlpha® technology platform with the specialized expertise of former regulators and practitioners and our deep understanding of the global regulatory landscape.

What we commit to

ACA is firmly committed to a policy of nondiscrimination, which applies to recruiting, hiring, placement, promotions, training, discipline, terminations, layoffs, transfers, leaves of absence, compensation and all other terms and conditions of employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.