AI Software Engineer — LLMs, LangChain, Python

ACA Group; Pittsburgh (Allegheny County); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

401(k) plan

Paid time off

Flexible work environment

Student debt forgiveness

Pet insurance

Job summary

ACA Group, a leading governance, risk, and compliance advisor in financial services, seeks an AI Software Engineer in a hybrid role (Pittsburgh or Durham). You will design and build intelligent applications leveraging LLMs, RAG, and AI agents to help clients manage compliance and risk.

Collaborate with product, engineering, and compliance teams to develop APIs and scalable AI-powered workflows using Python, SQL/NoSQL, and vector databases for secure, enterprise-grade solutions.

Qualifications

• 7+ years of professional software development experience with Python.
• Experience with LangChain or similar AI orchestration frameworks.
• Experience with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.).
• Experience implementing Retrieval-Augmented Generation (RAG) solutions.
• Experience building and deploying AI agents.
• Strong knowledge of SQL, NoSQL, and vector databases.
• Experience with REST APIs, HTTP, SSH, and SFTP.
• Experience with AWS and/or Azure.
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar).
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar).
• Strong software design, architecture, and problem-solving skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design and develop AI-powered applications using Python.
• Build and maintain RAG-based solutions and AI agent workflows.
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek.
• Develop APIs, services, and integrations that support AI-powered workflows.
• Design and optimize solutions using SQL, NoSQL, and vector databases.
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions.
• Evaluate emerging AI technologies and recommend improvements to the platform.

Skills

Python

LangChain

LLMs experience

RAG solutions

AI agents

SQL/NoSQL

APIs & Cloud

Observability tools

Workflow orchestration

Team collaboration

Tools

Docker

Kubernetes

Airflow

Dagster

Prefect

Job description

ACA Group, a leading governance, risk, and compliance advisor in financial services, seeks an AI Software Engineer in a hybrid role (Pittsburgh or Durham). You will design and build intelligent applications leveraging LLMs, RAG, and AI agents to help clients manage compliance and risk.

Collaborate with product, engineering, and compliance teams to develop APIs and scalable AI-powered workflows using Python, SQL/NoSQL, and vector databases for secure, enterprise-grade solutions.