AI Engineer II

CSI; Charlotte (NC); On-site; USD 120,000 - 160,000; Full time

Job summary

CSI in Charlotte, NC seeks an AI Engineer II to independently develop and support AI engineering capabilities for reusable, secure, and scalable AI-enabled software delivery.

The role builds AI Harness components, agent frameworks, evaluation systems, and developer workflows while partnering with engineering teams to deliver reliable AI-enabled solutions across the SDLC. Includes on-call responsibilities and governance considerations.

Qualifications

• Bachelor's degree or equivalent in a technical field.
• Strong programming skills, preferably Python and modern development languages.
• Experience with APIs, services, integrations, automated tests, and cloud apps.
• Experience with LLM patterns, prompt engineering, and AI-assisted development tools.

Responsibilities

• Design, build, test, and maintain AI platform components, services, connectors, and internal tools.
• Implement model routing, prompt execution patterns, and reusable utilities.
• Improve reliability, performance, observability, and usability of AI engineering tools.
• Support production operations for AI-enabled services, including monitoring and triage.

Skills

Python programming

LLM patterns

Prompt engineering

Agent frameworks

Cloud-based apps

Incident response

Education

Bachelor's degree in Computer Science, Software Engineering, AI, Information Systems, or related field

Job description

Job Description

The AI Engineer II independently develops and supports AI engineering capabilities that enable reusable, secure, and scalable AI-assisted software delivery. This role builds components of the AI Harness, agent frameworks, evaluation systems, and developer workflow tools, while partnering with engineering teams to translate practical delivery needs into reliable AI-enabled solutions. The AI Engineer II contributes to production-quality AI applications and helps improve the consistency, safety, and usefulness of AI-supported engineering workflows.

Develop AI Harness & Platform Capabilities
Design, build, test, and maintain well-defined AI platform components, services, connectors, and internal tools.
Implement model routing, prompt execution patterns, API integrations, and reusable utilities aligned to platform standards.
Improve reliability, performance, observability, and usability of AI engineering tools.
Support production operations for AI-enabled services, including troubleshooting, monitoring, and issue remediation.
May be responsible for on-call rotation and front-line incident response for AI-enabled production services, including triage, escalation, and remediation.
Implement agent behaviors, tool calls, structured workflows, and integration logic that support AI-assisted SDLC use cases.
Partner with more senior engineers to refine shared libraries and reduce duplicate AI engineering work across teams.
Build and maintain evaluation workflows for prompts, agents, tools, and AI-generated outputs.
Develop automated tests, regression checks, quality benchmarks, and validation approaches for AI-enabled capabilities.
Support versioning, release management, rollback readiness, and lifecycle management for prompts, agents, and AI components.
Analyze model and agent behavior to identify quality, cost, latency, security, or reliability concerns.

Apply AI Security & Governance Controls
Embed approved logging, access control, data classification, and risk controls into AI-enabled workflows.
Work with security and governance partners to address implementation requirements for responsible AI use.
Validate that AI tools and agents are handling sensitive data appropriately and operating within defined guardrails.
Support remediation of security, compliance, or audit findings related to AI engineering solutions.

Partner with Engineering Teams on AI-Assisted Delivery
Collaborate with software engineering teams to understand delivery pain points and identify AI-enabled workflow improvements.
Build examples, templates, and golden-path patterns that accelerate adoption of shared AI engineering capabilities.
Support onboarding, technical guidance, and issue resolution for engineering users of AI platform tools.
Contribute to team standards, documentation, and communities of practice around AI-assisted development.

Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Information Systems, or a related technical field, or equivalent work experience, with typically 5+ years of experience in software engineering, AI engineering, ML engineering, platform engineering, automation, or developer productivity roles.
Strong programming skills are required, preferably in Python and one or more modern application development languages.
Candidates should have experience building APIs, services, integrations, automated tests, and cloud-based applications.
Experience with LLM application patterns, prompt engineering, RAG, agent frameworks, LLMOps, evaluation techniques, or AI-assisted development tools is strongly preferred.

As a forward-thinking software provider, Computer Services, Inc. (CSI) helps community and regional financial institutions solve their customers' needs through open and flexible technologies. In addition to its award-winning core banking platform, these include the latest in lending, digital banking, payments, financial crime prevention and cybersecurity. Building on its 60-year track record of personalized service, CSI is shaping the future of banking and empowering its customers to rival their competition. Along with a competitive salary, this position includes eligibility for incentive awards based on both individual and business performance. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, physical and mental disability, marital status, veteran status, or any other characteristic protected by applicable law. For applicants residing in California, please read Privacy Notice for California Residents | CSI (csiweb.