LLM AI Engineer - Build Production AI Apps

Codeconnect Staffing; Johannesburg; On-site; ZAR 600,000 - 900,000; Full time

Job summary

Codeconnect Staffing is seeking a mid-level AI Engineer to join a newly established AI Engineering team within an international technology-enabled organisation operating in the tax, compliance and regulatory space. You will design, build, deploy and scale LLM-powered applications that solve real-world business problems and move rapidly into production.

As part of a founding AI team, you will influence technical architecture, engineering standards and how AI solutions are developed across the

Qualifications

• 2+ years of software engineering experience.
• Relevant Degree in Computer Science, Engineering or similar.
• Hands-on experience with LLM APIs, prompting, retrieval/RAG and structured outputs.
• Experience developing and working with APIs.
• Comfortable working across different areas of an application when required.
• Strong problem-solving skills with a practical, delivery-focused mindset.
• Clear communication skills and the ability to explain technical decisions to non-technical stakeholders.
• A proactive, self-starting approach with the ability to work effectively in a developing technical environment.

Responsibilities

• Design and deliver LLM-powered applications, including RAG, structured extraction and AI agents.
• Build AI solutions from prototype through to production.
• Develop evaluation frameworks, datasets, scoring and regression testing.
• Build and maintain production APIs and services.
• Monitor solution performance, reliability, cost and latency.
• Work with subject-matter experts to translate complex domain knowledge into AI product behaviour.
• Develop reusable patterns for prompts, guardrails, data contracts and human-review workflows.
• Contribute to technical and architectural decisions within the growing AI function.

Skills

Software engineering

LLM APIs

Prompting

APIs

RAG

Structured outputs

Education

Bachelor's degree in Computer Science or related

Tools

Python

TypeScript

PostgreSQL

FastAPI

Cloud Infrastructure

Job description

Codeconnect Staffing is seeking a mid-level AI Engineer to join a newly established AI Engineering team within an international technology-enabled organisation operating in the tax, compliance and regulatory space. You will design, build, deploy and scale LLM-powered applications that solve real-world business problems and move rapidly into production.

As part of a founding AI team, you will influence technical architecture, engineering standards and how AI solutions are developed across the