Junior AI Software Engineer — Hybrid (Python, LLMs)

International Business Machines Corporation; Durham (NC); Hybrid; USD 101,000 - 151,000; Full time

Job summary

IBM Software in Durham, North Carolina is seeking an Entry Level AI Software Engineer to help design, build, and test AI-powered features. You’ll work with experienced engineers to integrate LLMs, APIs, and enterprise data, turning research into reliable software.

The role emphasizes hands-on prototype work, debugging, and clear communication as you translate problems into concrete requirements, testable criteria, and demonstrations of impact.

Qualifications

• Strong software fundamentals across data structures, algorithms, design and testing.
• Proficiency in Python and building apps/services that integrate APIs.
• Hands-on experience building an application or prototype with LLMs.
• Systematic debugging mindset to investigate failures and reason about interactions between code, data, and models.
• Ability to translate problems into clear requirements, prompts, and testable acceptance criteria; evaluate AI-generated outputs.
• Familiarity with Git, clear technical communication, and collaboration.

Responsibilities

• Design, build, and test AI-powered features addressing real developer and client needs, with guidance from experienced engineers.
• Integrate LLMs, APIs, and enterprise data into applications, exploring tool calls and retrieval where appropriate.
• Write specifications and prompts, use AI development tools thoughtfully, and review and test produced code.
• Evaluate AI behavior with realistic test cases, measure quality and performance.
• Debug across model interactions, application code, APIs, and underlying systems to identify root causes and build reliable solutions.
• Collaborate via Git, code reviews, and technical discussions; document work and iterate on feedback.

Skills

Software fundamentals

Python proficiency

LLMs experience

Git

APIs integration

Education

High School Diploma/GED

Bachelor's Degree preferred

Job description

IBM Software in Durham, North Carolina is seeking an Entry Level AI Software Engineer to help design, build, and test AI-powered features. You’ll work with experienced engineers to integrate LLMs, APIs, and enterprise data, turning research into reliable software.

The role emphasizes hands-on prototype work, debugging, and clear communication as you translate problems into concrete requirements, testable criteria, and demonstrations of impact.