Entry-Level AI Software Engineer — Flexible Location

International Business Machines Corporation; City of Poughkeepsie (NY); On-site; USD 70,000 - 120,000; Full time

Job summary

IBM in New York is seeking an Entry Level AI Software Engineer to turn advances in large language models into practical software for enterprise systems. You will work with experienced engineers to build AI-powered features, integrate LLMs and APIs, and ensure reliable performance.

You will design clear specifications and prompts, test and debug across model interactions, and collaborate through Git and code reviews to deliver robust solutions.

Qualifications

• Design, build, and test AI-powered features for enterprise needs.
• Integrate LLMs, APIs, and enterprise data into apps.
• Write clear specifications and effective prompts.
• Evaluate AI behavior with realistic test cases.
• Debug across model interactions and underlying systems.
• Collaborate via Git, code reviews, and documentation.

Responsibilities

• Design, build, and test AI-powered features that address real developer and client needs.
• Integrate LLMs, APIs, and enterprise data into applications, exploring agent workflows, tool calling, and retrieval where they fit the problem.
• Write clear specifications and effective prompts, use AI development tools thoughtfully, and review and test the code they produce.
• Evaluate AI behavior with realistic test cases, measure quality and performance, and improve how applications handle incorrect outputs and failures.
• Debug across model interactions, application code, APIs, and underlying systems to understand root causes and build reliable solutions.
• Collaborate through Git, code reviews, and technical discussions; document your work and iterate on feedback.

Skills

AI/ML integration

LLM integration

API integration

Git & code reviews

Testing & QA

Prompt engineering

Technical documentation

Tools

Git

Job description

IBM in New York is seeking an Entry Level AI Software Engineer to turn advances in large language models into practical software for enterprise systems. You will work with experienced engineers to build AI-powered features, integrate LLMs and APIs, and ensure reliable performance.

You will design clear specifications and prompts, test and debug across model interactions, and collaborate through Git and code reviews to deliver robust solutions.