Senior Software Engineer, AI/ML

CNA; Chicago (IL); On-site; USD 72,000 - 141,000; Full time

Job summary

CNA in Chicago, IL seeks a Senior Python AI Developer to build intelligent agents using Google Vertex AI with Gemini or OpenAI models. Strong LLM fundamentals and hands-on agent development are required.

You will implement prompt engineering, context filtering, and security-aware prompting, evaluate models with structured testing, and work with LangChain, LangSmith, LangFuse, and observability tools to deliver scalable AI solutions.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Typically a minimum of 4 years of application development experience.
• Experience in AI/ML development and agent-based solutions.
• Hands-on with Vertex AI, Gemini or OpenAI models.

Responsibilities

• Evaluates client requirements and designs/implements complex application solutions.
• Ensures code quality via peer reviews, tests, and documentation.
• Acts as liaison between clients and applications team; analyzes system requirements.
• Researches and evaluates new solutions; may integrate vendor tools.
• Supports production and testing environments with operations teams.

Skills

Python AI development

LLMs

Model evaluation

Prompt engineering

Observability

Agent development

Education

Bachelor's degree in Computer Science

Equivalent work experience

Tools

Google Vertex AI

Gemini/OpenAI models

LangChain

LangGraph

LangSmith

LangFuse

Phoenix

Arize

Job description

You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential.

We are looking for a highly skilled Senior Python AI Developer with deep expertise in building intelligent agents using Google Vertex AI, particularly with Gemini or OpenAI models. The ideal candidate has a strong foundation in Large Language Models and understands how they work under the hood, combined with experience in evaluating model performance through structured testing methodologies. This role requires proficiency in the technical aspects of agent development while adhering to best practices in prompt engineering, context filtering, and security-aware prompting. The candidate should also have hands‑on experience with modern agent frameworks and observability tools, ensuring robust, scalable, and reliable AI solutions.

JOB DESCRIPTION

Essential Duties & Responsibilities

• Evaluates defined client area requirements and processes (e.g., new enhancements or maintenance) and detailed designs and develops moderate to complex application program solutions.
• Ensures quality of application solutions by performing code review with peers, creating documentation, implementing code, verifying program logic, performing defect root cause analysis, and completing unit and integration testing. Participates in systems testing with other IT staff.
• Assists with the high level design of solutions. Consults with the client area to analyze system requirements and capabilities, identify associated risks, and resolve problems. May act as a liaison between clients and applications area.
• Researches and evaluates new and/or alternative solutions, and recommends the most efficient and cost effective solution for the systems/program design and develops system specifications and procedures. May include integrating vendor applications and consulting resources into existing applications and resources.
• In conjunction with operations area technical staff, supports the implementation of the application into production and testing environments. May confer with technical personnel to identify and resolve issues.

Reporting Relationship

Typically Manager or above

Skills, Knowledge and Abilities

• Senior-level proficiency in Python, with experience in AI/ML development
• Strong understanding of Large Language Models (LLMs) and their operational mechanics
• Experience developing AI Agents on Google Vertex AI using Gemini or OpenAI
• Expertise in Prompt Engineering Best Practices
• Google Agent Development Kit
• LangChain and LangGraph
• Knowledge of Context Filtering and Prompting Security Best Practices
• LangSmith
• LangFuse
• Phoenix or Arize
• Experience with Eval AI Testing and model evaluation workflows
• Bachelor's degree in Computer Science, or related discipline, or equivalent work experience.
• Typically a minimum four years of application program development experience.
• Applicable certificates preferred.

In District of Columbia,California, Colorado, Connecticut, Illinois, Maryland, Massachusetts, New York and Washington, the national base pay range for this job level is $72,000 to $141,000 annually. Salary determinations are based on various factors, including but not limited to, relevant work experience, skills, certifications and location. CNA offers a comprehensive and competitive benefits package to help our employees – and their family members – achieve their physical, financial, emotional and social wellbeing goals. For a detailed look at CNA’s benefits, please visit cnabenefits.com.

CNA utilizes AI-enabled technology during the recruiting process. For more information, please visit our careers page.

CNA is committed to providing reasonable accommodations to qualified individuals with disabilities in the recruitment process. To request an accommodation, please contact [e-mail]