Senior Software Engineer, AI/ML

CNA Insurance; Chicago (IL); Hybrid; USD 72,000 - 141,000; Full time

Job summary

CNA Insurance is seeking a Senior Python AI Developer in Chicago to build intelligent agents using Google Vertex AI with Gemini or OpenAI. You will advance LLM-based solutions, implement robust prompt engineering, and ensure secure and scalable AI systems.

The role requires hands-on experience with LangChain, LangGraph, LangSmith and observability tools, plus strong testing workflows. This hybrid role offers collaboration across IT and product teams.

Qualifications

• Senior Python developer with AI/ML experience.

Responsibilities

• Evaluate client area requirements and develop complex application solutions.

Skills

Python AI

LLMs

Vertex AI

Gemini/OpenAI

Prompt Engineering

LangChain

LangGraph

Context Filtering

Prompting Security

Observability Tools

LangSmith

LangFuse

Phoenix

Arize

Eval AI Testing

Education

Bachelor's degree in Computer Science or related discipline

Tools

LangChain

LangGraph

Vertex AI

Gemini

OpenAI

Phoenix

LangSmith

LangFuse

Arize

Job description

You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential. We are looking for a highly skilled Senior Python AI Developer with deep expertise in building intelligent agents using Google Vertex AI, particularly with Gemini or OpenAI models. The ideal candidate has a strong foundation in Large Language Models and understands how they work under the hood, combined with experience in evaluating model performance through structured testing methodologies.

This role requires proficiency in the technical aspects of agent development while adhering to best practices in prompt engineering, context filtering, and security-aware prompting. The candidate should also have hands-on experience with modern agent frameworks and observability tools, ensuring robust, scalable, and reliable AI solutions. JOB DESCRIPTION: Essential Duties & Responsibilities:

Essential Duties & Responsibilities

• Performs a combination of duties in accordance with departmental guidelines: Evaluates defined client area requirements and processes (e.g., new enhancements or maintenance) and detailed designs and develops moderate to complex application program solutions.
• Ensures quality of application solutions by performing code review with peers, creating documentation, implementing code, verifying program logic, performing defect root cause analysis, and completing unit and integration testing.
• Participates in systems testing with other IT staff.
• Assists with the high level design of solutions.
• Consults with the client area to analyze system requirements and capabilities, identify associated risks, and resolve problems.
• May act as a liaison between clients and applications area.
• Researches and evaluates new and/or alternative solutions, and recommends the most efficient and cost effective solution for the systems/program design and develops system specifications and procedures.
• May include integrating vendor applications and consulting resources into existing applications and resources.
• In conjunction with operations area technical staff, supports the implementation of the application into production and testing environments.
• May confer with technical personnel to identify and resolve issues.

Reporting Relationship: Typically Manager or above

Skills, Knowledge and Abilities

Key Required Skills & Experience

• Senior-level proficiency in Python, with experience in AI/ML development
• Strong understanding of Large Language Models (LLMs) and their operational mechanics
• Experience developing AI Agents on Google Vertex AI using Gemini or OpenAI
• Expertise in Prompt Engineering Best Practices
• Hands-on experience with: Google Agent Development Kit LangChain and LangGraph
• Knowledge of Context Filtering and Prompting Security Best Practices
• Familiarity with observability and debugging tools: LangSmith LangFuse Phoenix or Arize
• Experience with Eval AI Testing and model evaluation workflows

Education and Experience

• 1. Bachelor's degree in Computer Science, or related discipline, or equivalent work experience.
• 2. Typically a minimum four years of application program development experience.
• 3. Applicable certificates preferred.

#LI-MR1 #LI-Hybrid

In certain jurisdictions, CNA is legally required to include a reasonable estimate of the compensation for this role. In District of Columbia, California, Colorado, Connecticut, Illinois, Maryland, Massachusetts, New York and Washington, the national base pay range for this job level is $72,000 to $141,000 annually. Salary determinations are based on various factors, including but not limited to, relevant work experience, skills, certifications and location.

CNA offers a comprehensive and competitive benefits package to help our employees - and their family members - achieve their physical, financial, emotional and social wellbeing goals. For a detailed look at CNA's benefits, please visit cnabenefits.com.

CNA utilizes AI-enabled technology during the recruiting process. For more information, please visit our careers page.

CNA is committed to providing reasonable accommodations to qualified individuals with disabilities in the recruitment process. To request an accommodation, please contact [e-mail]

At CNA, we are focused on success, individually and collectively. We pride ourselves on promoting a culture that challenges and engages people.

We strive to connect people, departments and business areas, to function as a team, and to serve our customers and communities with professionalism and respect.

Our dedication to employee engagement, continuous learning and the open exchange of ideas is the cornerstone of our business.

These ideals, combined with our focus on the customer, enable us to explore new market opportunities and build on our success.

Our values, culture and financial strength are what differentiates us from other employers and make CNA the place you want to work.

At CNA, we are committed to advancing a culture of inclusion – one that attracts talent from all walks of life, fosters respect and collaboration, and enables all of our colleagues to do their best work.

At CNA, we have a long standing commitment to the diverse communities in which we live and work. We actively make a difference for the greater good through partnerships, sustainability, initiatives, and working together for a better tomorrow.

Corporate Social Responsibility is not one person, or one department, it's the entire enterprise coming together to make the world a better place.