Quality Engineer III (AI and ML Platforms)

ICW INSURANCE COMPANY OF THE WEST; Baxter Village (SC); On-site; USD 95,378 - 160,850; Full time

Benefits offered by this job

Medical, dental, and vision plans

401(k) retirement plan with company match

Bonus potential

Paid Time Off and holidays

Learning and development support

Job summary

ICW INSURANCE COMPANY OF THE WEST is looking for a QA Engineer for AI and ML Platforms to enhance quality engineering practices for cloud-native solutions. The role involves defining test strategies, leading QA efforts, and implementing automated testing within CI/CD pipelines.

Ideal candidates will possess a Bachelor's degree, a minimum of 4 years of experience, and expertise in AWS and testing ML frameworks. Excellent communication and problem-solving skills are essential.

Qualifications

• Minimum 4 years of related QA experience.
• Ability to work independently and adapt to different processes.
• Experience with testing ML frameworks and tools.

Responsibilities

• Establish quality engineering practices for cloud-native and AI/ML platform solutions.
• Execute and maintain automated regression test suites.
• Define observability and quality signals for production systems.

Skills

SQL

Automation frameworks

User behavior analysis

AI/ML pipeline validation

Data validation

Customer service mentality

Education

Bachelor’s degree in Computer Science or related field

Tools

AWS

Terraform

Selenium

Snowflake

Job description

Are you looking to make an impactful difference in your work, yourself, and your community? Why settle for just a job when you can land a career? At ICW Group, we are hiring team members who are ready to use their skills, curiosity, and drive to be part of our journey as we strive to transform the insurance carrier space.

Purpose of Job

The QA Engineer for AI and ML Platforms establishes and evolves quality engineering practices for cloud‑native and AI/ML platform solutions, ensuring reliability, scalability, and reproducibility across data, model, and infrastructure layers. The position serves as a key contributor in defining test strategies for distributed systems, data pipelines, and machine learning workflows within AWS and Snowflake environments.

Essential Duties and Responsibilities

• Execute tasks that span across multiple systems/processes for one or more business projects/areas.
• Review, analyze, and evaluate business and IT systems and user needs to determine the best test approach.
• Estimate, prioritize, plan, and coordinate test activities.
• Identify, record, thoroughly document, and track bugs.
• Partner with the Development team to perform API‑based testing between applications.
• Track quality assurance metrics including defect densities and open defect counts.
• Influence quality engineering best practices within the scrum team.
• Execute and maintain automated regression test suites using open‑source tools.
• Apply standards in accordance with company policy and regulation (MAR, HIPAA, ISO 2700, ISO 27001, etc.).
• Recommend process improvement and implement approved quality enhancements.
• Audit test deliverables to ensure they meet standards and take corrective action to mitigate variances.
• Lead QA efforts for large initiatives and collaborate closely with external vendor partners (offshore, nearshore).
• Develop detailed, comprehensive, and well‑structured test plans and test cases.
• Publish and implement test strategies, plans, and scripts.
• Design and execute testing strategies for AI/ML applications and pipelines, including validation of models, data, inference, integration, and API testing.
• Implement testing strategies for infrastructure as code, validating AWS resources provisioned via Terraform or CloudFormation.
• Establish automated quality gates within CI/CD pipelines to enforce testing standards across build, deploy, and release stages.
• Define observability and quality signals (logs, metrics, traces) to proactively detect defects in production systems.
• Contribute to debugging and root cause analysis across application, data, and platform layers.
• Lead validation of non‑functional requirements including performance, scalability, reliability, and resiliency of AI and ML platforms.

Supervisory Responsibilities

This role does not have direct reports but may mentor and/or train less experienced team members.

Education and Experience

Bachelor’s degree in Computer Science, Information Systems, or related field, or equivalent work experience.

Minimum 4 years of related experience and 5 years of IT and/or relevant business experience.

Certifications, Licenses, Registrations

• Certified Software Test Engineer (CSTE) or International Software Testing Qualification Board (ISTQB) preferred.
• CP‑SAT Selenium Automation Testing certification preferred.
• Foundation level API certification preferred.

Knowledge and Skills

• Ability to anticipate user behavior or risks to systems and work independently.
• Experience querying and using data to enhance testing approach/scope.
• Rapid understanding of domain expertise with complex existing applications and architecture.
• Validate data transformations and perform end‑to‑end validations for ETL/API‑enabled integrated systems.
• Work effectively with geographically remote and culturally diverse teams.
• Analyze requirements to reduce ambiguity and increase testability; develop and review test plans, cases, and scripts.
• Mentor junior QA team members.
• Knowledge of Insurance Industry best practices and business workflows a plus; industry standard QA certification strongly desired.
• Customer‑service mentality to resolve/avoid conflict and enable a team approach.
• Excellent verbal communication with teams, stakeholders, and management.
• Ability to learn, analyze, and interpret technical documentation such as software requirements, detailed designs, flow charts, and database schemas.
• Strong SQL skills and experience building automation frameworks.
• Understanding of software development life cycle processes; testing methodologies and proper application.
• Work effectively in Agile/Scrum and Waterfall frameworks.
• Automation feasibility definition and hands‑on execution experience; train others on automation practices and tools.
• Experience testing ML frameworks and tools, preferably SageMaker, MLFlow, SnowflakeML.
• Experience validating data platforms, ETL/ELT pipelines, or data warehousing solutions such as Snowflake.
• Hands‑on experience on AI/ML pipeline validation, data validation, model validation, integration and API testing.
• Experience implementing automated testing within CI/CD pipelines and working in DevOps‑oriented environments.
• Experience testing cloud platforms and cloud resource provisioning (AWS preferred), IaC, containerization tools like Docker and Kubernetes.

Physical Requirements

This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines. Occasional work environment may be loud.

Work Environment

This position operates in an office environment and requires the frequent use of computer, telephone, copier and other standard office equipment.

Employment and Compensation

We are currently not offering employment sponsorship for this opportunity. The current range for this position is $95,378.98 – $160,850.17. This range is exclusive of fringe benefits and potential bonuses. Salary will be determined by factors unique to each candidate, including experience, education and the location of the role.

Benefits

• Competitive benefits package including medical, dental, and vision plans.
• 401(k) retirement plan with company match.
• Bonus potential for all positions.
• Paid Time Off and paid holidays throughout the calendar year.
• Learning and development support.

ICW Group is committed to creating a diverse environment and is proud to be an Equal Opportunity Employer. ICW Group will not discriminate against an applicant or employee on the basis of race, color, religion, national origin, ancestry, sex/gender, age, physical or mental disability, military or veteran status, genetic information, sexual orientation, gender identity, gender expression, marital status, or any other characteristic protected by applicable federal, state or local law.