AI Software Development Engineer in Test

Intellibee; New Brunswick; On-site; CAD 60,000 - 80,000; Full time

Job summary

A leading technology company in Canada, New Brunswick is looking for an AI Software Development Engineer in Test. The ideal candidate will have over 5 years of automation testing experience, particularly with functional and API testing. Responsibilities include implementing test strategies and ensuring the highest quality standards across projects. Proficiency in Python and experience with AWS services like S3 and Lambda are essential. This role offers an opportunity to shape testing practices in an innovative environment.

Qualifications

• 5+ years of experience in testing automation engineering with both functional & API based testing.
• Proficiency writing code in Python.
• Experience writing end to end test scripts utilizing multiple services and reporting results.

Responsibilities

• Help create a culture that motivates teams to ensure zero defects leak into production.
• Work across teams to understand enterprise quality requirements.
• Comprehend and decompose user stories/requirements for test creation.

Skills

Testing automation engineering

Python programming

SQL querying

AWS services

CI/CD technologies

AI paradigms

Education

BS/MS in Computer Science or related field

Tools

Git

Docker

Spacy

nltk

Job description

AI Software Development Engineer in Test, Charlotte, NC, US

AI Software Development Engineer in Test

Responsibilities:

• Help create a culture that motivates teams to ensure zero defects leak into production.
• Work across teams to understand enterprise quality requirements and ensure adoption of core processes and standards.
• Implement the shift-left test strategy for each line of business
• Leverage open-source automation frameworks and tools across all levels of testing that integrate in the automated CI/CD pipeline.
• Participate in the Agile (Scrum) team process, perform required standard testing activities keeping the customer experience top of mind during the testing process.
• Work with internal teams to document test environment and test data management container strategies and provisioning for the different types of testing activities.
• Comprehend and decompose user stories/requirements to identify what tests need to be created and automated across all levels of testing.

Qualifications:

• 5+ years of experience in testing automation engineering with both functional & API based testing
• Preferred BS/MS in Computer Science, Engineering, or related subject

Required Skills & Experience

• Proficiency writing code in Python
• Experience writing end to end test scripts utilizing multiple services and reporting results
• Experience using SQL to join and query data across multiple tables and schemas
• Experience with AWS services including
  • S3, Lambda, Dynamo DB, Cloudwatch, etc
• Experience with CI/CD supporting technologies
  • GIT, GitLab, Docker
• Experience with up-to-date AI paradigms
  • Large language models
  • Classification models
  • MCP
  • RAG
  • Dynamic prompting for LLMs

Preferred Skills & Experience

• Experience automating API tests and extensive knowledge of creating and leveraging mocks, stubs, and virtual services to fulfill test automation requirement
• Automating tests for the full solution stack (unit, business logic, contract, usability, functional, performance)
• Experience testing AI implementations and an understanding of the risks models pose to systems and the business at large

Major plus with direct experience in the following

• Experience leaving feedback on Merge/Pull Requests to ensure teams follow best practices
• Financial services technology / consumer banking testing experience
• Experience with Genesys IVR and Salesforce is a plus

Extensive knowledge of:

• White Box Testing practices
• Software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control, build and release processes, continuous integration and continuous deployment concepts (CI & CD), and test suite development and maintenance

Working knowledge of:

• Commonly used ML/AI Python libraries/packages
  • Spacy, nltk, etc
• Experience in troubleshooting issues and root cause analysis
• Possesses a deep understanding of shift-left test practices and techniques along with the frameworks, and tools that support it.
• Strong written and verbal communication skills.
• Enthusiastic and energetic with an inherent curiosity to break code.