Software Development Engineer in Test (SDET II)

Harvey Nash; Jersey City (NJ); On-site; USD 83,000 - 90,000; Full time

Benefits offered by this job

Referral bonuses

Commuter savings

Mobile payroll app

Voluntary insurance options

Job summary

Harvey Nash is seeking an experienced SDET II to test AI-powered applications and Agentic AI systems in Jersey City. You will design QA strategies, build automation, validate APIs, and support CI/CD for AI-driven platforms.

The role requires 8+ years in software quality engineering, strong Python and UI automation skills, and experience with REST APIs, cloud platforms, and AI evaluation. This is a 12+ month contract in New Jersey with competitive benefits.

Qualifications

• 8+ years in software quality engineering or SDET in Agile.
• Strong Python, PyTest, Pandas and OO principles.
• 6+ years UI automation with Playwright or Selenium.
• 6+ years testing REST APIs and microservices.
• Experience with CI/CD and DevOps.
• Experience with SQL and NoSQL databases.
• Experience with AWS or cloud platforms.
• Understanding prompt engineering and AI evaluation.
• Knowledge of LLMs, RAG, AI agents.

Responsibilities

• Design and execute functional, integration, system and automation tests.
• Apply Shift-Left testing by reviewing requirements early in SDLC.
• Build and maintain UI automation frameworks with Python, PyTest, Playwright.
• Perform manual and automated API testing with standard tools.
• Collaborate with developers, product owners, and DevOps to ensure quality.
• Work with SQL/NoSQL databases for backend validation and data testing.
• Support CI/CD pipelines and integrate automated tests into deployments.
• Create test plans, test cases, data strategies and quality metrics dashboards.
• Manage defect lifecycle with clear quality risk reporting.
• Develop AI test datasets, benchmarks and evaluation frameworks.
• Assist with performance/load testing using JMeter or similar.
• Familiarity with AI observability and monitoring platforms.

Skills

Quality engineering

Python

Pandas

OO programming

AI QA fundamentals

Tools

Playwright

Selenium

REST APIs

CI/CD

SQL

NoSQL

AWS

Job description

Job Title: Software Development Engineer in Test (SDETII)

Location: Jersey City NJ07310-1686

Duration: 12+ Months

US citizens and Green Card Holders and those authorized to work in the US are encouraged to apply. We are unable tosponsor H1b candidates at this time

Job Description:

Role Summary

We are seeking a self-driven Software DevelopmentEngineer in Test (SDET II) with experience testing AI-powered applications,Generative AI solutions, and Agentic AI systems. This role is responsible fordesigning and executing quality engineering activities, developing automationsolutions, validating APIs and integrations, supporting CI/CD and releasereadiness, and promoting a quality-first engineering mindset across traditionaland AI-driven platforms.

Key Experience Requirements

• 8+years of software quality engineering, test automation, or SDET experiencein Agile development environments.
• Strongproficiency in Python, Pytest, Pandas, and object-oriented programmingprinciples.
• 6+years of experience with UI automation frameworks such as Playwright orSelenium.
• 6+years of experience testing RESTful APIs and microservices.
• Hands-onexperience with CI/CD pipelines and DevOps practices.
• Experienceworking with SQL and NoSQL databases.
• Experiencewith AWS or other cloud-based platforms.
• Understandingprompt engineering, prompt validation, hallucination detection, biastesting, guardrail validation, and AI output evaluation.
• Knowledgeof LLMs, Retrieval-Augmented Generation (RAG), AI agents, MCP, andAI-assisted workflows.
• Abilityto develop QA strategies, test frameworks, and automation solutions forAI-driven applications.
• Analytical,problem-solving mindset with continuous learning and quality-firstengineering habits.

Key Responsibilities

• Designand execute functional, integration, system, regression, and automationtesting activities.
• ApplyShift-Left testing practices by participating in requirement reviews anddefining test scenarios early in the SDLC.
• Build,maintain, and enhance UI automation frameworks using Python, PyTest, andPlaywright.
• Performmanual and automated API testing using industry-standard tools andframeworks.
• Collaboratewith developers, product owners, business analysts, and DevOps teams toensure product quality.
• Workwith SQL and NoSQL databases for backend validation and data testing.
• SupportCI/CD pipelines and ensure automated tests are integrated into deploymentprocesses.
• Createtest plans, test cases, test data strategies, and quality metricsdashboards.
• Managelifecycle defect activities and provide clear reporting of quality risks.
• DevelopAI test datasets, benchmarks, evaluation frameworks, and automatedvalidation approaches.
• Experiencewith performance and load testing using JMeter or similar tools.
• Knowledgeof AI observability, model monitoring, and evaluation platforms.
• Experiencewith monitoring tools such as New Relic, Datadog, Splunk, or CloudWatch.

Preferred Qualifications

• Experiencetesting Generative AI and Agentic AI applications.
• Abilityto validate AI outputs for accuracy, reliability, and business relevance.
• Knowledgeof AI agent workflows, prompt testing, hallucination detection, and modelevaluation.
• UnderstandingAI safety, guardrails, security, compliance, and responsible AI practices.
• Experiencewith LangChain, LangGraph, MCP, OpenAI, Anthropic, Azure OpenAI, Kiro orAmazon Bedrock.
• Familiaritywith AI governance, risk management, and AI quality metrics.

A reasonable, good faith estimate of the minimum andmaximum hourly wage for this position is $60 to $65/hr.

Benefits of our contractor

At Harvey Nash, we know that great technologyprofessionals deserve great support. That's why we offer a comprehensive benefits package designed to help you thrive-professionally and personally. From company-contributed medical, dental, and vision plans to a 401(k), we invest in your health and future. You'll also enjoy perks like referral bonuses, commuter savings, a mobile payroll app for easy access to your pay and benefits, and a variety of voluntary insurance options to fit your lifestyle. Join a global IT leader that values your expertise, rewards your contributions, and supports your well-being every step of the way.

* The pay range listed above reflects the expectedstarting salary /Pay rate for this role. This range may be adjusted based onmarket conditions, location, and other relevant factors. The Company willdetermine the final starting salary/Pay rate in consultation with the selectedcandidate(s), in full compliance with applicable laws