Inperson Interview_AI SDET_NY

Themesoft Inc; New York (NY); On-site; USD 83,000 - 124,000; Part time

Job summary

Themesoft Inc. seeks an experienced AI SDET for a 6-month onsite contract in New York, NY. The role emphasizes Java and/or Python excellence, Playwright UI automation, and robust API testing across microservices and distributed systems.

You will lead automated quality gates, integrate with CI/CD, and apply AI/GenAI techniques to design-driven testing. Candidates should demonstrate strong debugging, performance testing, and experience with AI evaluation, MCP, and SDD.

Qualifications

• Expert-level proficiency in Java and/or Python.
• Strong Playwright and API automation experience.
• Experience building automation frameworks from scratch.
• Knowledge of microservices, distributed systems, CI/CD, SQL, observability, and high-availability platforms.
• Experience leveraging AI/GenAI, Prompt Engineering, AI Evaluation, AI Agents, MCP, and SDD.

Responsibilities

• Design and build scalable automation frameworks across UI, API, integration, and event-driven layers.
• Develop robust automation using Java and/or Python with OOP and design patterns.
• Build modern UI automation using Playwright.
• Develop and maintain REST API, microservices, and integration testing frameworks.
• Establish automated quality gates and integrate into CI/CD pipelines.
• Influence system design as a Quality Architect and ensure release readiness.

Skills

Java

Python

Playwright

REST API testing

CI/CD

AI/GenAI

OOP & Design Patterns

Tools

Jenkins

TeamCity

GitHub Actions

Job description

Title: AI SDET

Location: New York, NY (Onsite) (F2F Interview required)

Work Arrangement: Onsite

Employment Type: Contract

Duration: 6 Months

Primary Skills: AI, SDET, Java/Python

Role Overview

The ideal candidate will have expert-level Java and/or Python, strong Playwright and API automation experience, hands-on expertise building automation frameworks from scratch, and a solid understanding of microservices, distributed systems, CI/CD, SQL, observability, and high-availability platforms.

The candidate will work closely with developers, architects, and engineering teams to ensure quality is designed in, automated, observable, and enforced throughout the SDLC. Experience leveraging AI/GenAI, Prompt Engineering, AI Evaluation, AI Agents, MCP, and Spec-Driven Development (SDD) is required.

Key Responsibilities

Quality Engineering & Automation

• Design and build scalable automation frameworks from scratch across UI, API, integration, and event-driven layers.
• Develop robust automation using Java and/or Python, applying OOP, Data Structures, and Design Patterns.
• Build modern UI automation solutions using Playwright.
• Develop and maintain strong REST API, microservices, and integration testing frameworks.
• Implement practical and maintainable BDD solutions.
• Establish automated quality gates and integrate them into CI/CD pipelines.
• Act as a Quality Architect, influencing system design, testability, automation strategy, and release readiness.
• Engineer quality across microservices, distributed systems, and high-availability platforms.
• Drive continuous improvement in automation coverage, reliability, maintainability, and execution efficiency.

Reliability & Distributed Systems

• Test and validate high-availability, low-latency, and mission-critical systems.
• Design and execute performance, load, stress, resilience, and reliability testing.
• Validate microservices and event-driven architectures across distributed environments.
• Troubleshoot application and test failures using logs, metrics, and distributed traces.
• Leverage production telemetry and observability data to identify quality risks and improve QE strategy.
• Participate in incident triage, root cause analysis, production validation, and release certification.

AI / GenAI & Spec-Driven Engineering

• Leverage AI/GenAI tools to accelerate test design, automation development, coding, debugging, and test analysis.
• Apply Prompt Engineering and context management techniques to improve AI-assisted engineering workflows.
• Design and execute AI evaluation frameworks to validate AI-generated code, tests, and outputs.
• Apply Spec-Driven Development (SDD) to align specifications, implementation, automation, and validation.
• Develop and integrate AI Agents, skills, and Model Context Protocol (MCP) integrations.
• Safely integrate AI-assisted quality engineering workflows into CI/CD pipelines.
• Establish verification practices for AI-generated outputs and ensure responsible use of AI in engineering processes.

Quality Ownership

• Own end-to-end production quality, from test strategy through release certification and production validation.
• Define and maintain effective regression testing strategies.
• Partner with developers and architects to identify defects and quality risks early in the SDLC.
• Support production releases and incident triage, including participation in on-call rotations.
• Perform root cause analysis and drive corrective and preventive actions.
• Ensure quality standards are consistently applied across development, testing, deployment, and production environments.

Required Qualifications

• Expert-level proficiency in Java and/or Python.
• Strong understanding of Object-Oriented Programming, Data Structures, and Design Patterns.
• Proven experience building test automation frameworks from scratch.
• Hands-on expertise with Playwright for modern UI automation.
• Strong experience in REST API, integration, and microservices testing.
• Strong understanding of SQL, backend data stores, and data validation.
• Hands-on experience with CI/CD and automated quality gates.
• Experience with Jenkins, TeamCity, and/or GitHub Actions.
• Strong understanding of microservices and distributed/event-driven architectures.
• Experience testing high-availability and low-latency systems.
• Experience with performance, load, stress, and resilience testing.
• Strong debugging skills using logs, metrics, and traces.
• Practical experience implementing BDD frameworks.
• Hands-on experience with AI/GenAI for engineering and test automation.
• Strong Prompt Engineering and AI context-management skills.
• Experience with AI evaluation frameworks and validating AI-generated code/tests.
• Proven experience with Spec-Driven Development (SDD).
• Experience developing or integrating AI Agents, skills, and MCP integrations.
• Strong understanding of Quality Engineering and SDET practices.

Technical Skills

Programming: Java, Python, OOP, Data Structures, Design Patterns

AI/GenAI: GenAI, Prompt Engineering, AI Evaluation Frameworks, AI Agents, MCP, Context Management

UI Automation: Playwright, Test Automation Frameworks

API & Integration: REST API Testing, Microservices Testing, Integration Testing, Event-Driven Testing

Testing: Functional, Regression, BDD, Performance, Load, Stress, Resilience, Reliability Testing

Data: SQL, Backend Data Stores, Data Validation, Reconciliation

CI/CD: Jenkins, GitHub Actions, TeamCity, Automated Quality Gates

Observability: Logs, Metrics, Traces, Production Telemetry

Engineering Practices: Spec-Driven Development (SDD), Quality Engineering, SDET, Release Certification, Incident Triage, Root Cause Analysis

WorkAuthorization

ApplicantsmustbelegallyauthorizedtoworkintheUnitedStates.

EqualEmploymentOpportunity

ThemesoftIncisanEqualEmploymentOpportunityemployer.Weconsiderqualifiedapplicantswithoutregardtorace,color,religion,sex,sexualorientation,genderidentity,nationalorigin,age,disability,veteranstatus,oranyotherstatusprotectedbyapplicablefederal,state,orlocallaw.

Skills :

AUTOMATION,API,PYTHON,OBJECT-ORIENTED PROGRAMMING,JAVA,AUTOMATION FRAMEWORKS,OOP,SQL,DATA STRUCTURES,AI,INTEGRATION TESTING,TESTING,CI/CD