Software Development Engineer In Test

American AI Logistics; Colorado Springs (CO); On-site; USD 100,000 - 150,000; Full time

Job summary

American AI Logistics is hiring a Software Development Engineer in Test (SDET) to own quality across a cloud-based B2B SaaS platform for government procurement workflows. You will design test strategies, build frameworks in TS/JS, and implement API, integration, and E2E tests across multiple services.

You’ll ensure data integrity, security, and scalability with CI/CD gates and performance testing. The role emphasizes testing AI-powered extraction and generation pipelines, non-deterministic

Qualifications

• 3+ years of experience in a software engineering or SDET role with daily test automation development.
• Strong TypeScript or JavaScript skills—writing test code, fixtures, mocks and utilities in the same language as the app.
• Deep experience with a modern test framework (Jest, Vitest, Mocha) including lifecycle hooks and mocks.
• Experience testing REST APIs programmatically, including auth boundaries and error handling.
• Strong SQL skills; ability to verify data integrity with setup/teardown queries and migrations.
• Experience writing integration tests with real databases and tenant isolation; test transactions and deterministic seeding.
• Familiarity with CI/CD and test gates; configure tests and triage failures.
• Understanding of async/event-driven architectures; testing queues and async results.

Responsibilities

• Design and implement a comprehensive test strategy across a multi-service architecture.
• Build and maintain test frameworks in TypeScript/Jest and Go as platform evolves.
• Define coverage standards focused on critical business logic and data integrity.
• Create automated API test suites for a NestJS backend with 50+ modules.
• Test multi-tenant data isolation and cross-tenant access controls.
• Develop integration tests spanning services via queues; test LLM-dependent pipelines.
• Implement E2E UI tests using Playwright or Cypress for the React frontend.
• Optimize CI/CD integration; establish quality gates and performance tests.

Skills

TypeScript

JavaScript

Test frameworks

REST API testing

SQL/Relational DB

CI/CD pipelines

Tools

NestJS

Prisma

PostgreSQL

React

Playwright

Cypress

RabbitMQ

OpenAI

Job description

Software Development Engineer in Test

SDET, Quality Engineering & Test Automation

About the Role

We’re looking for an SDET to build and own the quality engineering practice for a cloud-based B2B SaaS platform that automates U.S. government procurement workflows using AI. The platform ingests solicitations, processes documents with LLMs, automates supplier communications, generates predictions, and produces bid-response documents, each of these workflows has real business consequences when something breaks. This is not just a manual QA role. You’ll write code every day, building test frameworks, automating regression suites, hardening CI pipelines, and creating tooling that makes the entire engineering team ship with confidence. You’ll be the person who defines what “tested” means for this product and builds the infrastructure to enforce it. The platform operates under SOC 2 controls for security, availability, and confidentiality. Test coverage isn’t optional, it’s part of how we demonstrate that changes are controlled and verified before they reach production.

What You’ll Work On

Test Strategy & Framework

Designing and implementing a comprehensive test strategy across a multi-service architecture , defining the right mix of unit, integration, contract, and end-to-end tests for each service boundaryBuilding and maintaining test frameworks in TypeScript (Jest) and potentially Go as the platform evolves , including shared test utilities, fixtures, factories, and assertion helpersEstablishing test data management patterns, database seeding, tenant-scoped test isolation, deterministic fixture generation, and teardown strategies that allow parallel test executionDefining and enforcing coverage standards, not vanity metrics, but meaningful coverage of critical business logic, data integrity paths, and failure modes

API & Integration Testing

Building automated API test suites for a NestJS backend with 50+ modules, validating request/response contracts, authorization boundaries, tenant isolation, error handling, and pagination behaviorTesting multi-tenant data isolation rigorously, verifying that row-level security policies, tenant-scoped queries, and cross-tenant access controls work correctly under every code pathWriting integration tests for async workflows that span multiple services via message queues, verifying that jobs enqueued by the API are correctly processed by downstream workers and results are persisted accuratelyTesting LLM-dependent workflows, designing strategies to test AI-powered extraction, prediction, and generation pipelines where outputs are non-deterministic. This includes building mock/stub LLM responses, validating output schema compliance, and testing graceful degradation when LLM calls fail or return unexpected formatsTesting email integration workflows, verifying that inbound email parsing, attachment extraction, outbound RFQ dispatch, and response parsing produce correct results across providers (Gmail, Microsoft Graph)

Database & Data Integrity Testing

Writing tests that validate schema migrations, verifying that migrations apply cleanly, preserve existing data, and that rollbacks work when neededTesting row-level security policies directly, asserting that queries executed with one tenant’s context cannot access another tenant’s data, including edge cases around shared resources and cross-tenant relationshipsValidating data consistency across async pipelines, when a bid is ingested, items extracted, prices resolved, and proposals generated across multiple services, the final database state must be correct and completeTesting materialized view refresh behavior and ensuring reporting/dashboard queries return accurate results after data mutations

CI/CD Integration & Quality Gates

Integrating test suites into CI/CD pipelines as blocking quality gates, tests must pass before code can be promoted from develop to staging to productionOptimizing test execution time, parallelization, selective test running based on changed files, caching strategies, and identifying flaky tests for quarantine and repairBuilding smoke test and health-check suites that run post-deployment to verify that production services are functioning correctly after each releaseIntegrating with existing CI scanning tools (SAST, dependency scanning, IaC scanning) and ensuring test results are visible and actionable in the deployment workflow

E2E & UI Testing

Building end-to-end test suites for critical user workflows in the React frontend , bid ingestion, item management, email automation configuration, proposal generation, and prediction reviewImplementing browser-based testing using Playwright or Cypress, with stable selectors, retry strategies, and clean environment setup/teardownTesting document generation outputs (DOCX, XLSX, CSV, PDF) , verifying that template placeholder substitution produces correct documents with accurate data, proper formatting, and no corruption

Performance & Reliability Testing

Identifying and testing performance-critical paths , large bid list queries, bulk item extraction jobs, concurrent LLM processing, and high-volume email ingestionBuilding load and stress test scenarios for API endpoints and async job processing pipelines to validate system behavior under sustained throughput and burst conditionsTesting failure modes and resilience , message queue unavailability, LLM provider timeouts, database connection exhaustion, and S3 access failures. Verifying that the system degrades gracefully and recovers correctly

What We’re Looking For

Required

• 3+ years of experience in a software engineering or SDET role where you wrote test automation code daily, not just test plans
• Strong TypeScript or JavaScript skills , you’ll be writing test code, fixtures, mocks, and utilities in the same language as the application
• Deep experience with a modern test framework (Jest, Vitest, Mocha, or equivalent) including test lifecycle hooks, mocking/stubbing, snapshot testing, and custom matchers
• Experience testing REST APIs programmatically , building request factories, validating response schemas, testing auth/authz boundaries, and asserting error handling behavior
• Strong understanding of relational databases and SQL , you need to verify data integrity directly, write setup/teardown queries, and validate that application behavior produces correct database state
• Experience writing integration tests that interact with real databases (not just mocks) , managing test transactions, tenant-scoped test isolation, and deterministic seeding
• Familiarity with CI/CD pipelines and how automated tests integrate as quality gates , you’ve configured test jobs, managed test environments, and triaged pipeline failures
• Understanding of async/event-driven architectures , you’ve tested systems where work is dispatched via queues and results arrive asynchronously, and you know the patterns for making those tests reliable
• Comfort reading and understanding production application code , you’ll need to trace logic through controllers, services, and data layers to understand what to test and where the risk lives
• Clear communication skills , you’ll define quality standards, explain test failures to developers, and advocate for testing investment to leadership

PreferredExperience

• Experience testing LLM/AI-integrated applications , mocking non-deterministic responses, validating structured output parsing, testing prompt/response contracts, and measuring extraction accuracy
• Experience with Playwright or Cypress for browser-based E2E testing, including managing test environments, handling auth flows, and maintaining stable test suites against a changing UIF
• Familiarity with NestJS or similar DI-based backend frameworks , understanding how to leverage dependency injection for test doubles and module-scoped test isolation
• Experience testing multi-tenant SaaS applications , validating tenant isolation, cross-tenant access controls, and data scoping under concurrent usage
• Familiarity with Prisma ORM or similar , writing test utilities that seed, query, and clean up data through the same ORM the application uses
• Experience with contract testing (Pact or similar) for validating API contracts between independently deployed services
• Exposure to performance testing tools (k6, Artillery, Locust, or similar) for API and job pipeline load testing
• Experience validating document outputs (DOCX, XLSX, PDF) programmatically , parsing generated files and asserting content correctness
• Background in a compliance-regulated environment (SOC 2, ISO 27001, FedRAMP) where test evidence is part of the audit story
• Experience with Go testing patterns (if you’ll also cover new Go microservices as the platform evolves)

Tech Environment

CategoryTechnologiesLanguagesTypeScript (primary), Go (emerging)Test FrameworkJest (current), Playwright or Cypress (E2E)BackendNestJS, Prisma ORM, PostgreSQLFrontendReactMessagingRabbitMQ (Amazon MQ)AI / MLOpenAI