Software Quality Engineer

Writer; United States; Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

Employer-covered medical plans

Flexible location and schedule

Company stock options

401k plan with employer contributions

Learning and development stipend

Generous PTO

Job summary

Writer, based in the United States, is seeking a Software Quality Engineer to enhance the quality and performance of our AI-powered platform. You'll implement quality assurance strategies and work closely with cross-functional teams, ensuring product reliability and performance while managing defects.

With a flexible schedule, competitive benefits including stock options and robust medical plans, this role is perfect for those passionate about quality in AI applications and has a collaborative spirit.

Qualifications

• Hands-on experience in software quality assurance or engineering focusing on testing complex systems.
• Strong analytical skills for dissecting complex problems in AI/ML applications.
• Collaborative spirit to connect cross-functional teams and drive quality initiatives.

Responsibilities

• Define and implement comprehensive quality assurance strategies for AI applications.
• Drive continuous improvement of testing processes and automation integration.
• Manage the full defect lifecycle and perform root cause analysis.

Skills

5+ years of experience in software quality assurance

Experience with AI/ML applications

Proficiency in Python or Typescript

CI/CD environment knowledge

Familiarity with cloud platforms (AWS, Azure, GCP)

Tools

GitHub Actions

Modern testing frameworks (e.g., Playwright)

Docker

Kubernetes

Job description

As a software quality engineer at WRITER, you’ll play a critical role in shaping the reliability, performance, and trustworthiness of our AI-powered work orchestration platform

• You’ll be at the forefront of defining and implementing rigorous quality strategies for our enterprise‑grade LLMs and AI agents, directly impacting how hundreds of global companies unlock transformational value through AI
• This is a unique chance to dive deep into the unique challenges of AI quality assurance and make a tangible difference in a rapidly evolving field
• You will report directly to the director of engineering
• Define and implement comprehensive quality assurance strategies and test plans for our AI agents and LLM‑powered applications, ensuring exceptional product reliability and performance
• Designing and developing automation frameworks: creating robust, scalable, and maintainable automated test frameworks from scratch or enhancing existing ones. You’ll need proficiency in at least one language like Typescript, Python
• Collaborate closely with product managers, machine learning engineers, and data scientists to understand complex AI features and model behaviors, translating them into effective test cases and validation criteria
• Drive the continuous improvement of our testing processes and infrastructure, integrating automated checks within our CI/CD pipelines to ensure rapid, high‑quality releases
• Identify, document, and track software defects and inconsistencies, performing root cause analysis to provide actionable feedback to development teams
• Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post‑release quality validation
• Champion quality best practices across engineering teams, fostering a culture of ownership and continuous improvement in delivering world‑class AI solutions
• Designing, managing, and maintaining test data strategies and mock services to ensure stable, isolated, and repeatable test execution
• Experience designing, developing, or integrating agentic AI systems, AI skills, and the Model Context Protocol (MCP)
• Manage the full defect lifecycle by analyzing customer feedback and debugging logs to identify, prioritize, and track software bugs, collaborating closely with development teams to ensure timely resolution

Benefits

• Selection of employer‑covered medical plans, plus dental, vision, life insurance, and FSA
• Flexible location and schedule options
• Competitive parental leave policy
• Company stock options
• 401k plan with employer contributions
• Learning and development stipend
• Generous PTO
• Distributed from Day 1: Our processes and operating cadence are built around a distributed culture
• SF office space: If you prefer working from an office, we have a beautiful sunny one in Union Square, the heart of San Francisco

Are you passionate about ensuring the highest quality for cutting‑edge generative AI applications? Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus. Exceptional analytical skills to dissect complex problems and a keen eye for detail, ensuring no bug goes unnoticed. 5+ years of hands‑on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications. Proficiency in programming languages like Python or Typescript for test automation, and experience with modern testing frameworks such as Playwright. Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs. A collaborative spirit that helps you connect cross‑functional teams to common quality goals, challenge existing assumptions to build better systems, and own the end‑to‑end quality of our products. Demonstrated ability to drive initiatives independently and thrive in a fast‑paced, evolving startup environment. 5+ years of experience working with GitHub Actions.