Software Engineer in Test II

Alert Media, Inc.; United States; Remote; USD 38,000 - 49,000; Full time

Benefits offered by this job

Annual company bonus

Employer-paid medical, dental, vision

Parental leave program

Vacation & holiday policy

Work-from-home stipend

Equipment provided

Job summary

AlertMedia is seeking a Software Engineer in Test II (SDET) to join our AI-focused engineering team. You will build and maintain automated test suites for our AI features, ensure guardrails hold under adversarial input, and test across web and mobile platforms.

You will work with Engineering, Product, and Customer Success to elevate quality throughout the product lifecycle. You’ll embrace AI-powered testing workflows, design scalable automation, and mentor teammates to raise testing standards.

Qualifications

• 5+ years of QA, SDET, or software testing roles.
• Experience with LLM evaluation techniques and AI features testing.
• Experience testing agentic systems and failure modes, including prompt injection.

Responsibilities

• Build, maintain, and execute automated test suites for AI features.
• Test guardrails, human approval gates, and adversarial inputs.
• Design, execute, and maintain test coverage for web and mobile platforms.
• Identify, document, and track defects through resolution.
• Collaborate with Eng, Product, and Customer Success to improve quality.

Skills

QA testing

SDET

AI testing

API testing

CI/CD

Python/JS

SQL/NoSQL

Team collaboration

Education

Bachelor’s degree preferred

Tools

Selenium

Cypress

Playwright

Gherkin

Git

Jenkins

Job description

Location: Mexico

Do work that matters.

AtAlertMedia, we help organizations protect their people, operations, and brand. Our modern Risk Intelligence and Response platform empowers teams to detect emerging threats, assess impact, and respond with confidence. We believe building resilience should be simpler—and it starts with bringing critical information and workflows together in one unified platform.

Our core values drive us in our important mission of keeping people safe & informed:

• We’re humans, not robots
• Customers always come first
• We work better together
• Simplicity is our strength
• Our reputation is priceless
• Hard work pays off

TheSoftware Engineer in Test II (SDET)will join our AI-focused engineering team as we build the next generation ofAlertMediaproducts and services. This role is critical to delivering high-quality, reliable softwarewith a primary focus on our AI featurecapabilities — the AI Assistant and the agent orchestration platform — andsupporting coverage across the broader web and mobileapplications.

We have an engineering culture that embraces AI-assisted development, intelligent automation, and modern tooling to improve product quality, engineering velocity, and customer outcomes.We’relooking for engineers who are excited to experiment with emerging AI-powered engineering workflows and help define how modern quality engineering evolves in an AI-native environment.

You’llplay a key role in shaping modern quality engineering best practices, improving automation coverage, and embedding quality throughout the software development lifecycle.

Who you are:

You’repassionate about software quality and creating efficient, scalable testing processes. You enjoy understanding how applications are built and how customers use them in the real world. You have a strong attention to detail, think critically about risk and user impact, and thrive in fast-paced, collaborative environments.You have experience testing AI features in customer-facing products.You'recomfortable testing systems thatdon'treturn the same answer twice, andyou know how to measure quality without a correct output to assert against.

You embrace automation and modern engineering practices, including AI-powered tools and workflows that improve testing efficiency, accelerate development, and enhance product quality. You believe quality is a shared responsibility and should be built into the product from day one.

Most importantly, you enjoy working cross-functionally with Engineering, Product, and Customer Success teams to deliver meaningful outcomes for customers.

What you get to do every day:

• Become an expert in theAlertMediaplatform, products, and customer use cases
• Build andmaintainevaluation suites that catch quality regressions in AI features,and test agent behavior end-to-end
• Test that guardrails and human approval gates hold under adversarial and unexpected input, and that AI features fail safely
• Design, execute, andmaintainautomated test coverage to prevent software regressions
• Perform manual, exploratory, functional, and regression testing across web and mobile platforms
• Identify, document, prioritize, and track software defects through resolution
• Execute API, integration, and performance testing to ensure platform reliability and scalability
• Partner closely with Engineering, Product, and Customer Success teams to improve quality and troubleshoot issues
• Contribute to QA strategy, processes, tools, and best practices across the organization
• Mentor team members and help elevate testing standards and automation practices
• Leverage AI-powered tools and capabilities to improve QA workflows, automation, debugging, and overall engineering efficiency

What you bring to the role:

• 5+years of experience in QA, SDET, or software testing roles
• Experiencewith LLM evaluation techniques — curated case sets, rubric or model-graded scoring, regression baselines
• Hands-on experience testingagentic systems (tool/function calling, multi-step workflows, MCP or similar integrations) and the failure modes they introduce, including prompt injection through untrusted content
• Experience mentoring teammates or serving as a QA thought partner preferred
• Strong understanding of API, integration, and distributed systems testing
• Experience designing scalable, maintainable automation frameworks and test strategies for modern web applications using tools such as Selenium, Cypress, Playwright, or Gherkin
• UI automation testing experience using Python or JavaScript
• Familiarity with CI/CD workflows and tools such as Git, Jenkins, or similar platforms
• Familiarityworking with SQL and/or NoSQL databases
• Experience using AI-powered engineering tools such as Codex, Claude, Cursor, or similar technologies to improve productivity and testing workflows
• Strong communicationand collaboration skills with the ability to work cross-functionally in a fast-paced environment
• Englishproficiency(written and verbal)required
• Bachelor’s degree preferred

Location: This role is remote in Mexico. We do have a Mexico City office in the Reforma area if you'd like to go into the office and collaborate with our engineering team, otherwise it is a fully remote position based in Mexico.

Sponsorship: AlertMedia does not sponsor candidates. Must have the legal right to work in Mexico without sponsorship now and in the future.

Why you’ll love working at AlertMedia:

• Competitive Base Salary (Bi-Monthly payroll)
• Annual Company Bonus
• 100% Employer-Paid Medical, Dental, and Vision Coverage
• Parental Leave Program
• Christmas Bonus (Aguinaldo)
• Generous Vacation and Holiday Policy
• Additional Vacation Bonus
• Monthly Work-from-Home Stipend
• All Necessary Equipment Provided:Laptop, monitor and accessories
• Recognition & Rewards:We celebrate wins big and small
• Language Immersion Program with employees spread out across the globe (English, Spanish, etc...depending on your interest)
• Continuous Learning & Growth: From mentorship and tech talks to personalized 1:1 career development sessions, we’re deeply committed to investing in your professional journey
• Award Winning Culture: We're proud to be recognized as a BEST WORKPLACE FOR 10 YEARS IN A ROW
• The Work & People: We’re passionate about the meaningful work we do—and even more grateful for the incredible people we get to do it with!

AboutAlertMedia:

We are the leading risk intelligence and response platform — trusted by the largest companies in the world to protect their people and assets when it matters most.We are a high-growth, PE-backed SaaS company with more than 4,000 clients scaling rapidly across the globe.Our technology is unmatched with a unified platform, a 7+year history of AI innovation, a customer NPS of 70+, and a culture that sets us even further apart from our competition.

We are an equal opportunity employer focused on creating a collaborative and exciting place for all to work. Ensuring a diverse, inclusive, andequitableworkplace for all people is key to our success andcore to ourvalues. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

This is an amazing opportunity to be part of our wave of momentum and