Senior Quality Engineer

Upshop; Austin (TX); On-site; USD 110,000 - 160,000; Full time

Job summary

Upshop in Austin seeks a Senior Quality Engineer to own quality, reliability, and performance through automation and AI-driven approaches. You will build end-to-end and API test coverage, shape test strategy, and shift quality left with AI agents and RAG while ensuring evidence-based results.

In a fast-paced engineering culture, you will drive CI/CD test integration, review automated outputs, and protect customer data.

Qualifications

• Proficient with AI coding agents and retrieval-backed workflows.
• Shift-left mindset with requirement-traced automation.
• Quality advocate who challenges weak defaults and risks.
• Proven ability to adapt in a fast-paced engineering culture.
• Experience in Agile/Scrum environments and CI/CD integration.

Responsibilities

• Own quality, reliability, and performance through automation and AI-driven approaches.
• Build and maintain end-to-end and API test coverage across platforms.
• Shape test strategy and shift quality left with AI agents and RAG.
• Review and correct agent outputs; ensure evidence-based results.
• Drive CI/CD pipelines and release readiness with automated tests.

Skills

AI agents

Prompt engineering

RAG workflows

Shift-left

Agile/Scrum

CI/CD

Performance testing

Automation frameworks

Tools

Testing tools

Job description

AboutUpshop:

Upshop is the foremost provider of a SaaS platform designed to streamline forecasting, ordering, production, and inventory optimization processes for food retailers. Its unified platform simplifies and enhances associate tasks, promoting smarter and more interconnected operations across Fresh, Center, DSD, and eCommerce departments. With over 450+ retailers and 50,000+ stores relying on its mission-critical operations platform globally, customers have witnessed substantial enhancements in sales, shrinkage reduction, food safety, and sustainability throughout their stores.

At Upshop, we believe that great businesses are built by great people. Our People function is at the heart of our company’s growth, ensuring we attract, develop, and retain A Players who drive our mission forward.

OverviewoftheRole:

WearelookingforaSeniorQualityEngineerwhoownsquality,reliability,andperformancethroughstrongautomation- andwhousesAIasaforcemultiplier,notasubstituteforjudgment.

You build and maintain end-to-end and API coverage, contribute to test strategy, and shift quality left with agents, RAG, and prompt engineering. You stay accountable for what those systems produce. You advocate for quality, act before you are asked, and challenge weak process, thin coverage, or “this is how we’ve always done it” when it puts the customer at risk. You adapt to a fast-paced engineering culture: changing priorities, short cycles, and delivery without lowering the quality bar.

KeyResponsibilities

• Picktherightlayer:proverulesanddatainAPItests;useUI/mobileonlywhenthatsurfaceistheproof.
• Runsuites,analyzefailures,drivedefectstoclose,andkeeppipelinestrustworthy(flakes,failingjobs,follow-upuntildone).
• Shiftleft:reviewacceptancecriteriafortestability,workfromspecificationsandscenarios,andmapeverycriteriontoAPI,Web,and/orMobile-ormarkitnotapplicablewithevidence.Donotinventtestsfromatickettitle.
• Keeptestsrequirement-tracedfromdesignthroughautomation.CI/releaseresultsarethesourceoftruthforpass/fail.
• UseAIagentstodesigncases,implementautomation,andraisereviewablePRsthatextendexistingframeworks.ApplypromptengineeringandRAGsooutputisgroundedinspecifications,existingtests,andstandards-notguessed.
• Review and correct agent output. Stop when evidence is missing. Never claim AI work passed without pipeline proof and human review. Protect secrets and customer data in prompts and retrieval.
• Ownteamqualityoutcomes:coverage,automationstandards,PRgates,andreleasereadiness-notjustassignedtickets.
• Stayeffectivewhenscope,priorities,ortimelinesmove.Re-plancoverage,communicateriskearly,andkeepautomationandpipelinesusableunderdeliverypressure.

RequiredSkills

• PracticaluseofAIcodingagents,withpromptengineeringandretrieval-backed(RAG)workflows;judgmenttoaccept,revise,orstopgeneratedwork.
• Shift-leftmindset:earlytestability,requirement-tracedautomation,humanaccountabilityforAI-assistedquality.
• Proactive,quality-advocateposture:ownsoutcomes,stepsoutsidethecomfortzone,andchallengesweakdefaults.
• Provenabilitytoadapttoafast-pacedengineeringcultureanddeliverqualityunderchangingpriorities.
• ExperienceworkinginAgile/Scrumenvironments.
• CI/CDintegrationofautomatedtests;performance/loadtools.
• Spec-drivenoragenticworkflows;evaluatingqualityofRAGorconversationalAIfeatures.