QA / Software Engineering Reviewer – Browser Test Validation
Remote · Contract · $30-60/hr
We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.
What You'll Do
Review browser-based testing workflows for AI-generated web applications.
Assess whether browser interactions are technically feasible and reliable.
Validate test isolation, fixtures, setup, and execution flow.
Ensure assertions produce deterministic, unambiguous pass/fail results.
Identify flaky tests, hidden dependencies, or ambiguous validation logic.
Provide structured technical feedback following project review rubrics.
We're Looking For
3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
Strong experience testing modern web applications.
Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
Experience writing automated UI and end-to-end tests.
Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
Excellent debugging skills and attention to detail.
Why Join?
Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.
Review realistic web application testing scenarios involving automation, test design, and software quality engineering.
Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.
Listing sourced from Mercor. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.