via Mercor

QA / Software Engineering Reviewer – Browser Test Validation

Remote · Contract · $30-60/hr

We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.

What You'll Do

  • Review browser-based testing workflows for AI-generated web applications.

  • Assess whether browser interactions are technically feasible and reliable.

  • Validate test isolation, fixtures, setup, and execution flow.

  • Ensure assertions produce deterministic, unambiguous pass/fail results.

  • Identify flaky tests, hidden dependencies, or ambiguous validation logic.

  • Provide structured technical feedback following project review rubrics.

We're Looking For

  • 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.

  • Strong experience testing modern web applications.

  • Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.

  • Experience writing automated UI and end-to-end tests.

  • Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.

  • Excellent debugging skills and attention to detail.

Why Join?

  • Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.

  • Review realistic web application testing scenarios involving automation, test design, and software quality engineering.

  • Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.

Listing sourced from Mercor. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.