Head of Insights – Executive Report Evaluation Expert
Remote · Contract · $200/hr
Mercor is partnering with a leading AI research company to improve how AI systems generate executive-level business reports and strategic recommendations. We're looking for experienced insights leaders to help define what excellent executive reporting looks like, create and review high-quality reports that address complex business questions, and evaluate AI-generated reasoning and outputs. This is a chance to apply your enterprise insights leadership experience to developing next-generation AI systems that support business decision-making.
Responsibilities
Report Framework Development
Define standards for high-quality executive reports and strategic recommendations
Establish best practices for insight communication, executive storytelling, recommendation development, and decision support
Help create evaluation rubrics that distinguish exceptional, average, and poor-quality outputs
Report Writing & Review
Analyse business questions generated by AI systems
Assess whether reports effectively answer business questions and support executive decision-making
Produce and review decision-ready reports comparable to deliverables presented to C-suite and senior leadership teams
Session Scoring & Evaluation
Review AI-generated research and reporting workflows across:
Consistency of reasoning and recommendations
Accuracy of analyses and conclusions
Appropriateness of confidence assessments
Quality of logical reasoning
Executive readiness of final outputs
Provide detailed feedback and scoring rationale.
Requirements
Must Have
10+ years of experience in consumer insights, market intelligence, strategy, research, or business insights leadership
Current or former Director, Senior Director, VP, Head of Insights, Head of Consumer Insights, Head of Market Intelligence, or equivalent leadership role
Experience leading insights functions within a Fortune 100 company or similarly large enterprise
Extensive experience presenting research findings and recommendations to executive leadership teams
Proven track record influencing strategic business decisions through research and analysis
Engagement Details
Engagement Length: 1 month initially, with potential extension
Commitment: 40 hours during the first week (training, calibration, and framework development), followed by approximately 15 hours per week for the remainder of the engagement
Why Join
Help shape how future AI systems support executive decision-making
Apply insights and leadership expertise to cutting-edge AI evaluation work
Work alongside senior consultants, researchers, and industry leaders
Listing sourced from Mercor. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.