Improve future results

After reviewing your data, you can employ a few strategies to improve future results. Note: these strategies will mainly impact data labeled after these changes are made, and thus are useful if you still have data remaining in the task.

StrategyGoalHow toNotes
Create additional Gold Standard casesAssist labelers with more training materialAdditional gold standards can be created through a variety of strategiesCreate additional Gold Standard cases where labelers are struggling with to provide more training material
Add examples and content to instructionsEducate labelers on common mistakes identified in reviewUpdate the task instructions in the portalAdd examples of commonly mislabeled cases with explanations and guidance
Add explanations to difficult casesProvide labelers with additional information on tricky casesSelect the desired case on the Centaur Portal, select the top icon on the right hand side, fill in desired content, select “Add Explanation”Most helpful on cases with high difficulty → include information about explaining the correct answer