View source - GikiCLEF - Cross-language Geographic Information Retrieval from Wikipedia

You do not have permission to edit pages, for the following reason:

The action you have requested is limited to users in the group Users.

You can view and copy the source of this page:

After all submissions have been received, the assessment process starts by producing an answer pool, in which different justifications for the same answer are considered as different answers. 

This pooling mechanism handles differences between HTML and XML, that is, only one will remain in the pool, as well as automatically filters out those pages which are easy to discard as invalid answers (such as disambiguation pages, or redirects).

Then, and in order to minimize the assessors' workload, the system automatically adds the information it already has about the topics, namely that some answers are correct and self-justified, or correct (but not self justified), provided this information is already present in the topic management system. 

An assessor is then presented with a list of answers for which s/he has to 
- either check the correctness through inspecting the pages and the justifications
- or just check the justifications because it is already known by the system that the answer is correct but not self justified
Also, the assessor can add comments about interesting issues (incompatible information in different languages, Wikipedia link translations incorrect, etc.) which may have a bearing on the evaluation score

The system allows the same answers to be evaluated by different assessors, and then start have a conflict-solving procedure if they do not agree.

After all answers in the pool have been classified, it is time for the evaluation system to take control.

[http://www.linguateca.pt/GikiCLEF/index.php/Main_Page Back to the main page]

[[Documentation]] (so far only in Portuguese)

Return to Assessment in the GikiCLEF assessment system.

Retrieved from "https://www.linguateca.pt/GikiCLEF/index.php/Assessment_in_the_GikiCLEF_assessment_system"