Evaluation

What was evaluated?

Quality of annotation?

Yes ("annotator reconciliation"), but incomplete and not reported.

Inter-annotator agreement?

Yes, on the 2 tasks in IL1 production:

  • assignment of ontological concepts (senses) to nouns, verbs, adjectives, and adverbs
  • assignment of thematic roles to arguments of verbs