Evaluation

What was evaluated?

Quality of annotation?

Yes ("annotator reconciliation"), but incomplete and not reported.

Inter-annotator agreement?

Yes, on the 2 tasks in IL1 production:

• assignment of ontological concepts (senses) to nouns, verbs, adjectives, and adverbs
• assignment of thematic roles to arguments of verbs