EAGLES Evaluation Working Group

• Produce detailed requirements for the system

  • For each feature, define a reliable way of measuring it.

• Devise the metrics to be applied for the defined requirements

  • How to combine the different features?
  • What is a good final evaluation score?

• Design the execution of the evaluation

  • Test materials; test groups

• Execute the evaluation