EAGLES Evaluation Working Group

• EAGLES - Expert Advisory Group on Language Engineering Standards

• 7-step recipe:

  • Why is the evaluation been done?
  • Elaborate a task model: relevant roles, agents, goals
  • Define top level quality characteristics
  • Produce detailed requirements for the system
  • Devise the metrics to be applied for the defined requirements
  • Design the execution of the evaluation
  • Execute the evaluation