EAGLES Evaluation Working Group

• Elaborate a task model: relevant roles, agents, goals

  • Unrestricted general dialogues vs task-oriented dialogues

• Define top level quality characteristics

  • Subjective
    • Users' opinion: satisfaction, friendliness, robustness, ...
  • Objective
    • Total time, number of dialogue turns, rate of correction/repair turns, transaction success