Task-Oriented Dialogues Evaluation

• Minimize dialogue costs

  • Efficiency measures: elapsed time, number of turns
  • Qualitative measures: Inappropriate or repair utterances

• Each cost measure is represented by a function ci(D) from the set of dialogues to the set of real numbers.