Task-Oriented Dialogues Evaluation

• Performance function

• P = a * N(k) - å wi * N(ci), where a is a weight on K, the cost functions are weighted by wi and N stands for a normalization function.

• Using multiple linear regression and a measure of user satisfaction it is possible to obtain the several weights, to identify the factors significant to the performance function and to evaluate and compare different dialogue systems.