Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Declaration of views_handler_filter::options_validate() should be compatible with views_handler::options_validate($form, &$form_state) in /home/speechmap/stcspeechmap.org/Drupal/modules/views/handlers/views_handler_filter.inc on line 589.
  • strict warning: Declaration of views_handler_filter::options_submit() should be compatible with views_handler::options_submit($form, &$form_state) in /home/speechmap/stcspeechmap.org/Drupal/modules/views/handlers/views_handler_filter.inc on line 589.
  • strict warning: Declaration of views_plugin_style_default::options() should be compatible with views_object::options() in /home/speechmap/stcspeechmap.org/Drupal/modules/views/plugins/views_plugin_style_default.inc on line 25.
  • strict warning: Declaration of views_plugin_row::options_validate() should be compatible with views_plugin::options_validate(&$form, &$form_state) in /home/speechmap/stcspeechmap.org/Drupal/modules/views/plugins/views_plugin_row.inc on line 135.
  • strict warning: Declaration of views_plugin_row::options_submit() should be compatible with views_plugin::options_submit(&$form, &$form_state) in /home/speechmap/stcspeechmap.org/Drupal/modules/views/plugins/views_plugin_row.inc on line 135.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Declaration of views_handler_argument::init() should be compatible with views_handler::init(&$view, $options) in /home/speechmap/stcspeechmap.org/Drupal/modules/views/handlers/views_handler_argument.inc on line 745.
  • strict warning: Declaration of views_handler_filter_node_status::operator_form() should be compatible with views_handler_filter::operator_form(&$form, &$form_state) in /home/speechmap/stcspeechmap.org/Drupal/modules/views/modules/node/views_handler_filter_node_status.inc on line 14.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
  • strict warning: Non-static method view::load() should not be called statically in /home/speechmap/stcspeechmap.org/Drupal/modules/views/views.module on line 879.
TitleUncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system
Publication TypeJournal Article
Year of Publication2011
AuthorsDaubigney, L, GaĊĦic M, Chandramohan S, Geist M, Pietquin O, Young S
Keywordsreinforcement learning, spoken dialogue systems
Abstract

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on arti- ficial data generated by a user simulator. Optimization is there- fore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function esti- mates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task.

URLhttp://www.metz.supelec.fr/metz/personnel/pietquin/pdf/IS_2011_LDMGSCMGOPSY.pdf