Multi-modal and Trilingual Spoken Dialog Systems

H. Meng

We are developing distributed spoken dialog systems that support the languages of Hong Kong (Cantonese, Mandarin and English) as well as human-computer interactions using portable PDAs and smart phones connected over a wireless network. Our systems accept multimodal input via speech, handwriting and pointing; and they deliver multimedia output involving text, audio and video. Users can use these systems for information access in the travel and financial domains. Our systems integrate a plethora of technologies involving speech recognition, natural language understanding, multi-modal dialog modelling and speech synthesis.