Abstract | This paper discusses the advantages and challenges of using multimodal and voice technologies for field data collection on the construction site. Current developments in the multimodal, mobile, field data communications are discussed. Multimodal and VoiceXML technology for speech-enabled information retrieval and input using speech over the phone is explained. This paper describes an innovative solution for field entry of quality control data and real-time communication that utilizes concepts of voice and multimodal interaction for field data entry on a handheld device. In this project, a field concrete testing technician can enter test results using variable interaction modes such as speech, stylus and keyboard via a handheld device, or speech-only on a mobile phone. The multimodal prototype application, for data collection in the field, includes a fat wireless client on a Pocket PC that has a multimodal browser, embedded speech recognition technology, and is based on X+V technology. The speech-only prototype, for field data collection, is based on VoiceXML technology that allows data retrieval and input using natural speech on the mobile phone. |
---|