Journal of Information Technology & Software Engineering
Open Access

Design of multimedia external representation: Cognitive processing

Global Summit and Expo on Multimedia & Applications

August 10-11, 2015 Birmingham, UK

Thomas K F Chiu

Posters-Accepted Abstracts: J Inform Tech Soft Engg

Abstract :

Multimedia resources can be categorized into technology, representation and sensory areas. Technology refers to devices
which display resources; representation, to formats of external representation; and sensory, to sensory modalities
through which resource data are received. In terms of representation, effectiveness is measured as a function of developing
user understanding, and requires the integration of new messages from multimedia resources and current understanding.
This involves different cognitive processes including: Selecting, organizing and integrating. To successfully acquire new
understanding, users need to select relevant multimedia messages presented in materials, then organize and integrate the
selected messages. The design of external representations determines the level of engagement in different kinds of cognitive
processing. We investigated design methods for multimedia external representations to maximize cognitive capacity and to
more effectively engage cognitive processing. The data collected allowed us to define optimal design characteristics, which
have useful practical implications for educational technology designers and educators, and can inform efforts to improve the
design of digital multimedia materials. These characteristics may also assist multimedia designers to develop more intuitive
and approachable interfaces that help users accept messages more effectively.