Input / Output Alle I/O enheter må forholde seg til menneskekroppen med sine sanser og bevegelsesmuligheter. Input: Fingre, hender, armer, ben. Øyebevegelser, hjerneaktivitet. Tale Output Syn Hørsel Taktil Lukt, smak. Tale og simulert intelligens Gjenskaper eller simulerer intelligent oppførsel Analyserer og tilpasser seg til brukerens oppførsel
Talegjenkjenning Gjenkjenning og syntese Fjerner tastatur og mus Tillater kompleks interaksjon over små grensesnitt uten bruk av skjerm Skaper problemer med tale som støy Skaper problemer med å kommunisere intensjon (systemene tillater bare kommando-stil eller spørsmål/svar-stil interaksjon. pr idag) Tale og simulert intelligens Allan Kay: The user is responsible for the activity Needs predictable and consistent behavior Lead, follow or get out of the way Ben Shneiderman: Beyond intelligent machines: just do it! Users need a clear mental model of what is possible Predictability and control is desirable because we need a sense of accomplishment and responsibility
Desktop computing Knowledge Navigator, Apple 1987 Mobile computing Examples 2004: In the ward, On the move The future is different from what was imagined
Stasjonær vs. mobil PC/internett Mobil trådløs IT Forgrunn / Bakgrunn Hovedfokuset er på bruk av PDA/mobil er integrert med PCen. andre aktiviteter Mind/Body Symbolmanipulasjon (mind) Også fysiske handlinger (body-mind) En bruker/ Flere brukere Ofte en bruker. Samhandling over nett Flere brukere samtidig, i den fysiske verden. Omgivelsesdata Fysiske posisjon er irrelevant (CyberSpace) Lokasjon og sensordata kan brukes av software. Hardware og ergonomi PCen har funnet sin fysiske form (desktop/laptop). Hardware/form blir viktig (størrelse, vekt, form, materialer, batterilevetid,) Skjerm og input, nye GUIs. Store skjermer, tastatur og mus Små skjermer, sollys. Penn, knapper, en-hånds løsninger, nye løsninger. Mixed Realities TV studios Head up displays Simulators Telerobotic operations Net: Working and Playing Design and Construction Medicine Training
Ukjent opphav Center for Pervasive Computing http://www2.cit.dk/default.asp?id=76
Computer Vision Visual recognition of: Object recognition in process plants or training Non intrusive gaze tracking or retina scanning 3D Gesture control - heavy computation but multipurpose Apparence based control - limited or command style Needs contextual design Force Feedback http://www.sensable.com/freeform/aliensystemweb.jpg
Tangible interfaces - håndgripelige grensesnitt The goal is to change the "painted bits" of GUIs to "tangible bits," taking advantage of the richness of multimodal human senses and skills developed through our lifetime of interaction with the physical world. http://gonzo.media.mit.edu/public/web/group.php?id=20 Durell Bishop: Marble answering machine
MIT Medialab: metadesk Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms Hiroshi Ishii and Brygg Ullmer www.media.mit.edu Thomas Hoff: Statnett Powerdesk
Anderson et.al: Physical Blocks Building Virtual Structures With Physical Blocks David Anderson2, James L. Frankel1 ; 2, Joe Marks2,Darren Leigh2, KathyRyall3, Eddie Sullivan2, Jonathan Yedidia2 1Frankel and Associates, Inc., Lexington, MA 02421 2MERL A Mitsubishi Electric Research Laboratory, Cambridge, MA02139 3University of Virginia, Dept. of Computer Science, Charlottesville, VA22903 MIT Medialab: intouch InTouch MIT Media Lab
Dag Svanæs: One-bit Pager Lars Hurlen: Multifunksjon-multigrip joystick Multifunksjon joystick for Kværneland Underhaug Lars Hurlen Institutt for Produktdesign NTNU
Kristian Sandvik: Eyes-free Kristian Sandvik: Eyes-free
Projected images, Objects as input devices metadesk: Ishii & Ulmer (MIT M.L.)
Rotation constraint instrument Passive lens, with Great Dome phicon
Active lens in Tangible Geospace Phicons - Physical Icons
PingPongPlus PingPongPlus
Physical objects as representations of digital information Marble Answering Machine (Bishop, RCA)
mediablocks (Ulmer, MIT) PHYSICAL CONTAINERS
Slide sorter Using IButtons for images
Augmenting the devices
Augmenting the devices Augmenting the devices
RF Smartcards Metaphors found Containment: The image is in the IButton (one image). The IButton stores images as a stack (many images, FIFO) Reference: The IButton is a reference to an image (technologically correct) Trigger: The IButton triggers an action (portable push-button) The IButton triggers an action for the image it stores/is. Power The IButton turns the device on/off. Magnet: The IButton sucks up the image. It is a magnet.
Systems of objects that can be combined in different ways Triangles, Matt Gorbet MIT
Explorations of the design space
Cinderella 2000, Story telling Media Manager
The Digital Veil Sound input & Output.