Input / Output. Tale og simulert intelligens

Transkript

1 Input / Output Alle I/O enheter må forholde seg til menneskekroppen med sine sanser og bevegelsesmuligheter. Input: Fingre, hender, armer, ben. Øyebevegelser, hjerneaktivitet. Tale Output Syn Hørsel Taktil Lukt, smak. Tale og simulert intelligens Gjenskaper eller simulerer intelligent oppførsel Analyserer og tilpasser seg til brukerens oppførsel

2 Talegjenkjenning Gjenkjenning og syntese Fjerner tastatur og mus Tillater kompleks interaksjon over små grensesnitt uten bruk av skjerm Skaper problemer med tale som støy Skaper problemer med å kommunisere intensjon (systemene tillater bare kommando-stil eller spørsmål/svar-stil interaksjon. pr idag) Tale og simulert intelligens Allan Kay: The user is responsible for the activity Needs predictable and consistent behavior Lead, follow or get out of the way Ben Shneiderman: Beyond intelligent machines: just do it! Users need a clear mental model of what is possible Predictability and control is desirable because we need a sense of accomplishment and responsibility

3 Desktop computing Knowledge Navigator, Apple 1987 Mobile computing Examples 2004: In the ward, On the move The future is different from what was imagined

4 Stasjonær vs. mobil PC/internett Mobil trådløs IT Forgrunn / Bakgrunn Hovedfokuset er på bruk av PDA/mobil er integrert med PCen. andre aktiviteter Mind/Body Symbolmanipulasjon (mind) Også fysiske handlinger (body-mind) En bruker/ Flere brukere Ofte en bruker. Samhandling over nett Flere brukere samtidig, i den fysiske verden. Omgivelsesdata Fysiske posisjon er irrelevant (CyberSpace) Lokasjon og sensordata kan brukes av software. Hardware og ergonomi PCen har funnet sin fysiske form (desktop/laptop). Hardware/form blir viktig (størrelse, vekt, form, materialer, batterilevetid,) Skjerm og input, nye GUIs. Store skjermer, tastatur og mus Små skjermer, sollys. Penn, knapper, en-hånds løsninger, nye løsninger. Mixed Realities TV studios Head up displays Simulators Telerobotic operations Net: Working and Playing Design and Construction Medicine Training

5 Ukjent opphav Center for Pervasive Computing

6 Computer Vision Visual recognition of: Object recognition in process plants or training Non intrusive gaze tracking or retina scanning 3D Gesture control - heavy computation but multipurpose Apparence based control - limited or command style Needs contextual design Force Feedback

7 Tangible interfaces - håndgripelige grensesnitt The goal is to change the "painted bits" of GUIs to "tangible bits," taking advantage of the richness of multimodal human senses and skills developed through our lifetime of interaction with the physical world. Durell Bishop: Marble answering machine

8 MIT Medialab: metadesk Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms Hiroshi Ishii and Brygg Ullmer Thomas Hoff: Statnett Powerdesk

9 Anderson et.al: Physical Blocks Building Virtual Structures With Physical Blocks David Anderson2, James L. Frankel1 ; 2, Joe Marks2,Darren Leigh2, KathyRyall3, Eddie Sullivan2, Jonathan Yedidia2 1Frankel and Associates, Inc., Lexington, MA MERL A Mitsubishi Electric Research Laboratory, Cambridge, MA University of Virginia, Dept. of Computer Science, Charlottesville, VA22903 MIT Medialab: intouch InTouch MIT Media Lab

10 Dag Svanæs: One-bit Pager Lars Hurlen: Multifunksjon-multigrip joystick Multifunksjon joystick for Kværneland Underhaug Lars Hurlen Institutt for Produktdesign NTNU

11 Kristian Sandvik: Eyes-free Kristian Sandvik: Eyes-free

12 Projected images, Objects as input devices metadesk: Ishii & Ulmer (MIT M.L.)

13 Rotation constraint instrument Passive lens, with Great Dome phicon

14 Active lens in Tangible Geospace Phicons - Physical Icons

15 PingPongPlus PingPongPlus

16 Physical objects as representations of digital information Marble Answering Machine (Bishop, RCA)

17 mediablocks (Ulmer, MIT) PHYSICAL CONTAINERS

18 Slide sorter Using IButtons for images

19 Augmenting the devices

20 Augmenting the devices Augmenting the devices

21 RF Smartcards Metaphors found Containment: The image is in the IButton (one image). The IButton stores images as a stack (many images, FIFO) Reference: The IButton is a reference to an image (technologically correct) Trigger: The IButton triggers an action (portable push-button) The IButton triggers an action for the image it stores/is. Power The IButton turns the device on/off. Magnet: The IButton sucks up the image. It is a magnet.

22 Systems of objects that can be combined in different ways Triangles, Matt Gorbet MIT

23 Explorations of the design space

24 Cinderella 2000, Story telling Media Manager

25 The Digital Veil Sound input & Output.