NIK Norsk informatikkonferanse. Universitetet i Nordland november NIK-styret og redaksjonskomité. Høgskolen i Oslo og Akershus

Transkript

1 NIK 2012 Norsk informatikkonferanse Norsk informatikkonferanse NIK 2012 Universitetet i Nordland november 2012 NIK-styret og redaksjonskomité Lars Ailo Bongo Siri Fagernes Dag Haugland Erik Hjelmås Hein Meling Birger Møller-Pedersen Andreas Prinz Trond Aalberg ISSN ISBN Universitetet i Tromsø Høgskolen i Oslo og Akershus Universitetet i Bergen Høgskolen i Gjøvik (styreleder) Universitetet i Stavanger Universitetet i Oslo Universitetet i Agder NTNU (redaktør)

2 Norsk informatikkonferanse NIK 2012 Universitetet i Nordland november 2012 NIK-styre og redaksjonskomité Lars Ailo Bongo Siri Fagernes Dag Haugland Erik Hjelmås Hein Meling Birger Møller-Pedersen Andreas Prinz Trond Aalberg Universitetet i Tromsø Høgskolen i Oslo og Akershus Universitetet i Bergen Høgskolen i Gjøvik (styreleder) Universitetet i Stavanger Universitetet i Oslo Universitetet i Agder NTNU (redaktør)

3 NIK-stiftelsen og Akademika forlag, Trondheim 2012 ISSN ISSN (online) ISBN Det må ikke kopieres fra denne boka ut over det som er tillatt etter bestemmelser i lov om opphavsrett til åndsverk, og avtaler om kopiering inngått med Kopinor. Dette gjelder også filer, kode eller annen gjengivelse tilknyttet e- bok. Redaktør: Trond Aalberg, NTNU Digital trykk og innbinding: AIT Oslo AS Vi bruker miljøsertifiserte trykkerier Akademika forlag Postboks 2461 Sluppen 7005 Trondheim Tlf.: E- post: forlag@akademika.no Forlagsredaktør: Lasse Postmyr (lasse.postmyr@akademika.no)

4 Forord Norsk informatikkonferanse har vært arrangert hvert år siden 1988 ved de forskjellige universitetene og høyskolene i Norge. I år er turen igjen kommet til Bodø. Formålet har hele tiden vært det samme: å være et møtested for datafaglig ansatte og studenter i høyere undervisningsinstitusjoner, forskningsinstitutter og næringsliv, å gi et representativt bilde av hva som foregår av forsknings- og avansert utviklingsarbeid i hele det norske fagmiljøet, dvs forsøke å vise bredden i forskningsmiljøet, både faglig, organisatorisk og geografisk, samt å holde et høyt faglig nivå og åpne for debatt om emner som opptar det datafaglige miljøet. Årets innsendte bidrag holder et normalt nivå. 21 av 43 innsendte bidrag ble akseptert som ordinære bidrag, mens ytterligere 7 bidrag ble akseptert til en egen short paper session. Det er flere studentarbeider blant de aksepterte bidragene og disse får økonomisk støtte fra NIK for å komme til konferansen og presentere sine bidrag. I vurderingsarbeidet har programkomiteen også fått uvurderlig hjelp av frivillige faglige konsulenter, nemlig Anders Andersen, Ivar Austvoll, Abdulrahman Azab, Anya Helene Bagge, Joanna Bauer, John Markus Bjørndalen, Reggie Davidrajuh, Ingvar Eidhammer, Pål Evensen, Bård Fjukstad, Ivar Farup, Phuong Ha, Geir Hasle, Jo Herstad, Magnus Lie Hetland, Rune Hjelsvold, Kjell Jørgen Hole, Anders Kofod-Petersen, Stein Krogdahl, Hanno Langweg, Mass Soldal Lund, Fredrik Manne, Arne Maus, Ellen Munthe-Kaas, Georg Muntingh, Morten Mossige, Khalid Mughal, Tor Anders Nygaard, Erlend Tøssebro, Julius Parulek, Jonathan Read, Tom Ryen, Gerhard Skagestein, Karl Skretting, Daniel Stødle, Ragnar Stølsmark, Nils Kalstad Svendsen, Gunnar Syrrist, Lars Tiede, Yngve Villanger, Sule Yildirim, Weihai Yu, Anne-Siri Øyen og Brit Helle Aarskog. På vegne av redaksjonskomiteen vil jeg gjerne få takke disse. I likhet med tidligere år har ikke NIK opphavsrett til artiklene i denne samlingen. Den enkelte forfatter må kontaktes om rettighetene til eventuell videre gjengivelse av artiklene. I år inviterer vi Bran Selic fra Malina Software Corp. som keynote til å fortelle oss om model-based engineering. Artiklene finnes også på nettet på NIKs adresse der man også finner annen informasjon om NIK. Programkomiteen for NIK Erik Hjelmås Gjøvik, oktober 2012.

5 Innhold An Empirical Evaluation of a Metric Index for Approximate String Matching... 1 Bilegsaikhan Naidan, Magnus Lie Hetland Image Metadata as a Means to Gather Image Relevant Information Randi Karlsen, Roger Bruun Asp Hansen Efficient Rule-Matching for Automated Coherent Logic Bjarne Holen, Dag Hovland, Martin Giese Mining of Association Relations in Text Gleb Sizov, Pinar Öztürk Bruk av PC-sal under eksamen i videregående programmering Erlend Tøssebro Vurderingsform og karakterbruk Christian F. Heide, Monica Kristiansen, Tom Heine Nätt Course Improvement the TQM way Tor Stålhane, Svein Erik Bratsberg, Roger Midtstraum Language and Metamorphosis Supervising Computer Science Students diagnosed with Asperger Syndrome Kirsten Ribu Computing the Optimal Layout of a Wind Farm Jan Kristian Haugland, Dag Haugland Optimization of Wood Fuel Chip Production in Denmark Assimizele Brice, Arne Løkketangen Optimization and Parallelization of Ptychography Reconstruction Code Thomas L. Falch, Jostein B. Fløystad, Anne C. Elster, Dag W. Breiby GPU-Based Airway Segmentation and Centerline Extraction for Image Guided Bronchoscopy Erik Smistad, Anne C. Elster, Frank Lindseth Real-Time Surface Extraction and Visualization of Medical Images using OpenCL and GPUs Erik Smistad, Anne C. Elster, Frank Lindseth Towards Efficient Simulation of Task Based Parallel Applications Alexandru C. Iordan, Magnus Jahre, Lasse Natvig A Child s Voice Miriam E. N. Begnum, Synnøve Flatebø Hoelseth, Britt Johnsen, Frank Hansen Making Touch-Based Mobile Phones Accessible for the Visually Impaired Alexander Dreyer Johnsen, Tor-Morten Grønli, Bendik Bygstad

6 Mobile IT Support for Multisport Competitions Steinar Kristoffersen, Manish Shrestha Public Review of E-voting Source Code: Lessons Learnt from E-vote Bjarte M. Østvold, Edvard K. Karlsen Konstruksjon av databaser for aktuelle og historiske addresser Kjell Bratbergsengen On the Truthfulness of Petal Graphs for Visualisation of Data Frode Eika Sandnes Tekstur og dekkval i biletsteganografi Hans Georg Schaathun NFC Experiments in the NFC City Project Anders Andersen, Randi Karlsen GeStore Incremental Computation for Metagenomic Pipelines Edvard Pedersen, Nils Peder Willassen, Lars Ailo Bongo BSV Window Visualization System Lars Ailo Bongo Towards Cross-Lingual Information Retrieval using Random Indexing Hans Moen, Erwin Marsi Eye Contact in Leisure Video Conferencing Annick Van der Hoest, Simon McCallum A Personal Assistant A Push System to Offer Relevant Information with a Minimum of Input Kai A. Olsen, Alessio Malizia, Teresa Onorati A Memory Aid for Reduced Cognitive Load in Manually Entered Online Bank Transactions Frode Eika Sandnes

7 Eye Contact in Leisure Video Conferencing Annick Van der Hoest & Dr. Simon McCallum Gjøvik University College, Norway 19 November 2012 Abstract This paper presents systems which enable eye contact in leisure video conferencing. The proposed solutions include a software based and a hardware based approach. Two experiments were conducted to test the performance of the systems by measuring the users sense of presence. The results showed that both solutions succeeded in establishing eye contact but there was no direct indication of an increase in presence with respect to the conventional setup. The hardware solution induced a greater sense of presence and established a greater and more natural eye contact perception than the software solution. 1 Introduction The concept of presence refers to the sensation of being in a physically distinct location [12]. A sense of presence in a video conferencing session, refers to experiencing togetherness with the remote user rather than being aware of the physical separation. In Knudsen s extensive research in the field of presence [1], the objective was to improve the quality of long distance communication by increasing the sense of presence. This is followed in this work and thus the focus was on enhancing users sense of presence. According to Witmer & Singer [15] a greater involvement and immersion lead to a greater sense of presence. There are three factors that determine the sense of presence: the individual preconditions present, the characteristics of the content delivered and the sensory environment (i.e. technologies used) [4]. While preconditions are difficult to influence, it is possible to influence the content and the sensory environment. In the field of gaming the content can be managed, however in video conferencing the content is controlled by the users. In both cases we can try to improve presence by altering the sensory environment. This work aims at improving presence in leisure video conferencing. In conventional video conferencing the camera is on top of the screen, preventing eye contact. This creates a problem because eye contact helps evaluate virtues such as attentiveness, competence and credibility of the speaker [8] and assists with recognising emotions [14]. Eye contact plays an important role in communication as it conveys additional nonverbal information. To improve leissure video conferencing we choose to focus on eye contatct in our attempt to improve presence. This paper was presented at the NIK-2012 conference; see 263

8 2 Related Work Eye contact solutions for video conferencing can be roughly divided into hardware and software. A simplistic hardware approach is to use large screens and have the user sit far away. For this to be effective the user s gaze and the camera location must be separated by less than 6 seconds of arc (vernier acuity [9]). If the angle is small the users do not detect the disparity. A common hardware solution is based on teleprompter technology, consisting of a display, a camera and a beam splitter. The camera and the display are located at a 90 disparity with the beam splitter in between at a 45 angle to both the display and the camera. The beam splitter deflects the beam emitted from the display, while allowing the light reflected from the user to pass through to the camera. Thus, the camera captures the image of the user through the beam splitter, whereas the user perceives the displayed image as in front of the camera due to the reflection of the beam splitter. Another hardware approach is using see-through displays, where the camera is behind the display, capturing the image of the user through the display. Shiwa and Ishibashi [11] used switchable liquid crystal displays. Tan et al. [13] used wavelength multiplexing, where the light projected on the display consists of visible wavelengths outside the sensitivity of the camera. Software approaches are more novel and have a wider application because there is no need for specific hardware. Software solutions use image processing techniques to create a perception of eye contact. A common approach is to generate a view from a virtual camera that is placed at the centre of the screen or at the position of the displayed face of the remote user [16, 2, 3, 5]. The scene is captured by multiple cameras from which 3D information is extracted to model the scene. The scene can then be displayed as if it was captured from a different perspective. Examples of multiple camera approaches include a system with a pair of calibrated stereo cameras proposed by Yang & Zhang [16]. They use a personalised face model to map the correspondence points necessary for the merging of the camera views, in order to deal with the high disparity of the cameras. Civit & Montserrat [2] proposed a four camera system to decrease the disparity in the images, which enhanced the search for reliable correspondence points. Dumont et al. [3] developed a six camera system, where all computations are done dynamically and in real time using the GPU. The Fraunhofer Heinrich-Hertz Institute [5] developed the Virtual Eye Contact Engine. These systems use multiple cameras, up to six for the Dumont system. This is unrealistic for most casual users. Single camera approaches include GazeMaster, a system developed by Gemmell & Zhu [6], which segments the eyes and texture maps the face onto a head model with synthetic eyes. However to reach real time performance the tracking of the eyes proved to be too difficult with a single camera (J. Gemmell, personal communication, Januari 24, 2012). Another one camera system was suggested by Jerald & Daily [7]. The camera is mounted on the side of the display and users click on specific points on their eyes to allow for eye tracking. This user interaction is the drawback of their system. 264

9 3 Methodology This work users a single camera and template matching software to enable eye contact. The system detects and then tracks the eyes, continuously correcting the gaze. This extends the Real Time Eye Tracking and Blink Detection with OpenCV software developed by Nash Ruddin [10]. This included a blink detector to automatically locate an eye and an eye tracker. The blink detector s template matching system was extended to locate both eyes and gaze correction functionality was added. The gaze correction captures a template of the eyes looking at the camera, then blends the template with the current frame. The software solution was tested against a hardware approach, by constructing a low-budget hardware solution based on teleprompter technology. It consisted of a wooden box with a piece of glass placed at a 45 angle, functioning as a beam splitter. A user looking in the box looks straight into the camera, while perceiving the display in the reflection of the glass. Experiments were designed and conducted to measure users sense of presence while engaged in video conferencing. The main experiment used 25 participants conducting a video chat with a member of the research team either in Skype with the telepromter or with custom video conferencing software with gaze correction. A questionnaire addressing presence was filled out afterwards. 4 Results The most substantial experimental results are shown as bar graphs in Figures 1 and 2 corresponding to questions addressing immersion and eye contact respectively. For each question a χ 2 test was performed. Participants testing the hardware solution were more engaged (confidence 99%) and less distracted (confidence 95%) from the conversation than the participants testing the software solution. Eye contact induced by the hardware solution is more natural (confidence 90%) and less distracting (confidence 95%) than the eye contact induced by the software solution. Figure 2 shows that eye contact perception in general was good for both solutions. The χ 2 test was therefore performed to distinguish between a good perception (i.e. rated by number 4) and a very good perception (i.e. rated by number 5). Results show that the hardware solution induced a greater eye contact perception than the software solution (confidence level of 95%). 5 Conclusion The aim of this work was to develop solutions suitable for leisure video conferencing that allow for eye contact. The experiment aimed at comparing the software to the hardware solution. From the results of the experiment it can be concluded that the hardware solution induced a greater sense of presence and established a greater and more natural eye contact perception. Based on the experimental results and the positive feedback from the participants both systems show potential. It is our belief that with improvements the solutions could function well as eye contact enabling systems for leisure video conferencing. 265

10 Figure 1: Presence results, comparing the sense of immersion when using the hardware and software solutions. Figure 2: Presence results, comparing the sense of eye contact when using the hardware and software solutions. 6 Future Work The main technical improvement required relates to tracking the eyes more accurately. Using multiple cameras would also provide more information on the scene. External cameras are becoming cheaper and more common as are multiple integrated cameras (for example the LG Optimus 3D smartphone, Microsoft Kinect and Fujitsu LifeBook AH572 laptop). A feature that should be added to the software is gaze localization such that when the user does not look at the image of the remote user the gaze is not corrected. This could be accomplished by making use of a stored template of the user looking at the image of the remote user. For hardware, developing a tablet protective case with integrated teleprompter functionality would provide a very user friendly solution. 266

11 References [1] Presence Production. PhD thesis, [2] J. Civit and T. Montserrat. Eye Gaze Correction to Guarantee Eye Contact in Videoconferencing. IEEE Latin America Transactions, 7(3): , JUL th Conference on Software Engineering and Databases, Gijon, SPAIN, [3] M. Dumont, S. Rogmans, S. Maesen, and P. Bekaert. Optimized two-party video chat with restored eye contact using graphics hardware, [4] N. Enlund. The production of presence - distance techniques in education, publishing and art. In ACS 2000 Proceedings, [5] Fraunhofer. Virtual eye contact engine [6] J. Gemmell and D. Zhu. Implementing gaze-corrected videoconferencing. In Proceedings of CIIT, [7] J. Jerald and M. Daily. Eye gaze correction for videoconferencing. In ETRA, pages 77 81, [8] C. L. Kleinke. Gaze and eye contact: A research review. Psychological Bulletin, 100(1):78 100, [9] A. Roorda. Encyclopedia of Imaging Science and Technology, chapter Human visual system - image formation [10] N. Ruddin. Real time eye tracking and blink detection with opencv (software). Time Eye Tracking and Blink Detection, [11] S. Shiwa and M. Ishibashi. A large-screen visual telecommunication device enabling eye contact. SID Dig., 22: , [12] J. Steuer. Defining virtual reality: Dimensions determining telepresence. JOURNAL OF COMMUNICATION, 42:73 93, [13] K.-H. Tan, I. N. Robinson, B. Culbertson, and J. Apostolopoulos. Connect- Board: Enabling Genuine Eye Contact and Accurate Gaze in Remote Collaboration. IEEE Transactions on Multimedia, 13(3): , JUN [14] R. van Eijk, A. Kuijsters, K. Dijkstra, and W. IJsselsteijn. Human sensitivity to eye contact in 2d and 3d videoconferencing. In Quality of Multimedia Experience (QoMEX), 2010 Second International Workshop on, pages 76 81, june [15] B. G. Witmer and M. J. Singer. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoper. Virtual Environ., 7(3): , June [16] R. Yang and Z. Zhang. Eye gaze correction with stereovision for videoteleconferencing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(7): , JUL