Dokumentasjon. Prosjekt: Systematiske oversikter innen bruk av blended learning hos helsefagstudenter. Litteratursøk utført av:

Transkript

1 Program for forskning innen digitalisering og læring Dokumentasjon Prosjekt: Systematiske oversikter innen bruk av blended learning hos helsefagstudenter Litteratursøk utført av: Malene W. Gundersen, Universitetsbiblioteket OsloMet Dato:

2 Spesifisering av litteratursøket Databaser: Populasjon: Tiltak: Tidsavgrensning: Språk: Studiedesign: Medline, Embase, PsycINFO, The Cochrane Library, Epistemonikos, Cinahl, ERIC, Education Source, Teacher Reference Center, Web of Science og Scopus Studenter innen helsefag Blended learning Publisert i 2010 eller senere Engelsk, norsk, svensk og dansk. Systematiske oversikter Inklusjonskriterier for litteratursøket innen blended learning Felles for alle litteratursøkene som utføres i tilknytning til oppbygging og utvidelse av Læringsbiblioteket.no, er kriteriene knyttet til kunnskapsoppsummeringer, helsefag samt publiseringsår og -språk. De inkluderte oversiktene må gi innsikt i effekten av ulike digitale, didaktive virkemidler gjennom inklusjon av studier som sammenligner forskjellige virkemidler eller gjennom før-nå studier. Videre inkluderes også studier som ikke primært er effektstudier av et digitalt, didaktiske virkemiddel, men hvor dette allikevel er gjenstand for spesifisert vurdering. Alt det ovenstående vil være likt for enhver screening som utføres. Det siste inklusjonskriteriet vil variere mellom litteratursøkene ettersom det er dette kriteriet som gjør at litteratursøkene skiller seg fra hverandre. I et tilfelle vil det dreie seg om blended learning, i et annet tilfelle simulering, simulering, apper, kunstig intelligens, eller lignende. I teksten under gjennomgås først de generelle inklusjonskriteriene som vil bli brukt for i enhver screening, dernest vil inklusjonskriteriet for blended learning bli gjennomgått. Kunnskapsoppsummeringer: Det er mange måter forfattere kan beskrive metoden sin på. Enten ved eksplisitt å identifisere kunnskapsoppsummeringen som en gitt publikasjonstype eller mer implisitt ved i metodeavsnittet å beskrive de metodologiske valgene tatt underveis. Uansett ønsker vi at de kunnskapsoppsummeringer som inkluderes i Læringsbiblioteket skal ha (basert på Petticrew og Roberts, 2006): en tydelig definert problemstilling en dokumentert og transparent søkehistorikk tydelige inklusjons- og eksklusjonskriterier kvalitetsvurdering av inkluderte studier en samlet analyse Det vil altså si at vi ikke utelukkende inkluderer kunnskapsoppsummeringer som eksplisitt er definert av forfatterne som systematiske oversikter eller meta-analyser, vi inkluderer også kunnskapsoppsummeringer som oppfyller punktene for oppsummert kunnskap uten å benytte dette begrepet. For eksempel vil studier presentert som integrative review inkluderes dersom de ved nærmere undersøkelser tilfredsstiller kravene til relevans og metodekvalitet. I noen tilfeller vil det kunne være innvendinger til kvaliteten eller tydeligheten på enkelte av disse punktene. Slike mangler eller svakheter vil bli kommentert senere i prosessen når de inkluderte kunnskapsoppsummeringene gjennomgår en vurdering av kvaliteten på metoden forfatterne har brukt. Helsefag ved OsloMet: Vi er spesielt interessert i å finne forskning som i størst mulig grad avspeiler fagområder som er relevante for de helsefaglige utdanningene som tilbys ved OsloMet, det vil si: Sykepleie Fysioterapi

3 Ergoterapi Ortopedi Radiografi Farmasi Vernepleie Tannteknikk Samfunnsernæring Prehospitalt arbeid/paramedic Bioingeniørfag Biomedisin Atferdsanalyse Helsevitenskap Rehabilitering/habilitering Psykisk helsearbeid Empowerment og helsefremmende arbeid Jordmorfag Kognitiv atferdsterapi Stråleterapi Helsesøsterutdanning Velferdsteknologi Folkehelse Seksuell helse Vi vil også inkludere kunnskapsoppsummeringer som inkluderer helsefagstudenter generelt. Derimot vil kunnskapsoppsummeringer gjort på mindre studentgrupper, for eksempel avgrensede studentgrupper med en gitt diagnose, vil ikke bli inkludert. Kunnskapsoppsummeringer som tar for seg høyere utdanning generelt (higher education) uten å snevre inn mot helse, vil ikke bli inkludert. Det forutsettes at elementet knyttet til utdanning innen helse må fremkomme tydelig i sammendraget for at kunnskapsoppsummeringen skal bli inkludert. Nyere forskning: Med nyere forskning menes: Litteratur publisert i 2010 eller senere Følgende språk inkluderes: Engelsk, norsk, dansk og svensk. Blended learning: Ettersom formålet med forskningsdatabasen ikke er å syntetisere flere systematiske oversikter betyr det at definisjonen på blended learning kan tillates å være videre for å identifisere mest mulig relevant forskning, enn det som hadde vært hensiktsmessig dersom formålet var syntetisering. Med den mer vide bruk av dette begrepet som inklusjonskriterium, antas det at metodene/teknologiene som brukes i forskningen avspeiler en større heterogenitet enn man ville se i en oversikt over oversikter. I dette tilfellet har vi brukt følgende inklusjonskriterier for blended learning: Bruk av teknologi i kombinasjon med ansikt-til-ansikt møte i undervisningsøyemed Kombinasjon av mer tradisjonelle pedagogikker med et fysisk element, hvorav minst en inneholder en teknologisk/digital komponent En kombinasjon av online og offline læring

4 Søkehistorikk Database: Ovid MEDLINE(R) Epub Ahead of Print, In-Process & Other Non-Indexed Citations, Ovid MEDLINE(R) Daily and Ovid MEDLINE(R) 1946 to Present Dato: Treff: 659 # Searches Results 1 exp Health Occupations/ed [Education] exp Education, Professional/ exp Students/ (student* or education*).tw,kw,kf or 2 or 3 or (meta analysis.pt,tw,kw,kf. or review.pt. or medline.tw. or systematic* review*.tw,kw,kf. or review.ti,kw,kf.) and ("2010" or "2011" or "2012" or "2013" or "2014" or "2015" or "2016" or "2017" or "2018").yr. and (english or norwegian or swedish or danish).lg. 7 5 and Computer Assisted Instruction/ Education, Distance/ Educational Technology/ Webcasts as Topic/ ((blended or combined or distributed or interactive or electronic) adj2 (learning or teaching 4643 or technolog* or instruction*)).tw,kw,kf. 13 ((online adj2 (learning or syllabus or activit* or methodology* or teaching or education)) or 5285 e-learning or ((educational or instructional) adj technolog*)).tw,kw,kf. 14 (((technology-mediated or technology-enhanced or web-based or virtual) adj (instruction* 4442 or learning or training)) or TEL or VLE or ((web or internet or technology) adj based learning)).tw,kw,kf. 15 (web-enhanced instruction* or ((virtual or integrated) adj2 (learning or instruction* or 1064 classroom*)) or instructional television or (hybrid adj (learning or course*)) or audiographics).tw,kw,kf. 16 ((computer adj (aided or assisted or based or supported) adj (instruction or learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) adj (learning or instruction))).tw,kw,kf. 17 (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or 96 computeri#ed instruction* or "computers and learning" or "computers in education" or computing education).tw,kw,kf.

5 18 ((digital adj (learning or technolog*)) or intelligent tutoring system* or interactive white 3167 board* or ((mobile or multimedia or online) adj2 learning) or online self study or online study).tw,kw,kf. 19 or/ and Database: Ovid Embase <1974 to 2018 March 13> Dato: Treff: 627 # Searches Results 1 exp paramedical education/ exp medical education/ exp health student/ continuing education/ vocational education/ (student* or education*).tw,kw or/1-5, (meta analysis.pt,tw,kw. or review.pt. or medline.tw. or systematic* review*.tw,kw. or review.ti,kw.) and ("2010" or "2011" or "2012" or "2013" or "2014" or "2015" or "2016" or "2017" or "2018").yr. and (english or norwegian or swedish or danish).lg and educational technology/ webcast/ ((blended or combined or distributed or interactive or electronic) adj2 (learning or teaching or technolog* or instruction*)).tw,kw. 13 ((online adj2 (learning or syllabus or activit* or methodology* or teaching or education)) or e-learning or ((educational or instructional) adj technolog*)).tw,kw. 14 (((technology-mediated or technology-enhanced or web-based or virtual) adj (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) adj based learning)).tw,kw

6 15 (web-enhanced instruction* or ((virtual or integrated) adj2 (learning or instruction* or 1393 classroom*)) or instructional television or (hybrid adj (learning or course*)) or audiographics).tw,kw. 16 ((computer adj (aided or assisted or based or supported) adj (instruction or learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) adj (learning or instruction))).tw,kw. 17 (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or 113 computeri#ed instruction* or "computers and learning" or "computers in education" or computing education).tw,kw. 18 ((digital adj (learning or technolog*)) or intelligent tutoring system* or interactive white 3980 board* or ((mobile or multimedia or online) adj2 learning) or online self study or online study).tw,kw. 19 or/ and Database: Ovid PsycINFO <1806 to March Week > Dato: Treff: 630 # Searches Results 1 exp higher education/ social work education/ nursing education/ continuing education/ students/ exp college students/ dental students/ medical students/ graduate students/ postgraduate students/ vocational school students/ seminarians/ reentry students/ (student* or education*).tw or/

7 16 ("literature review"/ or meta analysis/ or ("0800" or "0830" or "1200" or "1300").md. or meta analysis.tw. or medline.tw. or systematic* review*.tw. or review.ti.) and ("2010" or "2011" or "2012" or "2013" or "2014" or "2015" or "2016" or "2017" or "2018").yr. and (english or norwegian or swedish or danish).lg and computer assisted instruction/ intelligent tutoring systems/ programmed instruction/ teaching machines/ electronic learning/ distance education/ computer mediated communication/ electronic communication/ virtual classrooms/ ((blended or combined or distributed or interactive or electronic) adj2 (learning or teaching 5265 or technolog* or instruction*)).tw. 28 ((online adj2 (learning or syllabus or activit* or methodology* or teaching or education)) or e-learning or ((educational or instructional) adj technolog*)).tw. 29 (((technology-mediated or technology-enhanced or web-based or virtual) adj (instruction* 3249 or learning or training)) or TEL or VLE or ((web or internet or technology) adj based learning)).tw. 30 (web-enhanced instruction* or ((virtual or integrated) adj2 (learning or instruction* or 2746 classroom*)) or instructional television or (hybrid adj (learning or course*)) or audiographics).tw. 31 ((computer adj (aided or assisted or based or supported) adj (instruction or learning or 4459 teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) adj (learning or instruction))).tw. 32 (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or 333 computeri#ed instruction* or "computers and learning" or "computers in education" or computing education).tw. 33 ((digital adj (learning or technolog*)) or intelligent tutoring system* or interactive white 8689 board* or ((mobile or multimedia or online) adj2 learning) or online self study or online study).tw. 34 or/ and

8 Database: The Cochrane Library Dato: Treff: 20 ID Search Hits #1 MeSH descriptor: [Health Occupations] explode all trees and with qualifier(s): [Education - ED] 2967 #2 MeSH descriptor: [Education, Professional] explode all trees 4356 #3 MeSH descriptor: [Students] explode all trees 3606 #4 (student* or education*):ti,ab,kw #5 {or #1-#4} #6 MeSH descriptor: [Computer-Assisted Instruction] this term only 1178 #7 MeSH descriptor: [Education, Distance] this term only 110 #8 MeSH descriptor: [Educational Technology] this term only 64 #9 MeSH descriptor: [Webcasts as Topic] explode all trees 19 #10 ((blended or combined or distributed or interactive or electronic) near/2 (learning or teaching 427 or technolog* or instruction*)):ti,ab,kw #11 ((online near/2 (learning or syllabus or activit* or methodology* or teaching or education)) or 667 "e-learning" or ((educational or instructional) next technolog*)):ti,ab,kw #12 ((("technology-mediated" or "technology-enhanced" or "web-based" or virtual) next 481 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) next "based learning")):ti,ab,kw #13 (web-enhanced instruction* or ((virtual or integrated) near/2 (learning or instruction* or 77 classroom*)) or instructional television or (hybrid next (learning or course*)) or audiographics):ti,ab,kw #14 ((computer next (aided or assisted or based or supported) next (instruction or learning or 2577 teaching)) or CAI or CAL or CBL or (("multi-method" or "mixed mode") next (learning or instruction))):ti,ab,kw #15 ("lecture capture" or "1 to 1 computer" or "one to one computer" or "one2one computer" or 1 "computeri?ed instruction" or "computers and learning" or "computers in education" or "computing education"):ti,ab,kw #16 {or #6-#15} 3940 #17 #5 and #16 Publication Year from 2010 to 2018, in Other Reviews and Technology Assessments 20 Database: Epistemonikos Dato: Treff: 168 title_en:(student* OR education) OR advanced_abstract_en:(student* OR education)) AND (advanced_title_en:(("blended learning" OR "blended teaching" OR "blended technology" OR "blended instruction" OR "combined learning" OR "combined teaching" OR "combined technology" OR "combined instruction" OR "distributed learning" OR "distributed teaching" OR "distributed technology" OR "distributed instruction" OR "interactive learning" OR "interactive teaching" OR "interactive technology" OR "interactive instruction" OR "electronic learning" OR "electronic teaching" OR "electronic technology" OR "electronic instruction" OR "online learning" OR "online syllabus" OR "online activity" OR "online methodology" OR "online teaching" OR "online education" OR "e-learning" OR "educational technology" OR "instructional technology" OR "technology-mediated" OR "technology-enhanced" OR "web-based" OR "virtual training" OR TEL OR VLE OR "based learning" OR "web-enhanced instruction" OR "virtual learning" OR "virtual instruction" OR "virtual classroom" OR "integrated learning" OR "integrated instruction" OR "integrated classroom" OR "instructional television" OR "hybrid learning" OR "hybrid course" OR audiographics OR "computer aided" OR "Computer

9 assisted" OR "Computer based" OR "Computer supported" OR CAI OR CAL OR CBL OR "multi-method learning" OR "multi-method instruction" OR "mixed mode learning" OR "mixed mode instruction" OR "lecture capture" OR "1 to 1 computer" OR "one to one computer" OR "one2one computer" OR "computerised instruction" OR "computerized instruction" OR "computers AND learning" OR "computers in education" OR "computing education")) OR advanced_abstract_en:(("blended learning" OR "blended teaching" OR "blended technology" OR "blended instruction" OR "combined learning" OR "combined teaching" OR "combined technology" OR "combined instruction" OR "distributed learning" OR "distributed teaching" OR "distributed technology" OR "distributed instruction" OR "interactive learning" OR "interactive teaching" OR "interactive technology" OR "interactive instruction" OR "electronic learning" OR "electronic teaching" OR "electronic technology" OR "electronic instruction" OR "online learning" OR "online syllabus" OR "online activity" OR "online methodology" OR "online teaching" OR "online education" OR "e-learning" OR "educational technology" OR "instructional technology" OR "technology-mediated" OR "technology-enhanced" OR "web-based" OR "virtual training" OR TEL OR VLE OR "based learning" OR "web-enhanced instruction" OR "virtual learning" OR "virtual instruction" OR "virtual classroom" OR "integrated learning" OR "integrated instruction" OR "integrated classroom" OR "instructional television" OR "hybrid learning" OR "hybrid course" OR audiographics OR "computer aided" OR "Computer assisted" OR "Computer based" OR "Computer supported" OR CAI OR CAL OR CBL OR "multimethod learning" OR "multi-method instruction" OR "mixed mode learning" OR "mixed mode instruction" OR "lecture capture" OR "1 to 1 computer" OR "one to one computer" OR "one2one computer" OR "computerised instruction" OR "computerized instruction" OR "computers AND learning" OR "computers in education" OR "computing education"))) [Filters: classification=systematic-review, protocol=no, min_year=2010, max_year=2018] Database: Cinahl Dato: Treff: 276 # Query Results S1 (MH "Health Occupations+/ED") 26,702 S2 (MH "Education, Health Sciences+") 198,206 S3 (MH "Education, Physical Education") 155 S4 (MH "Students+") 79,321 S5 TI ( (student* or education) ) OR AB ( (student* or education) ) 225,961 S6 S1 OR S2 OR S3 OR S4 OR S5 393,444 S7 ((PT review) or (PT systematic review) or (PT meta analysis) or (TI meta analy* or AB meta 122,350 analy* or MW meta analy*) or (TI systematic* review* or AB systematic* review*) or (TI review) or (AB medline)) AND (PY 2010 or PY 2011 or PY 2012 or PY 2013 or PY 2014 or PY 2015 or PY 2016 or PY 2017 or PY 2018) AND (LA english OR LA norwegian OR LA swedish OR LA danish) S8 S6 AND S7 9,665 S9 (MH "Programmed Instruction") 328 S10 (MH "Computer Assisted Instruction") 5,046 S11 (MH "Computer User Training") 673 S12 (MH "Education, Non-Traditional") 6,889 S13 (MH "Educational Technology") 1,093 S14 (MH "Webcasts") 106 S15 (MH "Webinars") 314 S16 TI ( ((blended or combined or distributed or interactive or electronic) N2 (learning or teaching or technolog* or instruction*)) ) OR AB ( ((blended or combined or distributed or interactive or electronic) N2 (learning or teaching or technolog* or instruction*)) ) 1,985

10 S17 TI ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or 3,294 education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) OR AB ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) S18 TI ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 1,407 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) OR AB ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) S19 TI ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* or 703 classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) OR AB ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* or classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) S20 TI ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or learning or 1,921 teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) N1 (learning or instruction))) ) OR AB ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) N1 (learning or instruction))) ) S21 TI ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one 76 computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) OR AB ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) S22 TI ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive 3,296 white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) OR AB ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) S23 S9 OR S10 OR S11 OR S12 OR S13 OR S14 OR S15 OR S16 OR S17 OR S18 OR S19 OR S20 20,616 OR S21 OR S22 S24 S8 AND S Database: ERIC Dato: Treff: 1010 # Query Results S1 (DE "Postdoctoral Education" OR DE "Professional Education" OR DE "Graduate Medical 69,739 Education" OR DE "Nursing Education" OR DE "Pharmaceutical Education" OR DE "Allied Health Occupations Education" OR DE "Medical Education" OR DE "Professional Continuing Education" OR DE "Professional Training" OR DE "Vocational Education") S2 (DE "Nursing Students" OR DE "Students" OR DE "College Seniors" OR DE "College 165,179 Freshmen" OR DE "Undergraduate Students" OR DE "Graduate Medical Education" OR DE "Doctoral Degrees" OR DE "Masters Degrees" OR DE "Postdoctoral Education" OR DE "Undergraduate Study" OR DE "Premedical Students" OR DE "Graduate Students" OR DE "College Students" OR DE "Medical Students" OR DE "Doctoral Programs" OR DE "Graduate Study" OR DE "Masters Programs" OR DE "Graduates" OR DE "College Graduates" OR DE "Foreign Medical Graduates" OR DE "Associate Degrees" OR DE "Bachelors Degrees" OR DE "Doctoral Degrees" OR DE "Masters Degrees") S3 TI ( student* or education ) OR AB ( student* or education ) 850,529 S4 S1 OR S2 OR S3 901,935

11 S5 (DE "Literature Reviews" OR DE "Meta Analysis" OR DE "State of the Art Reviews" OR TI ( 9,567 meta analysis or systematic* review* ) OR AB ( meta analysis or systematic* review* ) OR TI review) AND (YR 2010 or YR 2011 or YR 2012 or YR 2013 or YR 2014 or YR 2015 or YR 2016 or YR 2017 or YR 2018) AND (LA English OR LA norwegian OR LA swedish OR LA danish) S6 S4 AND S5 5,480 S7 DE "Blended Learning" 3,378 S8 DE "Intelligent Tutoring Systems" 1,016 S9 DE "Computer Managed Instruction" 1,443 S10 DE "Integrated Learning Systems" 1,550 S11 DE "Programmed Instructional Materials" 95 S12 DE "Programmed Tutoring" 104 S13 DE "Computer Assisted Instruction" 28,956 S14 DE "Interactive Video" 1,876 S15 DE "Learner Controlled Instruction" 1,524 S16 DE "Virtual Universities" 462 S17 DE "Instructional Systems" 1,421 S18 DE "Performance Technology" 985 S19 DE "Educational Media" 8,031 S20 DE "Autoinstructional Aids" 1,540 S21 DE "Multimedia Instruction" 5,431 S22 DE "Audiovisual Instruction" 2,284 S23 DE "Virtual Classrooms" 2,596 S24 DE "Web Based Instruction" 5,646 S25 DE "Computer Uses in Education" 22,489 S26 DE "Electronic Learning" 9,920 S27 DE "Educational Technology" 43,320 S28 DE "Technology Integration" 10,197 S29 DE "Technology Uses in Education" 13,112 S30 DE "Distance Education" 16,558 S31 DE "Asynchronous Communication" 1,272 S32 DE "Nontraditional Education" 8,781 S33 TI ( ((blended or combined or distributed or interactive or electronic) N2 (learning or 9,301 teaching or technolog* or instruction*)) ) OR AB ( ((blended or combined or distributed or interactive or electronic) N2 (learning or teaching or technolog* or instruction*)) ) S34 TI ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or 21,709 education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) OR AB ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) S35 TI ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 5,052 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) OR AB ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) S36 TI ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* or 7,494 classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) OR AB ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* or classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) S37 TI ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) N1 (learning or instruction))) ) OR AB ( ((computer N1 (aided or assisted or based or supported) N1 9,500

12 (instruction or learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) N1 (learning or instruction))) ) S38 TI ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one 1,615 computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) OR AB ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) S39 TI ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive 13,737 white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) OR AB ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) S40 S7 OR S8 OR S9 OR S10 OR S11 OR S12 OR S13 OR S14 OR S15 OR S16 OR S17 OR S18 OR 137,991 S19 OR S20 OR S21 OR S22 OR S23 OR S24 OR S25 OR S26 OR S27 OR S28 OR S29 OR S30 OR S31 OR S32 OR S33 OR S34 OR S35 OR S36 OR S37 OR S38 OR S39 S41 S6 AND S Database: Education Source Dato: Treff: 963 # Query Results S1 DE "Associate degree education" OR DE "Associate degree nursing education" OR DE 198,556 "Baccalaureate nursing education" OR DE "Bachelor of science degree" or DE "Bachelor's degree" or DE "Chiropractic education" or DE "Chiropractic students" or DE "Clinical medical education" or DE "College graduates" or DE "College juniors" or DE "College seniors" or DE "College sophomores" or DE "College students" or DE "Continuing education of nurses" or DE "Continuing education" or DE "Dental education" or DE "Dental students" or DE "Discrimination in medical education" or DE "Doctoral degree" or DE "Doctoral programs" or DE "Education of physicians' assistants" or DE "Graduate education" or DE "Graduate students" or DE "Health occupations schools" or DE "Health occupations students" or DE "In-service training of nurses" or DE "Male college students" or DE "Master's degree" or DE "Medical education" or DE "Medical school applicants" or DE "Medical students" or DE "Medicine -- Study & teaching" or DE "Nursing education (Graduate)" or DE "Nursing education" or DE "Nursing school graduates" or DE "Nursing students" or DE "Occupational therapy students" or DE "Osteopathic students" or DE "Paramedical education" or DE "Pharmaceutical education" or DE "Pharmacy students" or DE "Physical therapy education" or DE "Physician assistant students" or DE "Podiatry students" or DE "Postdoctoral programs" or DE "Preceptorship in nursing education" or DE "Premedical education" or DE "Premedical students" or DE "Professional education" or DE "Prosthesis -- Study & teaching" or DE "Public health nursing education" or DE "Students" or DE "Television in nursing education" or DE "Undergraduates" or DE "Vocational education" or DE "Women college students" or DE "Women medical students" S2 TI ( student* or education ) OR AB ( student* or education ) 1,412,807 S3 S1 OR S2 1,448,920 S4 (PT review or TI ( meta analysis or systematic* review* ) OR AB ( meta analysis or 382,292 systematic* review* ) OR TI review) AND (PY 2010 or PY 2011 or PY 2012 or PY 2013 or PY 2014 or PY 2015 or PY 2016 or PY 2017 or PY 2018) AND (LA english OR LA norwegian OR LA swedish OR LA danish) S5 S3 AND S4 15,922

13 S6 S7 S8 DE "Asynchronous learning" Or DE "Asynchronous learning" or DE "Blended learning" or DE "Computer assisted instruction" or DE "Computer assisted language instruction" or DE "Computer assisted reading instruction or DE "Computer conferencing in education" or DE "Computer managed instruction" or DE "Computers in education" or DE "Cyberschools" or DE "Distance education" or DE "Educational technology" or DE "Instructional innovations" or DE "Instructional systems design" or DE "Instructional systems" or DE "Integrated learning systems" or DE "Intelligent tutoring systems" or DE "Interactive videos" or DE "Mobile communication systems in education" or DE "One-to-one computing in education" or DE "Online reading programs" or DE "Performance technology" or DE "Process-oriented guided inquiry learning" or DE "Programmed instruction" or DE "Tablet computers in education" or DE "Teaching machines" or DE "Virtual classrooms" or DE "Virtual universities & colleges" or DE "Web-based instruction" TI ( ((blended or combined or distributed or interactive or electronic) N2 (learning or teaching or technolog* or instruction*)) ) OR AB ( ((blended or combined or distributed or interactive or electronic) N2 (learning or teaching or technolog* or instruction*)) ) TI ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) OR AB ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) 115,528 12,790 35,501 S9 TI ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 7,978 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) OR AB ( (((technology-mediated or technology-enhanced or webbased or virtual) N1 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) S10 TI ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* 7,263 or classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) OR AB ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* or classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) S11 TI ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or 6,709 learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) N1 (learning or instruction))) ) OR AB ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or learning or teaching)) or CAI or CAL or CBL or ((multimethod or mixed mode) N1 (learning or instruction))) ) S12 TI ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one 1,764 computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) OR AB ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) S13 TI ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive 21,993 white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) OR AB ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) S14 S6 OR S7 OR S8 OR S9 OR S10 OR S11 OR S12 OR S13 151,010 S15 S5 AND S14 963

14 Database: Teacher Reference Center Dato: Treff: 47 # Query Results S1 TI ( student* or education ) OR AB ( student* or education ) 367,965 S2 TI ( meta analysis or systematic* review* ) OR AB ( meta analysis or systematic* 113,327 review* ) OR TI review) S3 S1 AND S2 1,234 S4 TI ( ((blended or combined or distributed or interactive or electronic) N2 (learning or 817 teaching or technolog* or instruction*)) ) OR AB ( ((blended or combined or distributed or interactive or electronic) N2 (learning or teaching or technolog* or instruction*)) ) S5 TI ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or 2,710 education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) OR AB ( ((online N2 (learning or syllabus or activit* or methodology* or teaching or education)) or "e-learning" or ((educational or instructional) N1 technolog*)) ) S6 TI ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 402 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) OR AB ( (((technology-mediated or technology-enhanced or web-based or virtual) N1 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) N1 based learning)) ) S7 TI ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* 447 or classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) OR AB ( (web-enhanced instruction* or ((virtual or integrated) N2 (learning or instruction* or classroom*)) or instructional television or (hybrid N1 (learning or course*)) or audiographics) ) S8 TI ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or 241 learning or teaching)) or CAI or CAL or CBL or ((multi-method or mixed mode) N1 (learning or instruction))) ) OR AB ( ((computer N1 (aided or assisted or based or supported) N1 (instruction or learning or teaching)) or CAI or CAL or CBL or ((multimethod or mixed mode) N1 (learning or instruction))) ) S9 TI ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one 64 computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) OR AB ( (lecture captur* or "1 to 1 computer" or "one to one computer" or "one2one computer" or computeri?ed instruction* or "computers and learning" or "computers in education" or computing education) ) S10 TI ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive 1,569 white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) OR AB ( ((digital N1 (learning or technolog*)) or intelligent tutoring system* or interactive white board* or ((mobile or multimedia or online) N2 learning) or online self study or online study) ) S11 S4 OR S5 OR S6 OR S7 OR S8 OR S9 OR S10 4,881 S12 S3 AND S11 Limiters - Published Date: Narrow by Language: - english 47

15 Database: Web of Science Dato: Treff: 641 Set Search Results #1 TS=(student* or education*) 951,420 #2 (DT=(Review)) AND (PY=(2010 or 2011 or 2012 or 2013 or 2014 or 2015 or 2016 or 678, or 2018)) AND (LA=(english or norwegian or swedish or danish)) #3 #2 AND #1 18,431 #4 TS=((blended or combined or distributed or interactive or electronic) NEAR/2 22,381 (learning or teaching or technolog* or instruction*)) #5 TS=((online NEAR/2 (learning or syllabus or activit* or methodology* or teaching or 21,074 education)) or "e-learning" or ((educational or instructional) NEAR/1 technolog*)) #6 TS=((("technology-mediated" or "technology-enhanced" or "web-based" or virtual) 14,598 NEAR/1 (instruction* or learning or training)) or TEL or VLE or ((web or internet or technology) NEAR/1 "based learning")) #7 TS=("web-enhanced instruction*" or ((virtual or integrated) NEAR/2 (learning or 7,887 instruction* or classroom*)) or "instructional television" or (hybrid NEAR/1 (learning or course*)) or audiographics) #8 TS=((computer NEAR/1 (aided or assisted or based or supported) NEAR/1 (instruction 36,320 or learning or teaching)) or CAI or CAL or CBL or (( multi-method or mixed mode ) NEAR/1 (learning or instruction))) #9 TS=("lecture captur*" or "1 to 1 computer" or "one to one computer" or "one2one 383 computer" or "computeri?ed instruction*" or "computers and learning" or "computers in education" or "computing education") #10 TS=((digital NEAR/1 (learning or technolog*)) or "intelligent tutoring system*" or 18,455 "interactive white board*" or ((mobile or multimedia or online) NEAR/2 learning) or "online self study" or "online study") #11 #10 OR #9 OR #8 OR #7 OR #6 OR #5 OR #4 103,994 #12 #11 AND #3 641 Database: Scopus Dato: Treff: 684 ( ( TITLE-ABS-KEY ( ( ( blended OR combined OR distributed OR interactive OR electronic ) W/2 ( learning OR teaching OR technolog* OR instruction* ) ) ) ) OR ( TITLE-ABS-KEY ( ( ( online W/2 ( learning OR syllabus OR activit* OR methodology* OR teaching OR education ) ) OR "e-learning" OR ( ( educational OR instructional ) PRE/1 technolog* ) ) ) ) OR ( TITLE-ABS-KEY ( "web-enhanced instruction*" OR ( ( virtual OR integrated ) W/2 ( learning OR instruction* OR classroom* ) ) OR "instructional television" OR ( hybrid PRE/1 ( learning OR course* ) ) OR audiographics ) ) OR ( TITLE-ABS-KEY ( ( computer PRE/1 ( aided OR assisted OR based OR supported ) PRE/1 ( instruction OR learning OR teaching ) ) OR cai OR cal OR cbl OR ( ( "multi-method" OR "mixed mode" ) PRE/1 ( learning OR instruction ) ) ) ) OR ( TITLE-ABS-KEY ( "lecture captur*" OR "1 to 1 computer" OR "one to one computer" OR "one2one computer" OR "computeri?ed instruction*" OR "computers and learning" OR "computers in education" OR "computing education" ) ) OR ( TITLE-ABS-KEY ( ( ( ( "technology-mediated" OR "technology-enhanced" OR "web-based" OR virtual ) PRE/1 ( instruction* OR learning OR training ) ) OR tel OR vle OR ( ( web OR internet OR technology ) PRE/1 "based learning" ) ) ) ) OR ( TITLE-ABS-KEY ( ( digital PRE/1 ( learning OR technolog* ) ) OR "intelligent tutoring system*" OR "interactive white board*" OR ( ( mobile OR multimedia OR online ) W/2 learning ) OR "online self study" OR "online study" ) ) ) AND ( ( TITLE-ABS-KEY ( ( "dental technician" OR "laboratory technician" OR "medical technician" OR "medicine technician" OR "biomedical engineering"

16 OR "Laboratory Scientist" OR "laboratory science" OR "Medical Laboratory" OR "Biomedical laboratory" OR "Clinical Laboratory" OR "Medical Technolog*" OR "ambulance technician" ) W/3 ( student* OR education* ) ) ) OR ( TITLE-ABS-KEY ( ( health OR healthcare OR clinical OR medical OR physiotherapy OR "physical therapy" OR nurse* OR nursing OR ergotherapy OR "ergo therapy" OR "occupational therapy" OR prosthetics OR orthotic* OR radiography OR pharmacy OR pharmacist* OR "social educator" OR paramedic OR "non-medical" OR emt OR "Emergency medical" OR audiologist OR pathologist OR pathology ) W/3 ( student* OR education* ) ) ) ) AND ( ( ( DOCTYPE ( re ) OR ( TITLE-ABS-KEY ( "systematic* review*" ) ) OR TITLE ( review ) ) AND ( PUBYEAR > 2009 ) AND ( LANGUAGE ( english OR norwegian OR swedish OR danish ) ) ) )

17 Included Eligibility Screening Identification PRISMA Records identified through database searching (n = 5752) Additional records identified through other sources (n = 0) Records after duplicates removed (n = 3571) Records screened (n = 3571) Records excluded (n = 3403) Full-text articles assessed for eligibility (n = 168) Full-text articles excluded, with reasons (n = 153) Ikke review: 26 Feil populasjon: 38 Ikke blended: 86 Annet språk: 1 Usikkert tidsskrift: 2 Studies included (n = 15) From: Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta- Analyses: The PRISMA Statement. PLoS Med 6(7): e doi: /journal.pmed For more information, visit