7/27/2019 Nijs Mpm Poster
1/1
Introduc)on
TheMusicPaintMachineisaninterac)vemusicsystem
thatintroducesmovementandexperimenta)oninmusicalinstrumentteachingthroughagame-likeexperience
ofmakingavirtualpain8ngbysimultaneouslymovingthebodyand
playingmusic.Themovementsofthemusician(e.g.twistorbendthetorso,movethefeet)anddifferentmusicalparameters(e.g.loudness,pitch)areinreal-8memappedtovisualparameters(e.g.linethickness,colour,opacity,draw
direc8on).Inthiswaythemusiciancancrea8velydealwiththe
combina8onofmusic,movementandvisualoutputtomakeavirtualpain8ng.
Design:BackgroundandMethod
Themaingoalofthedesignmethodistoembedthedesign
anddevelopmentoftheMusicPaintMachinewithina
pedagogicalframeworkandcontext
.Itfollowsamodelthatcomprises3modulesandthatischaracterizedbyaprac8ce-
basedanduser-orienteditera8veprocessthatemergesfrom
theinterac8onbetweenthemodules.Thefirstmoduleand
star8ngpointisaconceptualframeworkthatisbasedon
threebackgrounds:(1)theprac)ceofteaching,(2)atheore8calinves8ga8onoftherela)onshipbetween
musicianandmusicalinstrument(Nijs,2009,2010)and(3)aflowexperiencebasedapproachtoassessmentinmusicinstrumenteduca8on(Nijs,200).Thesecondmoduleisthe
developmentofhard-andsoware.Thethirdmoduleisthe
experimentalframeworkthataimsatmakingmusicians
prac8calknowledgeexplicitandtodevelopconsensus-based
prac8ces.
Aneduca)onalapplica)on
TheMusicPaintMachineaimsatcontribu8ngtothe
developmentofanembodiedunderstandingandcrea)veuseofmusicalparameters
.Itcomplementsexis8ngmusiceduca8onalapplica8onsbyexploringnewwaysofvisualizingmonitoringdata.Byprovidingvisualfeedbackthatisbasedontheobjec)vemeasurementofsoundandmovementbutrepresentedasacrea)veoutput(thevirtualpain8ng)itaimsatgivingfeedbackthatappealstoimagina8onands8mulates
musicalcrea8vity.Byengagingitsusersinaninterac8ve
feedbackloopbetweenmovement,musicandvisualoutput,it
inducesanimmersiveexperienceandthuss8mulatesintrinsicfeedbackmechanisms.Moreover,theMusicPaintMachineprovidesofflinefeedback(pain8ngs,datalogs)thatcanbe
usedaspedagogicaldocumenta)onforfurtherreflec8onandasdataforaprocessevalua)onofthestudentsskills.
Experiments
AfirstexperimentprobedtheMusicPaintMachinespoten8al
toinducepeakexperiences.WeusedtheFlowStateScale(Jackson&Ecklund,2004)andaself-designedPresenceState
Scale(Nijs,submi[ed).Furthermorepar8cipantswereasked
toevaluatethedidac8cpoten8aloftheMusicPaintMachine,
basedontheirexperienceofusingit.Fiy-oneamateur
musiciansand4teacherspar8cipatedinthisexperiment.
ResultsshowmoderatelyhighFlowandPresenceStateScales.Furthermoreastrongposi8vecorrela8onwasfoundbetweenbothscales,whichvalidatesthecombineduseofthe
conceptsofflowandpresenceintheconceptualframework
(Nijsetal,2009).Remarksofthepar8cipantsclearlyindicated
hard-andsowareissuesthatneedtobeaddressedinthe
furtherdevelopmentoftheapplica8oninordertoincrease
bothscales.Thedidac)cpoten)aloftheMusicPaintMachinewashighlyes8matedbybothteachersandamateur
musicians.
The Music Paint
MachineS"mula"nganembodiedunderstandingandcrea"veuse
ofmusicalparameters
LucNijspromotor:MarcLeman
collaborators:Dr.M.Lesaffre,Drs.B.Moens,Drs.P.Coussement,I.Schepers
contact:[email protected]
JACKSON,S.A.,&EKLUND,R.C.(2004.Theflowscalesmanual.Morgantown,WV:FitnessInforma8onTechnology.NIJS,L.,MOENS,B.,LESAFFRE,M.&LEMAN,M.TheMusicPaintMachine.S8mula8ngself-monitoringthroughinterac8vity.Submi[edtoJNMR,specialissueonmonitoring.NIJS,L.,COUSSEMENT,P.,MLLER,C.,LESAFFRE,M.,&LEMAN,M.(2010.TheMusicPaintMachine:amul"modalinterac"vepla=ormtos"mulatemusicalcrea"vityininstrumentalprac"ce.PaperpresentedattheSecondInterna8onalConferenceonComputersupported
Educa8on,Valencia,Spain.NIJS,L.,LESAFFRE,M.,&LEMAN,M.(2009.Themusicalinstrumentasanaturalextensionofthemusician.PaperpresentedattheFihConferenceon
InterdisciplinaryMusicology,Paris.NIJS,L.(2008.Evalua8einhetDKO:Hetschietloodinac8e.Begeleidzelfstandigleren,Alterna"eveevalua"e6(21).
Photo:BennDeceuninck
