Slide 1

Slide 2

Carnegie Mellon Music Understanding and the Future of Music Performance Roger B. Dannenberg Professor of Computer Science, Art, and Music Carnegie Mellon University

Slide 3

Carnegie Mellon 2 2013 Roger B. Dannenberg Why Computers and Music? Music in every human society! Computing can make music: More Fun More Available Higher Quality More Personal

Slide 4

Carnegie Mellon My Background Always interested in math and music and making things Discovered synthesizers in high school Discovered computers about the same time Discovered computer music in college Research motivated by musical experience: Computer accompaniment Expressive programming languages for music Audacity current work 3 2013 Roger B. Dannenberg

Slide 5

Carnegie Mellon 4 Overview Introduction How Is Computation Used in Music Today? New Capabilities: What Can Computers Do Tomorrow? What Will Music Be Like in the Future? 2013 Roger B. Dannenberg

Slide 6

Carnegie Mellon 5 How Is Computation Used in Music Today? http://venturebeat.com/ Indabamusic.com 2013 Roger B. Dannenberg

Slide 7

Carnegie Mellon 6 Music Computation Today Production: digital recording, editing, mixing Nearly all music production today... Records audio to (digital) disk Edit/manipulate audio digitally Equalization Reverberation Convert to media: CD MP3 Etc. protools.com 2013 Roger B. Dannenberg

Slide 8

Carnegie Mellon 7 Music Computation Today Musical Instruments: synthesizers and controllers Sonic Spring (Tomas Henriques) Linnstrument (Roger Linn) Drum Machine (Yamaha) Synthesizer (Solaris) 2013 Roger B. Dannenberg

Slide 9

Carnegie Mellon 8 Music Computation Today Distribution: compression, storage, networks Napster Apple iPod Apple iTunes Amazon Cloud Player 2013 Roger B. Dannenberg

Slide 10

Carnegie Mellon 9 Music Computation Today Search, recommendation, music fingerprinting Google Music China Music Fingerprinting Pandora Music Recommendation 2013 Roger B. Dannenberg

Slide 11

Carnegie Mellon 10 Overview Computer Music Introduction How Is Computation Used in Music Today? New Capabilities: What Can Computers Do Tomorrow? What Will Music Be Like in the Future? 2013 Roger B. Dannenberg

Slide 12

Carnegie Mellon 11 New Capabilities: What Can Computers Do Tomorrow? Computer accompaniment Style classification Score alignment Onset detection Sound synthesis 2013 Roger B. Dannenberg

Slide 13

Carnegie Mellon 12 Accompaniment Video 2013 Roger B. Dannenberg

Slide 14

Carnegie Mellon 13 Computer Accompaniment Performance Input Processing Matching Score for Performer Score for Accompaniment Performance Music Synthesis Accompaniment 2013 Roger B. Dannenberg

Slide 15

Carnegie Mellon 14 Computer Accompaniment Performance Input Processing Matching Score for Performer Score for Accompaniment Performance Music Synthesis Accompaniment Performance ABA A11 B122 B122 A123 C23 B3 G Score Dynamic Programming, plus... On-line, column-by-column evaluation Windowing for real-time evaluation Heuristics for best-yet matching Penalty for skipping notes 2013 Roger B. Dannenberg

Slide 16

Carnegie Mellon 15 Computer Accompaniment Performance Input Processing Matching Score for Performer Score for Accompaniment Performance Music Synthesis Accompaniment Rule-based system: E.g. If matcher is confident and accompaniment is ahead < 0.1s, stop until synchronized. If matcher is confident and accompaniment is behind