第4章 多媒体音频信息处理

Embed Size (px)

DESCRIPTION

第4章 多媒体音频信息处理. 声音是多媒体信息的一个重要组成部分,也是表达思想和情感的一种必不可少的媒体。无论其应用目的是什么,声音的合理使用可以使多媒体应用系统变得更加丰富多彩。在多媒体系统中,音频可被用作输入或输出。输入可以是 自然语言或语音命令 ,输出可以是语音或音乐,这些都涉及到音频处理技术。. STOP. 4.1 音频信号及其概念 - PowerPoint PPT Presentation

Citation preview

  • 4 , STOP

  • 4.1 4.1.1 19

  • CD---(Audio)

  • 4.1.2 ,

  • Hello4-14-1 Hello

  • 4.1.3 (Hz)(kHz)50005000Hz5kHz300Hz3000Hz20 Hz(Subsonic)20Hz20kHz(Audio)20kHz(Ultrasonic)

  • (4-2) (dB)4-2

  • 4.1.4 A/DD/A A/DD/AAAnalog()DDigital ()A/D A/D4-3A/DD/A4-4CD A/D

  • 4-3 8A/D4-4 A/DD/A

  • 4.1.5

  • 4.1.6

  • 4-54-5 (AUDIO TEST)

  • SNR(Signal to Noise Ration)(dB)

  • MOS(Mean Opinion Score)MOS4. 4.1 MOS

    MOS5(Excellent)4(Good)3(Fair)2(Poor)()1(Unacceptable)()

  • 4 CD-DASuper HiFi(High Fidelity) FM(Frequency Modulation) AM(Amplitude Modulation) (Telephone) 4CD-DA

  • 4-6 44-64

  • 4.2 4-7 A/DA/D 4-7

  • 4.2.1 2040(Shannon) (Sampling)

  • Nyquist CDPCM8000CD44.1kHz22050Hz

  • 4.2.2 ()? 16(bit) 828(quantization levels)16,216

  • 4.2 4.2

    (Hz)(kHz)()

    200-34008850-7000161620-15k37.81620-22k44.116

  • 4.2.3 4-81000/1/1000A/D09100 9 4-8 1000Hz10

  • D/A4-84-94-9() 4-9 D/A

  • 2000/204000/404-104-11D/A()

  • 4-10 2000Hz204-11 4000Hz40

  • 4-12 2000Hz20D/A 4-122000Hz20D/A

  • 4.2.4 (PCM)PCM

  • ITU G.71135dB0.5

  • ISOCD-DA24()CIRCCD4.3CD-DA 4.3 CD-DA

    QP41124124

  • 4.3 4.3.1

  • 4-134-13

  • ()()

  • PCMADPCMATC

  • LPC(Linear Predictive Coding) CELPMP-LPCVSELP

  • 4.3.2 PCM 1939Alec ReevesPCM(Pulse Code Modulation)PCM1962BellATTPCM(T1) PCMPCMPCMPCMPCM

  • 4-14PCMA/D (B)BPCM

  • 4-14

  • PCM (-Law)()()A(A-Law)()()

  • x(n)4-15PCM AA 8kHz16APCM864kb/sITU()G.711

  • 4-15

  • 4.3.3 CCITT1972G.711APCM64kb/s1984G.721ADPCM32kb/s3003400Hz(50Hz7kHz)CCITTG.72264kb/sISDNB

  • ISDNB(Bbearer) ISDN----BDBD 64KbpsB16KbpsD128Kbps23B64KbpsD30BD

  • CCITT198916kb/sAT&T Bell16kb/s(LD-CELP)(GSM)13kb/s(RPE-LTP)1989CTIACELPISO(MPEG)MPEGMPEGMPEGMPEG

  • MPEG12,4.448kHz44.1kHz32kHz32MPEG3MPEGMPEG32kb/s448kb/s

  • MUSICAM ASPEC 4.4 MPEG

    (kb/s)1MUSICAM 1:4 384

    2MUSICAM 1:6 1:8256 1923ASPEC1:10 1:12128 112

  • 4.3.4 WAVVOCMP3 WAV WAVWindowsWAVWindowsWindowsWAV

  • WAVRIFF (Resource Interchange File Format)RIFFPCMWAV3 WAVMSADPCMA S=R D (r/8) N

  • VOC VOCCreative(Sound Blaster)Creative Sound Blaster()WindowsDOSCCITT A WAVVOCASCII

  • MPEG.MP1/.MP2/.MP3 MPEGMPEGMPEG(MPEG Audio Layer 1/2/3),MP1MP2MP3 MPEGMP1MP2416181MP3101121 MP3Internet(4-16),MP3

  • 4-16 MP3InternetWINAMPMP3(4-17)4-17 MP3WINAMP

  • MP3WinampMP3MP3MMXMP3Winplay3MusicMatch RealAudio.RA/.RM/.RAM RealAudioRealNetworks(Streaming Audio)RealNetworksRealMedia28.8kb/sISDNCD

  • AIFF.AIF/.AIFF AIFF(Audio Interchange File Format),Macintosh

  • 4.4 ()MPC

  • 4.4.1 ADLIB- PC19842090 ADLIB,ADLIB

  • Creative (CREATIVE)1989ComdexPCSound Blaster Sound BlasterISA8D/ASound Blaster ProMPC1Sound Blaster Pro

  • Creative16bit44KHzSound Blaster 16CD2090 Creative1995Sound Blaster Awe 32SB Awe 32321MBMIDI(MIDIYAMAHAFM)

  • Sound Blaster 32Sound Blaster AWE643264326416SB AWE64Wave Effect28MBSound Font64MIDI

  • 4.4.2 (4-18) 4-18

  • - MIDICODEC DSP(4-19) DSP

  • A/DDSPPCMDPCMADPCMWAVWAVDSPD/A 4-19 ESS

  • -CODEC CODEC IntelAC97CODEC CODECMIDICD

  • I/D(/),4-20FM(mute)()CD-ROMI/OI/O

  • 4-20 Sound Blaster PCI64

  • CODECDACDAC CODEC20Hz20KHz PCMIDIMIDIMIDI(FM)(Wave Table)

  • DMAPCII/OIRQDMA 3.5mm (MIC IN)

  • (LINE IN)(LINE OUT)(SPK OUT) (REAR OUT) MIDI/(MIDI/Joystick)MIDI (SPDIF OUT)AC-3DTS (SPDIF IN)

  • 4.4.3 Line inCODECA/D CODECD/A MIDID/A

  • 4.4.4 CD44.1KHz16MIDI MIDIMIDI(.WAV), .MID.WAV.MID,MIDI MIDI,FMFM, ,

  • 4(4.1)

  • DVDDVDDolby Digital (AC3)5.1 5.15.14.180Hz 5.1

  • WAVEMP3MIDIMP3OICQICQWAVE()PCIWave

  • I/O (LINE IN)(LINE OUT)(SPEAKERS OUT)MIDI(MIDI/JOYSTICK PORT)4-214-21

  • I/ODMAIRQ(Jumper) WAVCDMIDIWAV

  • ISA8Mb/sPCIISA,,,PCI133Mb/s,, PCIFMPC 98ISAPCI

  • 4.4.5 CoolEdit CoolEdit ProSyntrillium 5WAV

  • 3D/DSP64 56 Sound Forge Sound ForgeSonic FoundryFlashFlash, Sound Forge(wav)(avi)

  • Sound Forge, WAVWMARMAVIMP3Sound Forge 4.5 MIDI MIDI

  • 4.5.1 MIDI MIDI(Musical Instrument Digital Interface)MIDIMIDIMIDI MIDI, MIDIMIDIMIDIMIDI

  • MIDI,,MIDI,, MIDIMIDIMIDIMIDIMIDI

  • 4.5.2 MIDI MIDI MIDIMIDI MIDIMIDI

  • MIDI,4-22 4-22 MIDI

  • MIDIMIDI () 4-23

  • 4-23

  • 4-24 MIDI MIDIMIDI4-24

  • MIDIMIDI 4-25USBMIDI

  • 4-25 USBMIDI

  • () MIDIRoland JV1080Yamaha MU100R4-26

  • 4-26 ROLAND JV1080

  • 128GMMIDI(Sound Blaster Live) Yamaha S-YXG100, Roland VSC88MIDIMIDIMIDI

  • (Sequencer) MIDI Yamaha QY7004-27 Cakewalk()

  • 4-27 YAMAHA QY700

  • 4.5.3 MIDI MIDIMIDIMIDIMIDI.MIDMIDIMIDIMIDIMIDI4-28

  • 4-28 MIDI

  • MIDIMIDI MIDIMIDIMIDIMIDIMIDI

  • MIDINote On MessageMIDI()(Note NumberC=60)(Velocity38) Note-On/Channel # (1001 CCCC) Note Number (0NNN NNNN) Velocity (0VVV VVVV) MIDINote-Off MessageMIDI()Note-Off/Channel # 1001 CCCC Note Number (0NNN NNNN) Velocity (0VVV VVVV)

  • MIDIMIDIMIDIMIDIMIDIMIDI(synthesizer)MIDI

  • 4.5.4 FM DSPMIDIFM FM FM2080John ChowningFM

  • FM FMROMROMFM

  • FM F(t)

  • AIcm FM183189FMFM9FM12(l12)6FM(1318)5 36() FM,(Vibrato)(Tremdo)

  • FMFM44.1kHz16(CD-DA)

  • ROMSound Blaster AWE32EMU800016MIDI32FM ROMRAMCPUCPUMIDI

  • 4.5.5 GM-MIDI MIDI()140560MIDI MIDI GM(General MIDI Instrument Map)GM16812810MIDI(MIDI Channel 10)(16) (Sound Effects) MIDIGM

  • 4.5.6 MIDI MIDIMIDI(PianoMusic Lesson) MIDIMIDI

  • CakewalkTwelve Tone SystemsMIDICakewalkMIDICakewalk Pro Audio9.06425632bitCakewalk Pro Audio MIDIMIDICakewalk16MIDI(MCI)

  • Cakewalk Pro Audio ()CakewalkMIDI MIDI

  • 4.6 4.6.1 207030

  • () TTS(Text-to-Speech)SR(Speech Recognition)TTSSRTTSSR

  • NSI D 4.6.2 -TTS TTS E

  • TTSTTS TTSTTSTTSTTSWAV

  • 20602070 TTSTTS

  • TTS TTS TTS

  • TTS ()() TTS

  • TTSTTS TTSTTS TTSTTSEmail

  • 4.6.3 TTS (Continuous Speech Recognition)

  • ttwo, true, butter

  • 4.6.4 4-29

  • Analysis System 4-29

  • Pattern Training (DTW)(HMM) Pattern Classifier Decision Logic

  • 4.6.5 -ViaVoice (Continuous Speech Recognition)

  • IBM1319979IBMViaVoiceIBM301999ViaVoice

  • ViaVoice, ViaVoiceWindows150903200028000ViaVoice ViaVoice

  • 4.6.6 4

  • Email 2010

  • 21PC,

  • MIDI

  • P100 13 410 1118