If you can't read please download the document
Upload
danielle-pena
View
80
Download
8
Embed Size (px)
DESCRIPTION
第4章 多媒体音频信息处理. 声音是多媒体信息的一个重要组成部分,也是表达思想和情感的一种必不可少的媒体。无论其应用目的是什么,声音的合理使用可以使多媒体应用系统变得更加丰富多彩。在多媒体系统中,音频可被用作输入或输出。输入可以是 自然语言或语音命令 ,输出可以是语音或音乐,这些都涉及到音频处理技术。. STOP. 4.1 音频信号及其概念 - PowerPoint PPT Presentation
Citation preview
4 , STOP
4.1 4.1.1 19
CD---(Audio)
4.1.2 ,
Hello4-14-1 Hello
4.1.3 (Hz)(kHz)50005000Hz5kHz300Hz3000Hz20 Hz(Subsonic)20Hz20kHz(Audio)20kHz(Ultrasonic)
(4-2) (dB)4-2
4.1.4 A/DD/A A/DD/AAAnalog()DDigital ()A/D A/D4-3A/DD/A4-4CD A/D
4-3 8A/D4-4 A/DD/A
4.1.5
4.1.6
4-54-5 (AUDIO TEST)
SNR(Signal to Noise Ration)(dB)
MOS(Mean Opinion Score)MOS4. 4.1 MOS
MOS5(Excellent)4(Good)3(Fair)2(Poor)()1(Unacceptable)()
4 CD-DASuper HiFi(High Fidelity) FM(Frequency Modulation) AM(Amplitude Modulation) (Telephone) 4CD-DA
4-6 44-64
4.2 4-7 A/DA/D 4-7
4.2.1 2040(Shannon) (Sampling)
Nyquist CDPCM8000CD44.1kHz22050Hz
4.2.2 ()? 16(bit) 828(quantization levels)16,216
4.2 4.2
(Hz)(kHz)()
200-34008850-7000161620-15k37.81620-22k44.116
4.2.3 4-81000/1/1000A/D09100 9 4-8 1000Hz10
D/A4-84-94-9() 4-9 D/A
2000/204000/404-104-11D/A()
4-10 2000Hz204-11 4000Hz40
4-12 2000Hz20D/A 4-122000Hz20D/A
4.2.4 (PCM)PCM
ITU G.71135dB0.5
ISOCD-DA24()CIRCCD4.3CD-DA 4.3 CD-DA
QP41124124
4.3 4.3.1
4-134-13
()()
PCMADPCMATC
LPC(Linear Predictive Coding) CELPMP-LPCVSELP
4.3.2 PCM 1939Alec ReevesPCM(Pulse Code Modulation)PCM1962BellATTPCM(T1) PCMPCMPCMPCMPCM
4-14PCMA/D (B)BPCM
4-14
PCM (-Law)()()A(A-Law)()()
x(n)4-15PCM AA 8kHz16APCM864kb/sITU()G.711
4-15
4.3.3 CCITT1972G.711APCM64kb/s1984G.721ADPCM32kb/s3003400Hz(50Hz7kHz)CCITTG.72264kb/sISDNB
ISDNB(Bbearer) ISDN----BDBD 64KbpsB16KbpsD128Kbps23B64KbpsD30BD
CCITT198916kb/sAT&T Bell16kb/s(LD-CELP)(GSM)13kb/s(RPE-LTP)1989CTIACELPISO(MPEG)MPEGMPEGMPEGMPEG
MPEG12,4.448kHz44.1kHz32kHz32MPEG3MPEGMPEG32kb/s448kb/s
MUSICAM ASPEC 4.4 MPEG
(kb/s)1MUSICAM 1:4 384
2MUSICAM 1:6 1:8256 1923ASPEC1:10 1:12128 112
4.3.4 WAVVOCMP3 WAV WAVWindowsWAVWindowsWindowsWAV
WAVRIFF (Resource Interchange File Format)RIFFPCMWAV3 WAVMSADPCMA S=R D (r/8) N
VOC VOCCreative(Sound Blaster)Creative Sound Blaster()WindowsDOSCCITT A WAVVOCASCII
MPEG.MP1/.MP2/.MP3 MPEGMPEGMPEG(MPEG Audio Layer 1/2/3),MP1MP2MP3 MPEGMP1MP2416181MP3101121 MP3Internet(4-16),MP3
4-16 MP3InternetWINAMPMP3(4-17)4-17 MP3WINAMP
MP3WinampMP3MP3MMXMP3Winplay3MusicMatch RealAudio.RA/.RM/.RAM RealAudioRealNetworks(Streaming Audio)RealNetworksRealMedia28.8kb/sISDNCD
AIFF.AIF/.AIFF AIFF(Audio Interchange File Format),Macintosh
4.4 ()MPC
4.4.1 ADLIB- PC19842090 ADLIB,ADLIB
Creative (CREATIVE)1989ComdexPCSound Blaster Sound BlasterISA8D/ASound Blaster ProMPC1Sound Blaster Pro
Creative16bit44KHzSound Blaster 16CD2090 Creative1995Sound Blaster Awe 32SB Awe 32321MBMIDI(MIDIYAMAHAFM)
Sound Blaster 32Sound Blaster AWE643264326416SB AWE64Wave Effect28MBSound Font64MIDI
4.4.2 (4-18) 4-18
- MIDICODEC DSP(4-19) DSP
A/DDSPPCMDPCMADPCMWAVWAVDSPD/A 4-19 ESS
-CODEC CODEC IntelAC97CODEC CODECMIDICD
I/D(/),4-20FM(mute)()CD-ROMI/OI/O
4-20 Sound Blaster PCI64
CODECDACDAC CODEC20Hz20KHz PCMIDIMIDIMIDI(FM)(Wave Table)
DMAPCII/OIRQDMA 3.5mm (MIC IN)
(LINE IN)(LINE OUT)(SPK OUT) (REAR OUT) MIDI/(MIDI/Joystick)MIDI (SPDIF OUT)AC-3DTS (SPDIF IN)
4.4.3 Line inCODECA/D CODECD/A MIDID/A
4.4.4 CD44.1KHz16MIDI MIDIMIDI(.WAV), .MID.WAV.MID,MIDI MIDI,FMFM, ,
4(4.1)
DVDDVDDolby Digital (AC3)5.1 5.15.14.180Hz 5.1
WAVEMP3MIDIMP3OICQICQWAVE()PCIWave
I/O (LINE IN)(LINE OUT)(SPEAKERS OUT)MIDI(MIDI/JOYSTICK PORT)4-214-21
I/ODMAIRQ(Jumper) WAVCDMIDIWAV
ISA8Mb/sPCIISA,,,PCI133Mb/s,, PCIFMPC 98ISAPCI
4.4.5 CoolEdit CoolEdit ProSyntrillium 5WAV
3D/DSP64 56 Sound Forge Sound ForgeSonic FoundryFlashFlash, Sound Forge(wav)(avi)
Sound Forge, WAVWMARMAVIMP3Sound Forge 4.5 MIDI MIDI
4.5.1 MIDI MIDI(Musical Instrument Digital Interface)MIDIMIDIMIDI MIDI, MIDIMIDIMIDIMIDI
MIDI,,MIDI,, MIDIMIDIMIDIMIDIMIDI
4.5.2 MIDI MIDI MIDIMIDI MIDIMIDI
MIDI,4-22 4-22 MIDI
MIDIMIDI () 4-23
4-23
4-24 MIDI MIDIMIDI4-24
MIDIMIDI 4-25USBMIDI
4-25 USBMIDI
() MIDIRoland JV1080Yamaha MU100R4-26
4-26 ROLAND JV1080
128GMMIDI(Sound Blaster Live) Yamaha S-YXG100, Roland VSC88MIDIMIDIMIDI
(Sequencer) MIDI Yamaha QY7004-27 Cakewalk()
4-27 YAMAHA QY700
4.5.3 MIDI MIDIMIDIMIDIMIDI.MIDMIDIMIDIMIDIMIDI4-28
4-28 MIDI
MIDIMIDI MIDIMIDIMIDIMIDIMIDI
MIDINote On MessageMIDI()(Note NumberC=60)(Velocity38) Note-On/Channel # (1001 CCCC) Note Number (0NNN NNNN) Velocity (0VVV VVVV) MIDINote-Off MessageMIDI()Note-Off/Channel # 1001 CCCC Note Number (0NNN NNNN) Velocity (0VVV VVVV)
MIDIMIDIMIDIMIDIMIDIMIDI(synthesizer)MIDI
4.5.4 FM DSPMIDIFM FM FM2080John ChowningFM
FM FMROMROMFM
FM F(t)
AIcm FM183189FMFM9FM12(l12)6FM(1318)5 36() FM,(Vibrato)(Tremdo)
FMFM44.1kHz16(CD-DA)
ROMSound Blaster AWE32EMU800016MIDI32FM ROMRAMCPUCPUMIDI
4.5.5 GM-MIDI MIDI()140560MIDI MIDI GM(General MIDI Instrument Map)GM16812810MIDI(MIDI Channel 10)(16) (Sound Effects) MIDIGM
4.5.6 MIDI MIDIMIDI(PianoMusic Lesson) MIDIMIDI
CakewalkTwelve Tone SystemsMIDICakewalkMIDICakewalk Pro Audio9.06425632bitCakewalk Pro Audio MIDIMIDICakewalk16MIDI(MCI)
Cakewalk Pro Audio ()CakewalkMIDI MIDI
4.6 4.6.1 207030
() TTS(Text-to-Speech)SR(Speech Recognition)TTSSRTTSSR
NSI D 4.6.2 -TTS TTS E
TTSTTS TTSTTSTTSTTSWAV
20602070 TTSTTS
TTS TTS TTS
TTS ()() TTS
TTSTTS TTSTTS TTSTTSEmail
4.6.3 TTS (Continuous Speech Recognition)
ttwo, true, butter
4.6.4 4-29
Analysis System 4-29
Pattern Training (DTW)(HMM) Pattern Classifier Decision Logic
4.6.5 -ViaVoice (Continuous Speech Recognition)
IBM1319979IBMViaVoiceIBM301999ViaVoice
ViaVoice, ViaVoiceWindows150903200028000ViaVoice ViaVoice
4.6.6 4
Email 2010
21PC,
MIDI
P100 13 410 1118