Digital Signal ProcessingDigital Signal Processing

Prof. Prof. PengyuPengyu

TelTel ：： 1590451091115904510911

EmailEmail ：： pengyu@hit.edu.cnpengyu@hit.edu.cn

OfficeOffice ：： RoomRoom 526, Bldg. 2A, Science Park 526, Bldg. 2A, Science Park

Automatic Test and Control Institute Automatic Test and Control Institute （（ 5353 专专

业）业）

School of electrical engineering and automationSchool of electrical engineering and automation

Harbin Institute of TechnologyHarbin Institute of Technology

2008 2008 教育部双语教学示范课教育部双语教学示范课程程

IntroductionIntroduction

1 1 Basic Concepts about Basic Concepts about SignalSignal

DefinitionDefinition

A Signal carries information and can be described as a A Signal carries information and can be described as a

function of independent variables in mathematics.function of independent variables in mathematics.

Variable of SignalsVariable of Signals ： ： TimeTime//DistanceDistance//TemperatureTemperature//VoltageVoltage

One-dimensional SignalsOne-dimensional Signals ： ： Single variableSingle variable y=x(t)y=x(t)

Two-dimensional SignalsTwo-dimensional Signals ： ： Two variablesTwo variables

Three-dimensional SignalsThree-dimensional Signals ：： Three variablesThree variables

Classification of SignalClassification of Signal Continuous-Continuous-timetime and discrete-time signal and discrete-time signal

Analog and digital signal Analog and digital signal ((time and amplitudetime and amplitude))

(1) (1) Continuous-time signalContinuous-time signal ：： (2) (2) Discrete-time signalDiscrete-time signal ：： Discrete variableDiscrete variableContinuous Continuous

amplitude amplitude

Time-domain discrete signalsTime-domain discrete signals

(3) (3) Analog Signal:Analog Signal: Continuous variableContinuous variableContinuous amplitudeContinuous amplitude

Speech, Television,Speech, Television, Time-domain continuous signalsTime-domain continuous signals

(4) (4) Digital SignalDigital Signal ：： Discrete variablesDiscrete variablesDiscrete Discrete amplitudeamplitude

Quantized discrete-time signalsQuantized discrete-time signals

Signal Signal ProcessingProcessing

Computer, Semiconduct and Information ScienceComputer, Semiconduct and Information Science 1960’s-1970’s1960’s-1970’s

RepresentationRepresentation, , transformationtransformation and and manipulationmanipulation

of signals and the information they contain.of signals and the information they contain.

Signal operation include:Signal operation include:

(1) Transform, filter, (1) Transform, filter, inspectioninspection, spectrum analysis; , spectrum analysis;

(2) Modulation and coding; (2) Modulation and coding;

(3) (3) Analog Signal ProcessingAnalog Signal Processing;;

(4) (4) Digital Signal ProcessingDigital Signal Processing..

IMAGE PROCESSINGIMAGE PROCESSING

Pattern recognitionPattern recognition

Robotic visionRobotic vision

Image enhancementImage enhancement

Satellite weather mapSatellite weather map

animationanimation

IMAGE PROCESSINGIMAGE PROCESSING

Pattern recognitionPattern recognition

Robotic visionRobotic vision

Image enhancementImage enhancement

Satellite weather mapSatellite weather map

animationanimation

INSTRUMENTATION & CONTROLINSTRUMENTATION & CONTROL

Spectrum analysisSpectrum analysis

Position and rate controlPosition and rate control

Noise reductionNoise reduction

Data compressionData compression

INSTRUMENTATION & CONTROLINSTRUMENTATION & CONTROL

Spectrum analysisSpectrum analysis

Position and rate controlPosition and rate control

Noise reductionNoise reduction

Data compressionData compressionSPEECH & AUDIOSPEECH & AUDIO

Speech recognitionSpeech recognition

Speech synthesisSpeech synthesis

Text to speechText to speech

digital audiodigital audio

SPEECH & AUDIOSPEECH & AUDIO

Speech recognitionSpeech recognition

Speech synthesisSpeech synthesis

Text to speechText to speech

digital audiodigital audio

MILITARYMILITARY

Secure communicationSecure communication

Radar processingRadar processing

Sonar processingSonar processing

Missile guidanceMissile guidance

MILITARYMILITARY

Secure communicationSecure communication

Radar processingRadar processing

Sonar processingSonar processing

Missile guidanceMissile guidance

TELECOMMUNICATIONTELECOMMUNICATION

Echo cancellationEcho cancellation

Adaptive equalizationAdaptive equalization

Video conferencingVideo conferencing

data communicationdata communication

TELECOMMUNICATIONTELECOMMUNICATION

Echo cancellationEcho cancellation

Adaptive equalizationAdaptive equalization

Video conferencingVideo conferencing

data communicationdata communicationBiomedicalBiomedical

Patient monitoringPatient monitoring

ScannersScanners

ECG (Electrocardiograph) ECG (Electrocardiograph)

X-ray storage/enhancementX-ray storage/enhancement

BiomedicalBiomedical

Patient monitoringPatient monitoring

ScannersScanners

ECG (Electrocardiograph) ECG (Electrocardiograph)

X-ray storage/enhancementX-ray storage/enhancement

Consumer applicationsConsumer applications

digital, cellar mobile phonesdigital, cellar mobile phones

universal mobile telecommunication systemuniversal mobile telecommunication system

digital televisiondigital television

digital cameradigital camera

internet music, phones and videointernet music, phones and video

digital answer machines, fax and modemsdigital answer machines, fax and modems

voice mail systemvoice mail system

interactive entertainment systemsinteractive entertainment systems

Consumer applicationsConsumer applications

digital, cellar mobile phonesdigital, cellar mobile phones

universal mobile telecommunication systemuniversal mobile telecommunication system

digital televisiondigital television

digital cameradigital camera

internet music, phones and videointernet music, phones and video

digital answer machines, fax and modemsdigital answer machines, fax and modems

voice mail systemvoice mail system

interactive entertainment systemsinteractive entertainment systems

2 2 Basic concepts about Basic concepts about

systemsystem(1) (1) SystemSystem

Device or technology of signal processing.Device or technology of signal processing.

(2) (2) Analog systemAnalog system

System with analog input and output.System with analog input and output.

(3) (3) Digital systemDigital system

System with digital input and output.System with digital input and output.

23/4/21 7

Signals and SystemsBasic model:Basic model:

Input: xInput: x Output: y Output: y

DSPDSP 、、 FPGAFPGA 、、 SOPCSOPC 、、 SOCSOC 、、 Algorithm CodesAlgorithm Codes

23/4/21 8

x y

• Given x and h, find y analysis

• Given h and y, find x control

• Given x and y, find h design or synthesis

h

Three Problems

3 3 Processing of analog signal with digital Processing of analog signal with digital

methodsmethods(1) (1) Digitalized process for analog signalsDigitalized process for analog signals

SamplSamplee

QuantizerQuantizer CoderCoderxxaa(t)(t) x(n)x(n)

(2) (2) Digital processing methodDigital processing method

A/DA/D DSPDSP D/AD/Axxaa(t)(t) yyaa(t)(t)FilterFilterx(n)x(n) y(n)y(n)

FilterFilter

4 4 Feature of Digital SystemFeature of Digital System

(1) (1) High accuracy: Floating pointHigh accuracy: Floating point-8,16,32,64 -8,16,32,64 bitsbits

(2) (2) High reliability: VLSI High reliability: VLSI (analog: drift, calibration)(analog: drift, calibration)

(3) (3) Flexible: DSP, Software, FPGA, VHDL Flexible: DSP, Software, FPGA, VHDL

(4) (4) Easy to integrateEasy to integrate

(5) (5) Deal with high dimensional signals Deal with high dimensional signals

(6) (6) Low costs: Low costs: reusable, reconfigurablereusable, reconfigurable

AdvantagesAdvantages

((77) ) Data loggingData logging

((88) ) Adaptive capabilityAdaptive capability

DisadvantagesDisadvantages

• Complex: cost and speedComplex: cost and speed

KXa(t)Xa(t) Ya(t)Ya(t)

Analog Signal ProcessingAnalog Signal Processing

A/DA/D DSPDSP D/AD/Axxaa(t)(t) yyaa(t)(t)FilterFilterx(n)x(n) y(n)y(n)

FilterFilter

Digital Signal ProcessingDigital Signal Processing

5 5 Study CaseStudy Case

currecurrentnt

SignalSignalConditioninConditionin

g g

voltagvoltagee

freqfreq

temptemp

humidithumidityy

AnalogAnalogSwitcheSwitche

s s

CPCPU U

A/D A/D MEMO MEMO DISP DISP

PCPC

PrintePrinterr

Electrical/non-Electrical/non-electrical electrical

measurementmeasurementAutomatic test systemAutomatic test system

Analog/Digital Analog/Digital CircuitsCircuits

Digital Signal ProcessingDigital Signal ProcessingDigital Signal ProcessingDigital Signal Processing

Environment monitoring SystemEnvironment monitoring System

When you speak, your voice is picked up by an analog sensor in the cell phone’s microphone

An analog-to-digital converter chip converts your voice, which is an analog signal, into digital signals, represented by 1s and 0s.

The DSP compresses the digital signals and removes background noise.

In the listener’s cell phone, a digital-to-analog converter chip changes the digital signals back to an analog voice signal.

Your voice exits the phone through the speaker.

MORE APPLICATIONS

A MP3 PlayerA MP3 Player

((3) 3) NoiseNoise process process DigitalDigital filter filter

((1) Selective of A/D1) Selective of A/D Signal representation - SamplingSignal representation - Sampling

((2) Manipulation and transform 2) Manipulation and transform feature extraction and feature extraction and analysisanalysis

6. Objective6. Objective of Digital Signal of Digital Signal ProcessingProcessing

Digital SignalsDigital Signals

ManipulationManipulation DigitalDigital filter filter

MeasurementMeasurement DigitalDigital Signals Signals

SpectrumSpectrum analysis analysis FrequencyFrequency division division

DisturbanceDisturbance attenuation attenuation

77.. Research objectivesResearch objectives

1-dimentional DSP, multi-dimentional 1-dimentional DSP, multi-dimentional

DSP and the realization of DSP DSP and the realization of DSP

systemsystem

• 1D DSP:1D DSP: 1D discrete-time signals and system 1D discrete-time signals and system

• multi-D DSP:multi-D DSP: 2D or 3D image processing, etc. 2D or 3D image processing, etc.

• Realization of DSP system:Realization of DSP system:

Realization of theoretical algorithm and system Realization of theoretical algorithm and system

(filter) on software and hardware: including (filter) on software and hardware: including

system architecture, chip selective, development system architecture, chip selective, development

of the software and hardware, etc.of the software and hardware, etc.

8. Theory8. Theory of digital signal of digital signal processingprocessing• Sampling of analog signalsSampling of analog signals A/D A/D conversionconversion, , ssamplingampling theory theory, a, analysisnalysis of quantization of quantization

errors;errors;• Discrete-time signal analysisDiscrete-time signal analysis Time-domain and frequency-domain analysis, FTime-domain and frequency-domain analysis, Fourierourier

transform, transform, zz - transform, H - transform, Hilbertilbert transform; transform;• Discrete-time system analysisDiscrete-time system analysis System representation, cSystem representation, causalityausality and stability, t and stability, timeime-invariant -invariant

system, convolution, frequency response, dsystem, convolution, frequency response, digitaligital filter design; filter design;• FastFast algorithm for signal processing algorithm for signal processing FFTFFT, f, fastast convolution and correlation; convolution and correlation;• Special algorithm for signal processingSpecial algorithm for signal processing InterpolationInterpolation, , singular value analysis, deconvolution.singular value analysis, deconvolution.

9. Implementation9. Implementation of DSP system of DSP system

• GeneralGeneral-purpose computer; -purpose computer;

• Micro-control unit;Micro-control unit;

• GeneralGeneral-purpose DSP chip;-purpose DSP chip;

• Specific-design DSP chip;Specific-design DSP chip;

TI TI (leading manufacture, 70%)(leading manufacture, 70%)

ADAD, , MotoralaMotorala, Lucent, , Lucent, NECNEC

10. 10. Objectives of our learning Objectives of our learning

Understand the concept: Understand the concept:

Main idea:Main idea: solve the problem of analog signals solve the problem of analog signals with digital methodwith digital method

SampleSample

Transform: time-domainTransform: time-domainfrequency domainfrequency domain

Spectrum analysisSpectrum analysis

Filter designFilter design

Important tools:Important tools: Method to design digital filterMethod to design digital filter

11. 11. Proposed syllabus for the course Proposed syllabus for the course

Total period:Total period: 46;46; Class:Class: 4 40 0

Experiment:Experiment: 66

• Discrete-time signDiscrete-time signaals and systemls and system

• Discrete Fourier transformDiscrete Fourier transform

• FFT and its applicationsFFT and its applications

• Design of IIR digital filtersDesign of IIR digital filters

• Design of FIR digital filtersDesign of FIR digital filters

23/4/21 23

How to Learn ?How to Learn ?

23/4/21 24

Curriculum in Signal ProcessingCurriculum in Signal Processing

• MathematicsMathematics

• Signals and SystemsSignals and Systems

• Signal processing theory and systemsSignal processing theory and systems

• Communications theory and systemsCommunications theory and systems

• Control theory and systemsControl theory and systems

• Applications and researchApplications and research

23/4/21 25

Mathematics for Signal ProcessingMathematics for Signal Processing• Algebra, calculus, differential equationsAlgebra, calculus, differential equations

• Linear algebra, matrices, vector spaces, Linear algebra, matrices, vector spaces, functional analysisfunctional analysis

• Probability, statistics, random processesProbability, statistics, random processes

• Computational mathematics, numerical Computational mathematics, numerical analysis, algorithmsanalysis, algorithms

• Computer Science and EngineeringComputer Science and Engineering

• Math now has an experimental laboratoryMath now has an experimental laboratory

23/4/21 26

Modern Engineering is DesignModern Engineering is Design

• Science Science studiesstudies and and describesdescribes what nature what nature created, what already existscreated, what already exists

• Engineering Engineering createscreates and and buildsbuilds what what society wants and needs, what does not society wants and needs, what does not already existalready exist

• Engineering uses mathematics in a Engineering uses mathematics in a differentdifferent way from science way from science

23/4/21 27

History of Teaching and History of Teaching and Learning EngineeringLearning Engineering

• Engineering was first a trade which was Engineering was first a trade which was learned through learned through apprenticeshipapprenticeship

• Next, it was a profession which was Next, it was a profession which was learned through learned through trainingtraining

• Now it is a discipline which is learned Now it is a discipline which is learned through through education. education. Modern liberal artsModern liberal arts

23/4/21 28

Training vs. EducationTraining vs. Education

• Old Old Engineering: How do I build a Engineering: How do I build a bridge across the river?bridge across the river?

• NewNew Engineering: How do I satisfy Engineering: How do I satisfy peoplepeople’’s desire to interact across the s desire to interact across the river?river?

23/4/21 29

Training vs. EducationTraining vs. Education• OldOld system: Learn enough in the university to last system: Learn enough in the university to last

your professional lifetimeyour professional lifetime• NewNew system: In the university, learn the methods system: In the university, learn the methods

to continue to learn all of your life.to continue to learn all of your life.

• OldOld: study, work, then retire. : study, work, then retire. • NewNew: study and work and retire without boundary: study and work and retire without boundary

• Transition from old to new system occurred Transition from old to new system occurred around 50 years ago but education has not around 50 years ago but education has not changedchanged

23/4/21 30

Research in the New WorldResearch in the New World• In the In the oldold system, research was done by a system, research was done by a

small number of specialist in laboratories small number of specialist in laboratories and graduate schooland graduate school

• In the In the newnew system, research will be done system, research will be done by everybody in all levels of school and by everybody in all levels of school and workwork

• Same true for Same true for ““DesignDesign””

23/4/21 31

Education in the New SystemEducation in the New SystemShift emphasisShift emphasis from from

– Training to educationTraining to education

– Teaching to Teaching to learninglearning (teacher to student) (teacher to student)

– Passive to Passive to activeactive (and interactive) (and interactive)

– Process to Process to conceptconcept (concept inventory) (concept inventory)

– Understand to Understand to discoverdiscover

Need research in learning technical materialNeed research in learning technical material

23/4/21 32

Technology for EducationTechnology for Education

• Matlab, Mathematica, Maple, LabViewMatlab, Mathematica, Maple, LabView

• OCW, Connexions, Wikipedia, GoogleOCW, Connexions, Wikipedia, Google

• Desktop, laptop, hand-held, mobile Desktop, laptop, hand-held, mobile phone plus Internet; social software phone plus Internet; social software systemssystems

23/4/21 33

Open Educational ResourcesOpen Educational ResourcesThe The Open Educational ResourceOpen Educational Resource (OER) (OER)

movement was inspired by the movement was inspired by the Open SourceOpen Source movement in softwaremovement in software. .

• OOpen pen CCourse ourse WWare are ““OCWOCW”” (MIT)(MIT)

• CCononnneexxions ions ““CnxCnx”” (Rice)(Rice)

• WikiWikipedia (Wikibooks, etc.)pedia (Wikibooks, etc.)

• CCreative reative CCommons ommons ““CCCC”” (Stanford, Duke) (Stanford, Duke)

• Curriki, PLoS, EOL, Curriki, PLoS, EOL, Shuttleworth's Siyavula Shuttleworth's Siyavula Project, CK-12 Project, OSI, Project, CK-12 Project, OSI, eetc.tc.

23/4/21 34

23/4/21 35

Interactive, Dynamic Virtual Lab

23/4/21 36

Multimedia

23/4/21 37

MatlabMatlab

www.mathworks.comwww.mathworks.com

23/4/21 39

Connexions NowConnexions NowUsageUsage

Repository: 7300 modules, 20,000 revisions, 405 courses or books, Repository: 7300 modules, 20,000 revisions, 405 courses or books, 7200 author accounts, 147 countries, print-on-demand books7200 author accounts, 147 countries, print-on-demand books

In Oct. 2008: 17M hits, 1.0M pages views, 520K unique users In Oct. 2008: 17M hits, 1.0M pages views, 520K unique users from 157 countriesfrom 157 countries

GlobalizationGlobalization

Europe: Germany, Norway, England, etc.Europe: Germany, Norway, England, etc.

Asia: CAsia: China, hina, India, Pakistan, India, Pakistan, Japan, Vietnam, Korea Japan, Vietnam, Korea

Africa: South AfricaAfrica: South Africa

LACCEI: (conversation with Mexico, Argentina, Brazil, Chile, LACCEI: (conversation with Mexico, Argentina, Brazil, Chile, and Uruguay started)and Uruguay started)

23/4/21 40

Signal Processing Web Sites

• DSP an Rice: http://www-dsp.rice.edu/

• DSP at MIT: http://www.rle.mit.edu/

• Connexions at Rice: http://cnx.org/

• OCW at MIT:

• Georgia Tech, Univ. of Illinois, University of Texas, Princeton, Stanford

Curriculum schedule• Class:

0601104 ， 0601201 ， 0601202 ； 66 students

• Lectures ： 正心 226 4th-14th week,

Mon: 5~6; Wen: 7~8;

• Experiments:

12th-13th week, G601, Thu, 5~6 • Examination: 正心 42, 17th week, Thu, 10:00~12:00

12 12 Student CommitmentStudent Commitment

AAssignmentssignment

Attendance in classes is mandatory !Attendance in classes is mandatory !

ScoresScores

Assignment Assignment ++ Experiment + Experiment + Report: Report: 10%10%

Examination:Examination: 100%100%

Presentation Project ： 3~5 points

Subject is assigned by teacher

Discuss with instructor 3 days before presentation

Criterion ： Content, Clear and fluent, Team works

NEW STUFFNEW STUFF

LIMITED TIMELIMITED TIME

LOTS OF WORKLOTS OF WORK

PRESSUREPRESSURE

METHODOLOGYMETHODOLOGY

PLANPLAN

EXECUTEEXECUTE

TEAM WORK TEAM WORK HAVE TO SHARE HAVE TO SHARE

NEW BEGINNING FOR YOURSELF !NEW BEGINNING FOR YOURSELF !

FOR YOUR FUTURE LIFE!FOR YOUR FUTURE LIFE!

HOW TO HOW TO GET GET WHAT YOU WANT ?WHAT YOU WANT ?

WANTED !WANTED !

http

://h

ttp://

ww

w.e

mu

le.o

rg.c

nw

ww

.em

ule

.org

.cn

EmuleEmule ：电驴 ：电驴 P2PP2P 软件软件ICQICQ,,AOL Instant MessengerAOL Instant Messenger,,Yahoo Yahoo PagerPager, , MSN MessengerMSN Messenger,, Tencet Tencet QQQQ-most popular -most popular P2PP2P..

REVIEWREVIEW

What is DSP ?What is DSP ?

Why DSP ?Why DSP ?

How to ?How to ?

BRIEF INTRODUCTIONSBRIEF INTRODUCTIONS

ReferencesReferences1 1 Discrete-time Signal Processing. Discrete-time Signal Processing. A.V.A.V. Oppenheim, R.W.Schafer. Oppenheim, R.W.Schafer.

Pearson EducationPearson Education ，， 2002005,5,11

2 2 Digital Signals ProcessingDigital Signals Processing————using MATLAB. using MATLAB. Vinay K. Vinay K.

Ingle,John G. ProakisIngle,John G. Proakis. ISTE Publishing Company,ISTE Publishing Company, 20020088

3 3 Real-time Digital Signal Processing – Implementation, Application Real-time Digital Signal Processing – Implementation, Application

and Experiments with the TMS320C55X.and Experiments with the TMS320C55X. Sen M. Kuo, Bob H. Lee. Sen M. Kuo, Bob H. Lee.

WILEY, WILEY, 20032003,,1212

4 4 Introduction to Signal Processing. Introduction to Signal Processing. Sophocles J. Orfanidis. Sophocles J. Orfanidis.

Prentice Hall, 1998,12Prentice Hall, 1998,12

5 5 Fundamentals of Digital Signal Processing.Fundamentals of Digital Signal Processing. Joyce Van de Vegte. Joyce Van de Vegte.

Prentice Hall, Prentice Hall, 20032003,,11