Table of Contents
1. Introduction 1
1.1.
Development
of Multimedia Systems 2
1.2.
Classification
of Media 3
1.3.
Properties
of Multimedia Systems 5
1.4.
Multimedia
Computing 6
1.5.
Different
Aspects of Multimedia
References 9
Questions 9
Part I: Multimedia Signals
2.
Audio Fundamentals 11
2.1
Characteristics of Sound 11
2.2
The
Human Auditory System 14
2.3
Audio Recording 18
2.4
Audio
Signal Representation 23
2.4.1 Waveform method 23
2.4.2 Musical
Instrument Digital Interface 24
References 30
Questions 31
3. The Human Visual System and Perception 33
3.1
Introduction 33
3.2
The Human Visual System 34
3.2.1 Relative
Luminous Efficiency 36
3.2.2 Weber’s
Law 37
3.2.3 Modulation
Transfer Function 38
3.2.4 HVS
Model 42
3.3
Color Representation 42
3.3.1 Three-Receptor
Model 42
3.3.2 Color Matching 44
3.3.3 Tristimulus
Value 45
3.3.4 Chromaticity
Diagram 47
3.3.5 Color
Models and Transformation of Primaries 48
3.3.5.1 NTSC
Receiver Primary 49
3.3.5.2 NTSC
Transmission System 50
3.3.5.3 1960
CIE-UCS Color coordinates 53
3.3.5.4 CMY
Model 54
3.4
Temporal
Properties of Vision 54
References 55
Questions 56
4. Multimedia Data Acquisition 57
4.1
Sampling
of Audio Signals 57
4.2
Sampling of Two-Dimensional Images 63
4.3
Anti-Aliasing Filters 67
4.4
Digitization
of Audio Signals 70
4.4.1 Analog to
Digital Conversion 71
4.4.2
Audio
Fidelity Criteria 75
4.4.3
MIDI
versus Digital Audio 78
4.5
Digitization
of Images 79
4.5.1
Visual
Fidelity Measures 79
References 81
Questions 81
Part II: Signal
Processing and Compression
5. Transforms and Subband Decomposition 83
5.1
1-D
Unitary Transform 84
5.2
1-D
Discrete Fourier Transform 85
5.3
1-D
Discrete Cosine Transform 90
5.4
Digital
Filtering and Subband Analysis 93
5.4.1
Digital
Filters 93
5.4.2
Subband
Analysis 97
5.4.3
Transforms
and Digital Filtering 103
5.5
1-D
Discrete Wavelet Transform 104
5.6
2-D
Unitary Transform 109
5.7
2-D
Discrete Fourier Transform 111
5.8
2-D
Discrete Cosine Transform 114
5.9
2-D
Discrete Wavelet Transform 116
References 118
Questions 119
6. Text Representation and Compression 121
6.1
Text Representation 121
6.2
Principles
of Text Compression 124
6.3
Statistical
Redundancy 124
6.3.1 Probability Density Function
and Entropy 125
6.3.2 Shannon's Noiseless Source
Coding Theorem 127
6.3.3 Huffman Coding 129
6.3.4 Arithmetic Coding 133
6.4
Dictionary-based
Compression 137
6.4.1 LZ77 Technique 138
6.4.2 LZ78 Technique 140
6.5
Summary 143
References 143
Questions 144
7. Digital Audio Compression 145
7.1
Audio Compression Principles 145
7.1.1 Rate
Distortion Function 147
7.2
Statistical Redundancy 148
7.2.1
Companding
and Expanding 149
7.3
Temporal Redundancy 151
7.4
Perceptual
Audio Coding 156
7.5
Audio Compression Standards 158
7.6
MPEG-1 Audio Compression Standard 159
7.7
MPEG-2 Audio Compression Standard 162
7.8
AC Audio Compression Standards 163
7.9
Comparison of Compression Algorithms 165
7.10
Audio Formats 166
References 166
Questions 167
8. Digital Image Compression Techniques 169
8.1
Principles
of Image Compression 169
8.2
Low
Complexity Compression Techniques 170
8.2.1
Entropy
Coding 170
8.2.2
Run-length
Coding 171
8.2.3
Predictive
Coding 173
8.3
Transform
Coding 175
8.3.1
Unitary
Transform 176
8.3.2
Block
Transform 177
8.3.3
Wavelet
Coding 179
8.3.4
Comparison
of DCT and Wavelets 180
8.4
Other
Coding Techniques 182
8.4.1
Vector
Quantization 183
8.4.2
Fractal
Image Compression 184
8.5
Image
Compression Standards 185
8.6
The
JPEG Image Compression Standard 186
8.6.1
Baseline
Sequential Mode 186
8.6.2
Other
JPEG Modes 192
8.7
The
JPEG 2000 Standard 193
8.8
Image
Formats 199
References 200
Questions 201
9. Digital Video Compression Techniques 203
9.1
Principles
of Video Compression 203
9.2
Digital
Video and Color Redundancy 204
9.3
Temporal
Redundancy Reduction 207
9.4
Block-based
Motion Estimation 209
9.4.1
Fast
Motion Estimation Algorithms 214
9.5
Video
Compression Standards 221
9.5.1
Motion
JPEG 222
9.5.2
The
MPEG-1 Video Compression Standard 222
9.5.3
The
MPEG-2 Video Compression Standard 224
9.5.4
The
MPEG-4 Video Compression Standard 226
9.5.4.1 Video Coding Scheme 228
9.5.5
The
H.261 Video Compression Standard 231
9.5.6
H.263,
H.263+ and H.26L Standards 231
9.5.7
Comparison
of Standard Codecs 232
References 235
Questions 236
10. Digital Audio Processing 239
10.1
Audio
Filtering Techniques 239
10.2
Audio
Equalization 241
10.3
Audio
Enhancement 245
10.3.1
Noise
Suppression by Digital Filtering 246
10.3.2
Spectral
Subtraction Method 248
10.4
Editing
MIDI Files 252
10.5
Digital
Audio and MIDI Editing Tools 254
References 255
Questions 256
11. Digital Image and Video Processing 257
11.1
Basic
Image Processing Tools 257
11.1.1
Image
Resizing 257
11.1.2
Cropping 260
11.2
Image
Enhancement Techniques 261
11.2.1
Brightness
and Contrast Improvement 261
11.2.1.1
Contrast
Stretching 262
11.2.1.2
Histogram
Equalization 265
11.2.2
Image
Sharpening 266
11.3
Digital
Video 267
11.3.1
Special
Effects and Gradual Transition 269
11.3.1.1
Wipe 269
11.3.1.2
Dissolve 272
11.3.1.3
Fade
In/Out 272
11.3.2
Video
Segmentation 273
11.3.2.1
Camera
Operations 279
11.4
Image
and Video Editing Softwares 280
11.5
Summary 280
References 281
Questions 282
Part
III: Multimedia Systems
12. Analog and Digital Television 283
12.1
Analog
Television Standards 283
12.2
Raster
Scanning 285
12.3
Color
Space for TV Transmission 286
12.3.1
NTSC
System 288
12.3.2
PAL
System 289
12.4
NTSC
Television System 291
12.4.1
Channel
Assignment 291
12.4.2
NTSC
Encoder and Decoder 293
12.5
Component and S-Video 295
12.6
Digital
Television 296
12.6.1
Grand
Alliance HDTV Standard 299
References 303
Questions 304
13. Content Creation and Management 305
13.1 Multimedia Authoring 305
13.1.1
Authoring
Steps 306
13.2 Multimedia Authoring Tools 308
13.2.1
Card/Page-Based
Tools 309
13.2.2
Icon-Based
Tools 310
13.2.3
Time-Based
Tools 311
13.2.4
Object
Oriented Tools 312
13.3 Multimedia
Documents 313
13.4 Hepertext and
Hypermedia 315
13.4.1
Nonlinear Information Chain 315
13.4.2
Hypertext and Hypermedia Systems 316
13.4.3
Mark-up
Languages 317
13.4.4
HTML 318
13.4.5
XML 321
13.5 Web Authoring
Tools 323
13.6 Multimedia
Standards 325
13.6.1
The MPEG-7 Standard 326
13.6.2
The MPEG-21 Standard 328
13.6.3
The MHEG Standard 329
13.7 Summary 329
References 330
Questions 330
14. Optical Storage Media 333
14.1
Physical
Medium 334
14.1.1
Cross-section of a CD 334
14.1.2
Digital Versatile Disc (DVD) 335
14.1.3
Physical Formats and Speeds 336
14.1.4
Playback of CD and DVD 337
14.1.5
CD-ROM, CD-R, and CD-RW 340
14.1.6
Advantages of Optical Technology 342
14.2
CD and DVD Standards 342
14.2.1
Audio CD 343
14.2.2
CD-ROM Standard 346
14.2.3
DVD Data Storage Principles 347
14.2.4
Video CD and DVD-Video Standards 348
References 350
Questions 350
15. ELECTRONIC DisplayS 351
15.1
Important
Display Parameters 351
15.2
Cathode-Ray
Tube 353
15.3
Field Emission Display 355
15.4
Plasma Display 357
15.5
Liquid Crystal Display 360
15.6
Digital Micromirror Display 363
References 365
Questions 366
Appendix: About the CD-ROM 367
INDEX 371