s Media - Video Coding 1. 2.
3.
Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001
Scenarios for Multimedia Applications - Motivation - Requirements Principles for Media Coding ➤ Redundancy - Irrelevancy ➤ Quantization as most important principle of Irrelevancy Reduction ➤ Entropy Coding (Run length, Hufman) as Redundancy Reduction ➤ Predictive Coding and DPCM based on decorrelation of signals ➤ Intraframe Coding (Motion Compensation) for temporal prediction ➤ Transform Coding (DCT) for decorrelation of signals ➤ Hybrid Coding the basic coding principle for all standards Standards ➤ Overview, importance of standards ➤ ITU - H.263 + H.26L, principles, demos (video quality at various rates) ➤ MPEG-2; MPEG-4, principles, demos (Functionality of MPEG-4) ➤ MPEG-7: principles, applications, demos ➤ JPEG-2000: Principles,demos (Functionality of JPEG-2000)
15 Min 75 Min 10 Min 10 Min 10 Min 10 Min 10 Min 10 Min 15 Min 120 Min 15 Min 15 Min 30 Min 30 Min 30 Min 1
Dr. Eckart Hundt; Siemens AG, CT IC 2; D-81730 München; Tel.: +49-89-636 53388;
[email protected]
Media - Video Coding: Standards
© Dr. Hundt; Siemens AG CT IC 2; München
s Importance of Standards
Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001
•• Standards Standardsguarantee guaranteedata datastreams streamsthat thatare are exchangeable exchangeablebetween betweendifferent differentterminals terminalsand andapplications applications ØØ Standards Standardsare areBasis Basisfor forProducts Productsand andApplications Applications •• Standards Standardsdescribe describeaadata datastream stream(sequencing (sequencingand andsyntax) syntax)ininaaway waythat that each eachdecoder decodercan canuniquely uniquelyand andconsistently consistentlydecode decodethe thedata datastream stream •• Features Featuresas aserror errorresilience, resilience,delay, delay,display displayprocess processare arenot notdefined definedininstandard standard •• Implementation Implementationofofdecoder decoderisisdefined definedtotoaahigh highdegree, degree, but encoders are not consistently defined but encoders are not consistently defined ØØ Performance Performanceof ofaastandardized standardizedsystem systemisisdependent dependentfrom fromimplementation implementation •• Major Majorworldwide worldwideresearch researchand anddevelopment developmentisisrepresented representedat atstandardisation standardisation bodies bodieslike likeITU ITUand andISO/MPEG ISO/MPEG ØØ Standards Standardsrepresent representleading leadingedge edgeof oftechnology technology Media - Video Coding: Standards
© Dr. Hundt; Siemens AG CT IC 2; München
s Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001
Video & Image Coding Standards
Series of Still Images
JPEG JPEG
M-JPEG2000 M-JPEG2000
JPEG2000 JPEG2000 Flexible Still Images
Still Images
MPEG-7 MPEG-7
Content Description
MPEG-1 MPEG-1
MPEG-2 MPEG-2
Video CD
Digital TV
MPEG-4 MPEG-4 V1 V1
ISO/IEC
MPEG-4 MPEG-4
V2 V2
V3 V3 V4 V4
Generic Multimedia Applications
MPEG-21 MPEG-21 E-Trade of AV Content
H.261 H.261 V2 V2
H.263 H.263
H.263 H.263
H.263 H.263
V1 V1
V2 V2
V3 V3
Videoconferencing over ISDN
1992
Media - Video Coding: Standards
Video Communication
Videotelephony, Low Bitrate Communication
1996
H.26L H.26L 3 ITU-T
2000 © Dr. Hundt; Siemens AG CT IC 2; München
s Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001
International Compression Standards STANDARD
JPEG
H.263 ITU-T3615 LBC
MPEG-1
MPEG-2
MPEG-4
ISO/IEC 11172-2
ISO/IEC 13818-2 ITU-T H.262
ISO/IEC 14496-2
ISO/IEC 10918-1 ITU-T T.81
H.261/p x 64
Compression of photographic images
Low bitrate compression for video comunication
interactive Video retrieval from CD-ROM
generic high quality video coding
generic objectbased video coding
64 k x 64 k No fixed formats
CIF 352x288 QCIF 176x144 SQCIF88x72
SIF 352x288
CCIR 601 720x576
SQCIF to CCIR progressive & interlaced
N/A
8 kb/s to 2 Mb/s px64 kb/s
ó1.856 M (CPS)
(MP@ML)
8 x 8 pels
16 x 16 pels
16 x 16 pels
16 x 16 pels
8 x 8 pels
Temporal prediction
N/A
forward/ bidirectional
forward/ backward/ bidirectional
forward/ backward/ bidirectional
forward/ bidirectional
Motion comp. range/ resolution
N/A
H.263: ± 32/ 0.5 H.261: ± 15/ 1
± 128/ 0.5
± 127 (V), ± 1023 (H) /0.5
resolution dependent; half pel
Rate control
No
Yes
Yes
Yes
Yes; multi video objects
Functionality
Source resolution (pixels x lines) Bit rates [bit/s] min. Data Unit
Media - Video Coding: Standards
ITU-T 3615
(MP@ML)
ó15 M
5 kb/s to 4 Mb/s
© Dr. Hundt; Siemens AG CT IC 2; München
s Comparison of Coding Efficiency
Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001
dB
Test Scene Foreman with much motion 45 43 41 39 37 35 33 31 29 27 25
H26L MPEG4 MPEG2 MPEG1
1000
2000
5
KBits
Media - Video Coding: Standards
© Dr. Hundt; Siemens AG CT IC 2; München
s Comparison of Coding Efficiency
Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001
Test Scene Akiyo with slow motion 51
dB
49 47 45
H26L MPEG4 MPEG2
43 41
MPEG1
39 37 35 1000
2000
6
KBits
Media - Video Coding: Standards
© Dr. Hundt; Siemens AG CT IC 2; München
s System Standards for Multimedia Terminals Video I/O equipment
Video Codec
Audio I/O equipment
Audio Codec
Data applications (T120)
Data Protocols
System control
Control Protocol H.245
Delay
Terminal
Network
Channel bit rate
H.320 H.324/I
N-ISDN
64-1920 kbit/s
H.323
LAN
64-1920 kbit/s
H.324
PSTN
Profile hierarchy ensures interoperability
ACE
Simple Features: Features: •• basic basic codec codec •• QCIF QCIF -- CIF CIF ••