Media - Video Coding: Standards

s Media - Video Coding 1. 2. 3. Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001 Scenarios for ...
Author: Neal McCoy
1 downloads 3 Views 3MB Size
s Media - Video Coding 1. 2.

3.

Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001

Scenarios for Multimedia Applications - Motivation - Requirements Principles for Media Coding ➤ Redundancy - Irrelevancy ➤ Quantization as most important principle of Irrelevancy Reduction ➤ Entropy Coding (Run length, Hufman) as Redundancy Reduction ➤ Predictive Coding and DPCM based on decorrelation of signals ➤ Intraframe Coding (Motion Compensation) for temporal prediction ➤ Transform Coding (DCT) for decorrelation of signals ➤ Hybrid Coding the basic coding principle for all standards Standards ➤ Overview, importance of standards ➤ ITU - H.263 + H.26L, principles, demos (video quality at various rates) ➤ MPEG-2; MPEG-4, principles, demos (Functionality of MPEG-4) ➤ MPEG-7: principles, applications, demos ➤ JPEG-2000: Principles,demos (Functionality of JPEG-2000)

15 Min 75 Min 10 Min 10 Min 10 Min 10 Min 10 Min 10 Min 15 Min 120 Min 15 Min 15 Min 30 Min 30 Min 30 Min 1

Dr. Eckart Hundt; Siemens AG, CT IC 2; D-81730 München; Tel.: +49-89-636 53388; [email protected]

Media - Video Coding: Standards

© Dr. Hundt; Siemens AG CT IC 2; München

s Importance of Standards

Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001

•• Standards Standardsguarantee guaranteedata datastreams streamsthat thatare are exchangeable exchangeablebetween betweendifferent differentterminals terminalsand andapplications applications ØØ Standards Standardsare areBasis Basisfor forProducts Productsand andApplications Applications •• Standards Standardsdescribe describeaadata datastream stream(sequencing (sequencingand andsyntax) syntax)ininaaway waythat that each eachdecoder decodercan canuniquely uniquelyand andconsistently consistentlydecode decodethe thedata datastream stream •• Features Featuresas aserror errorresilience, resilience,delay, delay,display displayprocess processare arenot notdefined definedininstandard standard •• Implementation Implementationofofdecoder decoderisisdefined definedtotoaahigh highdegree, degree, but encoders are not consistently defined but encoders are not consistently defined ØØ Performance Performanceof ofaastandardized standardizedsystem systemisisdependent dependentfrom fromimplementation implementation •• Major Majorworldwide worldwideresearch researchand anddevelopment developmentisisrepresented representedat atstandardisation standardisation bodies bodieslike likeITU ITUand andISO/MPEG ISO/MPEG ØØ Standards Standardsrepresent representleading leadingedge edgeof oftechnology technology Media - Video Coding: Standards

© Dr. Hundt; Siemens AG CT IC 2; München

s Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001

Video & Image Coding Standards

Series of Still Images

JPEG JPEG

M-JPEG2000 M-JPEG2000

JPEG2000 JPEG2000 Flexible Still Images

Still Images

MPEG-7 MPEG-7

Content Description

MPEG-1 MPEG-1

MPEG-2 MPEG-2

Video CD

Digital TV

MPEG-4 MPEG-4 V1 V1

ISO/IEC

MPEG-4 MPEG-4

V2 V2

V3 V3 V4 V4

Generic Multimedia Applications

MPEG-21 MPEG-21 E-Trade of AV Content

H.261 H.261 V2 V2

H.263 H.263

H.263 H.263

H.263 H.263

V1 V1

V2 V2

V3 V3

Videoconferencing over ISDN

1992

Media - Video Coding: Standards

Video Communication

Videotelephony, Low Bitrate Communication

1996

H.26L H.26L 3 ITU-T

2000 © Dr. Hundt; Siemens AG CT IC 2; München

s Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001

International Compression Standards STANDARD

JPEG

H.263 ITU-T3615 LBC

MPEG-1

MPEG-2

MPEG-4

ISO/IEC 11172-2

ISO/IEC 13818-2 ITU-T H.262

ISO/IEC 14496-2

ISO/IEC 10918-1 ITU-T T.81

H.261/p x 64

Compression of photographic images

Low bitrate compression for video comunication

interactive Video retrieval from CD-ROM

generic high quality video coding

generic objectbased video coding

64 k x 64 k No fixed formats

CIF 352x288 QCIF 176x144 SQCIF88x72

SIF 352x288

CCIR 601 720x576

SQCIF to CCIR progressive & interlaced

N/A

8 kb/s to 2 Mb/s px64 kb/s

ó1.856 M (CPS)

(MP@ML)

8 x 8 pels

16 x 16 pels

16 x 16 pels

16 x 16 pels

8 x 8 pels

Temporal prediction

N/A

forward/ bidirectional

forward/ backward/ bidirectional

forward/ backward/ bidirectional

forward/ bidirectional

Motion comp. range/ resolution

N/A

H.263: ± 32/ 0.5 H.261: ± 15/ 1

± 128/ 0.5

± 127 (V), ± 1023 (H) /0.5

resolution dependent; half pel

Rate control

No

Yes

Yes

Yes

Yes; multi video objects

Functionality

Source resolution (pixels x lines) Bit rates [bit/s] min. Data Unit

Media - Video Coding: Standards

ITU-T 3615

(MP@ML)

ó15 M

5 kb/s to 4 Mb/s

© Dr. Hundt; Siemens AG CT IC 2; München

s Comparison of Coding Efficiency

Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001

dB

Test Scene Foreman with much motion 45 43 41 39 37 35 33 31 29 27 25

H26L MPEG4 MPEG2 MPEG1

1000

2000

5

KBits

Media - Video Coding: Standards

© Dr. Hundt; Siemens AG CT IC 2; München

s Comparison of Coding Efficiency

Universtät Klagenfurt - IWAS Multimedia Kommunikation (VK 622.776) Dr. Sebestyen/Dr. Hundt; Mai 2001

Test Scene Akiyo with slow motion 51

dB

49 47 45

H26L MPEG4 MPEG2

43 41

MPEG1

39 37 35 1000

2000

6

KBits

Media - Video Coding: Standards

© Dr. Hundt; Siemens AG CT IC 2; München

s System Standards for Multimedia Terminals Video I/O equipment

Video Codec

Audio I/O equipment

Audio Codec

Data applications (T120)

Data Protocols

System control

Control Protocol H.245

Delay

Terminal

Network

Channel bit rate

H.320 H.324/I

N-ISDN

64-1920 kbit/s

H.323

LAN

64-1920 kbit/s

H.324

PSTN

Profile hierarchy ensures interoperability

ACE

Simple Features: Features: •• basic basic codec codec •• QCIF QCIF -- CIF CIF ••