MMT and DASH - KRnet · Summary of DASH 17 MPEG-DASH is a client-centric solution. The Client can control the QoS for the user in a DASH-based deployment MPEG-DASH Standardization

2012/4/19

KRnet 2014 (2014-06-24)

MMT and DASH over All-IP Network

2014. 06. 24

박경모 책임

([email protected])

KRnet 2014, H-1. Multimedia Networking

If you are interested in any of the following: Streaming audio and video to Smartphone, Tablet, PC, SMART

TV, or UHDTV over the Internet.

IP Broadcasting and Hybrid delivery services for multimedia.

Sending video on demand with QoS (Quality of Service)

Streaming multimedia with QoS or QoE (Quality of Experience)

You should learn about this.

Contents

Ⅰ MPEG-DASH

Ⅱ MPEG-MMT


Video will dominate the Internet and Mobile

Internet Real-time video is 50% of the traffic at peak periods

notably 28.18% from Netflix and 16.78% from YouTube*

Mobile Video traffic is growing exponentially & is a large portion

Source: Cisco White Paper:

Cisco Visual Network: Index:

Global Mobile Data Traffic Forecast

Update, 2010-2015

69.1%

* source : sandvine


Cloud applications and services also dominate

Cloud Video many Internet video applications can be categorized as cloud applications, mobile cloud traffic follows a curve similar to video.

Netflix, YouTube, Pandora, and Spotify allow mobile users to overcome the memory capacity and processing power limitations of mobile devices. Mobile Video Will Generate Over 69 Percent of Mobile Data Traffic by 2018

Source: Cisco White Paper:

Cisco Visual Network: Index:

Global Mobile Data Traffic Forecast

Update, 2010-2015


The generation of the high quality and combined multimedia consumption

at the various devices with no constraint of user environments”

All IP,

Clouds 2011 2015 2020

Beginning Mobile media 1st generation of mobile media

Extension of mobile media

Completion of mobile media

Full HD 3D IPTV, Sat. Cable UHD

Terr. UHD broadcasting

Movement for Smart Multimedia Delivery

3D Earth

UD contents


Contents

Devices

Network

• Immersive Contents (UHD)

• Smart interactivity

• Multiple contents on the screen

• High Speed Broadcasting Network

• Emerging Broadband Network

• Hybrid Delivery

• Larger Screen Devices.

• Multimedia Devices everywhere.

• Single service on the multiple Screens

Trends in Broadcasting

2012/4/19

KRnet 2014 (2014-06-24)

MPEG-DASH (ISO/IEC 23009-1)


User Frustration with Internet Video

Can’t access the content

Behind a firewall

Bandwidth not sufficient

Wrong format

Wrong DRMs

Wrong device

Background

Low quality of experience

Long start-up delay

Frequent re-buffering

Low playback quality

No lip-sync

No DVD quality (language, subtitle)

Apple

Microsoft

Adobe

“HTTP Live Streaming”

“Smooth Streaming”

“HTTP Dynamic Streaming”

IETF

“HTTP Streaming”, “HTTP Progressive Download”

The need for an interoperable universal standard that can work on today’s Internet infrastructure and delivery a consistent high quality

experience to the end user.


What is DASH?

Dynamic Adaptive Seamless rate adaptation Random access & Trick mode support

Streaming Not (progressive) download Including “Live” streaming

HTTP Assuming legacy HTTP 1.1 service & client HTTP cache mechanism


HTTP Adaptive Streaming – Common Understanding

HTTP (RFC2616)

Application layer protocol (over TCP), presume a reliable Transport layer protocol for host-to-host data transfer.

request-response protocol in the client-server computing model. Intermediate network elements to improve or enable communications between clients and

servers (proxy and/or web cache). HTTP Resources are identified and located on the network by Uniform Resource Identifiers

(URIs) or, more specifically, Uniform Resource Locators (URLs) using the http or https URI schemes.

Source : DASH Workshop (T. Stockhammer)


MPEG-DASH (ISO/IEC 23009-1)

A New Standard : ISO/IEC 23009-1 Efficient solution for HTTP-based streaming of MPEG media

Objectives A specification defining standard delivery format for streaming multimedia

over Internet.

A standard for building interoperable solutions by various vendors.

provides formats to enable efficient and high-quality streaming over the Internet

IS published (2012) ISO/IEC 23009-1, Media Presentation Description and Segment Formats

extensions to ISO Based Media File Format to support DASH (ISO/IEC 14496-12/AMD3)

Common Encryption 23001-7 with AES-128 CTR


Scope of the MPEG-DASH

MPD and Index information for DASH access client Core specification aspects of DASH

Initialization and Media Segment for Media engine Reuse of existing container formats and easy conversion


Example of DASH

* Period : Time sequence of Media Presentation * Representation : Encoded version of media component * Random access & Trick mode support


MPD hierarchical model

Splicing of arbitrary content

Selection of Components

Select/ Switch of Bandwidth

Set of switchable Representation


Example Deployment Architecture

Content Preparation

Ingestion component

Content Cloud Services (HTTP caching servers) IP Networks DASH Client

Original Content Original content encoded into video streams at different media bitrates

Packages video streams into video files MPD file generated for the video files URL generated for MPD files URI indicated for each Media Segments

HTTP Delivery

All intelligence in the client side Accesses MPD file based on URL & makes requests for appropriate video file adjust media rate based on network conditions


Intelligence in Client-based control

16

The Client has significant information on its consumption environment (processing power, display, access bandwidth, etc.) and can directly select and dynamically adjust to these changing conditions.

The client can implement many smart measures to optimize quality and throughout such as buffering, load balancing, multiple connections and so on.

The client can directly react to user interaction

It permits to use standard HTTP servers permitting massively scalable and cost-efficient distribution of high-quality content.

It permits stateless distribution of content, i.e., the network does not have to maintain 1:1 connection for a session.

Source : DASH Workshop (T. Stockhammer)


Summary of DASH

17

MPEG-DASH is a client-centric solution.

The Client can control the QoS for the user in a DASH-based deployment

MPEG-DASH

Standardization is completed (ISO/IEC 23009-1)

— harmonized industry standard for OTT video

— applicable to TV and mobile world

Support the client in making smart decisions by providing available information to client

— specified the MPD describes accessible Segment and corresponding timing.

— focused on Segment formats based on MPEG container format.

Use general purpose tools for controlling HTTP/TCP applications (TCP CC, HTTP codes, etc.)

Use existing control mechanisms (DRM authentication, HTML5/Web tools).


MPEG-DASH Status

18

Latest status in MPEG DASH

23009-1 2nd Edition FDIS, Amd1 support for event messages and extended

audio channel configuration (Aug. 2013)

23009-2 FDIS, Conformance and reference software (Aug. 2013)

23009-3 DTR, Implementation Guidelines (Aug. 2013)

Descriptions of Core Experiments on DASH amendment

— Metadata track

— DASH Authentication for Content URL validation

— Server and Network assisted DASH operation

— Controlling DASH client behavior

— Spatial relationship description

Technologies under Consideration

— Low latency live support

— Improved relations for advanced media (e.g. depth)


Forward looking

19

Open sources

The MPEG-DASH conformance and reference software provides the ideal playground for researchers as it can be used both to generate and to consume bitstreams compliant to the standard.

(http://www.dashif.org/)

(http://gpac.wp.mines-telecom.fr/) http://www-itec.aau.at/dash/

http://www.dashif.org/

http://gpac.wp.mines-telecom.fr/



http://www-itec.aau.at/dash/



2012/4/19

KRnet 2014 (2014-06-24)

MPEG-H, MMT (ISO/IEC 23008-1)


Future Broadcasting

Enjoy very high quality and combined multimedia consumption at the

various devices with no constraint of user environments

VOD

Live streaming

File

widget

E-book

UHD

metadata

Broadband

Broadcast

Mobile

UHD : Ultra High Definition VOD : Video on Demand

Hybrid


Future Multimedia Services

Evolution : High Quality Contents and High Speed Network

Revolution : Data Broadcasting, Multiple Screens, Hybrid Network

Big Screen

UHDTV

Multiple Screens

Mobile HD

Data Broadcasting Hybrid Network

(Bi-directional services)

(w/ sync-ed services)


Future Broadcast Requirement

• IP based multimedia delivery for all kinds of devices

– Many service provider and broadcaster believes, all IP based network

environment is for the future delivery.

• QoS/QoE enhanced media delivery over IP

– People wants to enjoy HDTV experience regardless of underlying network

types; No buffering time, constant and high quality.

• Not only AV but also ‘new media’ and ‘non-timed media’

– New media: Augmented Reality can be presented over video.

– Non-timed media: Widget and image can be presented over video.

• Storage and streaming in common format

– More streamlined and simple format for media delivery.

• Operator manages core and fundamental service description

– Complex presentation but simple and light composition format.


Analyzing the improvement factors

New standard should be substantially better than MPEG-2 TS and MP4/HTTP, RTP/RTSP and combinations – It would be nice if it is a companion to

MPEG-2 TS

MPEG-2 TS is overloaded new solution might be required – Buffering models are getting complicated

(e.g. MVC/SVC over TS)

– Running out of code points

– TS/PES size is not suitable to emerging services (e.g. UHD)

New standards are required for – Converged application (Adaptive and/or

Progressive Download)

– Unmanaged environment

– Fixed and mobile convergence

– Hybrid delivery (Broadcast and Internet, Push/Pull/Unicast/Multicast/Overlay Multicast)

Internet Layer (IP)

Transport Layer (TCP, UDP)

Application Layer

(e.g. HTTP, RTP)

Delivery Layer (MPEG-2 TS, MP4

File)

Synchronization Layer

(MPEG-2 PES, MPEG-4 SL)

Compression Layer (Audio ES, Video ES)

• ES/SL/TS over RTP

• TS over UDP

• File over HTTP

• TS over HTTP


• New MPEG transport solution for IP environment

• More flexibility on content consumption and delivery

• Suitable for 1 to 1 as well as 1 to M transmission

P1 MPEG Media Transport

• HEVC provides a novel video format with a compression capability twice that of AVC ( to be

done by 2013.1Q)

• Extensions for support of higher bit-depth, color sampling beyond 4:2:0, stereo/multiview

(MVC-like) expected early 2014

P2 High Efficiency Video Coding

• “Home Theater” : More Speakers, Immersive 3D Audio

• “ Enhanced Personal System” : Immersive Audio in Portable Device

P3 3D Audio

MPEG-H MMT: An Emerging MPEG Standard for Multimedia Delivery over the Internet


MMT – New Global Standard

New global standard for media delivery and encapsulation

MMT allows broadcasters to move to IP without losing the major advantages of MPEG-2 TS (e.g. tight synchronization, clear buffer model) while also reducing complexity and overhead

MMT integrates fully with HTML5 and IP technologies

MMT provides excellent support for hybrid delivery of multimedia services

MMT is well suited to fixed and mobile reception


• Support any type of data (Video, Audio, Apps )

• Single format for transmission and storage

• Adaptation considering NW condition is possible

01 Media Encapsulation

• HTML 5 + enhancement for Media Consumption

• Supports any kinds of devices with a single presentation

• Temporal, Spatial and event based presentation is possible.

02 Media Presentation

• Most suitable IP based scheme for MPEG Media

• Network based adaptation is possible with CLO.

• Server controls NW resource.

03 Transport

MPEG-H Part 1 MMT

VOD

Live streaming

File

widget

E-book

UHD

TV

`

Windows Media

Encoder

Windows Media

Server

PC Streaming

Media Portal

Symbol Description

Delivery over DSL

Subscriber

Management

EPG

DServer Media Router

Acquisition Server

Live Encode

TV2 Headend

Symbol Description

Delivery over DSL

TV2 uses a Windows Media

Server farm as its media store.

Media delivered to the PC may

also be delivered to the TV,

including Video, Music and

Photos.

The TV2 Notification Web

Service supports integration

with voice (Caller ID and SMS)

as well as data (Instant

Messaging, Alerts) services.

TV2 and the

Streaming Media Portal

IP network

MMT Packets

MMT Packets

MMT Packet

metadata

Hybrid delivery

Multi-service/context aware

Adaptation

MMT Package

MMT assets


MMT – Functional Areas

• Functional areas – Encapsulation

• Container Format

• Media Packetization

• Media Fragmentation

• Media Synchronization

• Content Protection

– Delivery

• Network flow multiplexing

• Network Packetization

• QoS, AL-FEC, ARQ

– Signaling

• Information for Media Consumption

• Information for Media Delivery

Media Coding Layer

Encapsulation Function

Delivery Function

Transport Protocol (TCP, UDP)

Signaling Function

Internet Protocol (IP)


MMT Architecture & protocol stack


MMT – Content Model

Package can be logically defined for dynamic creation of

mash-up service

Each Access is associated with

delivery characteristics

information

Temporal relationship information is

provided to optimized delivery order

Asset (and MPU) is uniquely identifiable

for distributed caching and named

based search

* CI provides information for associating assets to a specific screen for multiple screen presentation environments.


MMT Package instantiation, packetization


IP Broadcasting over MMT

technology media synchronization channel change time UTC

MPEG2-TS STC-based DTS/PTS up to 2 seconds not supported

DASH on eMBMS DTS/PTS (always relative time) 2~4 sec. not supported

MMT UTC-based DTS/PTS up to 1.4 sec. supported


Hybrid delivery over MMT

technology Ad insertion presentation synchronization

MPEG2-TS static not supported not supported

DASH on eMBMS flexible at media level maybe supported with HTML5 possible with MPD update in advance

MMT flexible at media and

packet level fully supported with MPEG-H CI

and HTML 5 fully supported with MPEG-H CI


Targeting Specific Audience Group over MMT


Presenting the Multiple Content Items in MMT


MMT – Encapsulation

Media Fragment Unit – a generic container format, independent of any specific media codec, containing coded media data

that is independently consumable by a media decoder. – equal to or smaller than an Access Unit (AU) and contains information that can be utilized by

delivery layers. – aligned to “NAL” concept in AVC series standards (including HEVC)

MMT Processing Unit – a generic container format, independent of any specific media codec, containing one or more AUs

and additional delivery and consumption related information. – coded media data unit that can be completely and independently processed in MMT.

MMT Asset – data entity that is composed of one or more MPUs. – the largest data unit for which same composition information and data characteristics are applied. – contains only one kind of data type including packaged or multiplexed data

(e.g. a portion of audio ES, a portion of video ES, an MPEG-U Widget Package, a portion of MPEG-2 TS, a portion of MP4 file, and a portion of MMT Package).

MMT Package – MMT Package is a logical entity. – An MMT Package shall contain one MMT Composition Information (MMT-CI), one or more MMT

Assets and an associated MMT Asset Delivery Characteristics (MMT-ADC) for each MMT Asset


MMT – Packetization

length (16bits) – This field indicates the length of the payload in bytes excluding the header.

type (8bits) − This field indicates the type of payload data.

f_i (2bits) − This field indicates the fragmentation indicator contains information about fragmentation of data unit in the payload.

fragment_counter (frag_count: 8 bits) − This field specifies the number of payload containing fragments of same data unit succeeding this MMT payload.

number_data_unit (numDU: 4 bits) − This field specifies the number of data unit within this MMT payload.

DU_offset (16bits) − This field specifies location of each data unit from the byte indicated by data_offset. This field shall be used, when aggregation_flag is set to ‗1‘.

payload_sequence_number (32 bits) − This field specifies the sequence number of payload associated with the same Asset.


MMT Packet

Similar features to MPEG-2 TS packets

– Multiplexing of components into one delivery stream

– Interleaving of data from multiple components considering consumption order

– Random access indication

New features

– Assuming TCP/UDP/IP as underlying delivery layer protocol

– Carrying delivery time instance based on NTP for delivery jitter removal

– Two stage application layer FEC for strong error protection


MMT – Signaling


Delivery Function


Delivery Function

Similar features to MPEG-2 Sections

– Carrying composition information

– Providing location information of components

– Structure supporting repeated delivery

– Hierarchical structure of information

New features

– Information for clock synchronization between MPEG-2 PCR and NTP

– Device Capability information and Downloadable DRM/CAS information are provided.


Conclusion

MMT is a fully developed standard as an MPEG-H family (Systems).

MMT lies between HTML5 and IP — it connects them

MMT puts broadcaster in control of the hybrid broadcast/ broadband experience

Single solution for encapsulation, delivery and presentation

Designed for IP Packet based multimedia delivery

Packet oriented delivery and use of Internet protocols and functionalities (e.g. NTP)

Works over IP as well as non IP

Server/System driven streaming approach

QoS/QoE enhanced media delivery over IP

Not only ‘AV’ but also ‘non-timed media’

Data plane for the delivery of media data

Control plane for signaling/management of presentation and delivery

Enhanced Error Resilience : Two Stage AL-FEC (AL-FEC Framework)

KRnet 2014, H-1. Multimedia Networking 41

Documents

MMT and DASH - KRnet · Summary of DASH 17 MPEG-DASH is a client-centric solution. The Client can control the QoS for the user in a DASH-based deployment MPEG-DASH Standardization