draft-hsyang-avtcore-rtp-haptics-02.txt   draft-hsyang-avtcore-rtp-haptics-03.txt 
avtcore HS Yang avtcore HS Yang
Internet-Draft X. de Foy Internet-Draft X. de Foy
Intended status: Standards Track InterDigital Intended status: Standards Track InterDigital
Expires: 5 September 2024 4 March 2024 Expires: 26 September 2024 25 March 2024
RTP Payload for Haptics RTP Payload for Haptics
draft-hsyang-avtcore-rtp-haptics-02 draft-hsyang-avtcore-rtp-haptics-03
Abstract Abstract
This memo describes an RTP payload format for the MPEG-I haptic data. This memo describes an RTP payload format for the MPEG-I haptic data.
A haptic media stream is composed of MIHS units including a A haptic media stream is composed of MIHS units including a
MIHS(MPEG-I Haptic Stream) unit header and zero or more MIHS packets. MIHS(MPEG-I Haptic Stream) unit header and zero or more MIHS packets.
The RTP payload header format allows for packetization of a MIHS unit The RTP payload header format allows for packetization of a MIHS unit
in an RTP packet payload as well as fragmentation of a MIHS unit into in an RTP packet payload as well as fragmentation of a MIHS unit into
multiple RTP packets. multiple RTP packets.
skipping to change at page 1, line 35 skipping to change at page 1, line 35
Internet-Drafts are working documents of the Internet Engineering Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet- working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/. Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress." material or to cite them other than as "work in progress."
This Internet-Draft will expire on 5 September 2024. This Internet-Draft will expire on 26 September 2024.
Copyright Notice Copyright Notice
Copyright (c) 2024 IETF Trust and the persons identified as the Copyright (c) 2024 IETF Trust and the persons identified as the
document authors. All rights reserved. document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents (https://trustee.ietf.org/ Provisions Relating to IETF Documents (https://trustee.ietf.org/
license-info) in effect on the date of publication of this document. license-info) in effect on the date of publication of this document.
Please review these documents carefully, as they describe your rights Please review these documents carefully, as they describe your rights
skipping to change at page 2, line 23 skipping to change at page 2, line 23
5. Payload format for haptics . . . . . . . . . . . . . . . . . 5 5. Payload format for haptics . . . . . . . . . . . . . . . . . 5
5.1. RTP header Usage . . . . . . . . . . . . . . . . . . . . 5 5.1. RTP header Usage . . . . . . . . . . . . . . . . . . . . 5
5.2. Payload Header . . . . . . . . . . . . . . . . . . . . . 6 5.2. Payload Header . . . . . . . . . . . . . . . . . . . . . 6
5.3. Payload Structures . . . . . . . . . . . . . . . . . . . 7 5.3. Payload Structures . . . . . . . . . . . . . . . . . . . 7
5.3.1. Single Unit Payload Structure . . . . . . . . . . . . 8 5.3.1. Single Unit Payload Structure . . . . . . . . . . . . 8
5.3.2. Fragmented Unit Payload Structure . . . . . . . . . . 8 5.3.2. Fragmented Unit Payload Structure . . . . . . . . . . 8
5.4. MIHS Units Transmission Considerations . . . . . . . . . 10 5.4. MIHS Units Transmission Considerations . . . . . . . . . 10
6. Payload Format Parameters . . . . . . . . . . . . . . . . . . 10 6. Payload Format Parameters . . . . . . . . . . . . . . . . . . 10
6.1. Media Type Registration Update . . . . . . . . . . . . . 10 6.1. Media Type Registration Update . . . . . . . . . . . . . 10
6.2. Optional Parameters Definition . . . . . . . . . . . . . 11 6.2. Optional Parameters Definition . . . . . . . . . . . . . 11
7. SDP Considerations . . . . . . . . . . . . . . . . . . . . . 12 6.3. SDP Parameter Registration . . . . . . . . . . . . . . . 12
7.1. SDP Offer/Answer Considerations . . . . . . . . . . . . . 13 7. SDP Considerations . . . . . . . . . . . . . . . . . . . . . 13
7.2. Declarative SDP considerations . . . . . . . . . . . . . 14 7.1. SDP Offer/Answer Considerations . . . . . . . . . . . . . 14
8. Congestion control consideration . . . . . . . . . . . . . . 14 7.2. Declarative SDP considerations . . . . . . . . . . . . . 15
8. Congestion control consideration . . . . . . . . . . . . . . 15
9. Security Considerations . . . . . . . . . . . . . . . . . . . 15 9. Security Considerations . . . . . . . . . . . . . . . . . . . 15
10. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 16 10. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 17
11. References . . . . . . . . . . . . . . . . . . . . . . . . . 16 11. References . . . . . . . . . . . . . . . . . . . . . . . . . 17
11.1. Normative References . . . . . . . . . . . . . . . . . . 16 11.1. Normative References . . . . . . . . . . . . . . . . . . 17
11.2. Informative References . . . . . . . . . . . . . . . . . 16 11.2. Informative References . . . . . . . . . . . . . . . . . 17
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 18 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 18
1. Introduction 1. Introduction
Haptics provides users with tactile effects in addition to audio and Haptics provides users with tactile effects in addition to audio and
video, allowing them to experience sensory immersion. Haptic data is video, allowing them to experience sensory immersion. Haptic data is
mainly transmitted to devices that act as actuators and provides them mainly transmitted to devices that act as actuators and provides them
with information to operate according to the values defined in haptic with information to operate according to the values defined in haptic
effects. The IETF is registering haptics as a primary media type effects. The IETF is registering haptics as a primary media type
akin to audio and video [I-D.ietf-mediaman-haptics]. akin to audio and video [I-D.ietf-mediaman-haptics].
skipping to change at page 10, line 35 skipping to change at page 10, line 35
resources. Since, from a receiver standpoint, a missed MIHS unit may resources. Since, from a receiver standpoint, a missed MIHS unit may
originate from a not-sent silent unit, or a lost packet, a sender MAY originate from a not-sent silent unit, or a lost packet, a sender MAY
send one, or a few, MIHS silent units at the beginning of a haptic send one, or a few, MIHS silent units at the beginning of a haptic
silence. If a media receiver receives a MIHS silent unit, the silence. If a media receiver receives a MIHS silent unit, the
receiver SHOULD assume that silence is intended until the reception receiver SHOULD assume that silence is intended until the reception
of a non-silent MIHS unit. This can reduce the number of false of a non-silent MIHS unit. This can reduce the number of false
detection of lost RTP packets by the decoder. detection of lost RTP packets by the decoder.
6. Payload Format Parameters 6. Payload Format Parameters
This section describes payload format parameters. Section 6.1
updates the 'haptics' Media Type Registration and Section 6.2
specifies new optional parameters. Section 6.3 further registers a
new token in the media sub-registry of the Session Description
Protocols (SDP) Parameters registry.
6.1. Media Type Registration Update
This memo updates the 'hmpg' haptic subtype defined in section 4.3.3 This memo updates the 'hmpg' haptic subtype defined in section 4.3.3
of [I-D.ietf-mediaman-haptics] for use with the MPEG-I haptics of [I-D.ietf-mediaman-haptics] for use with the MPEG-I haptics
streamable binary coding format described in ISO/IEC DIS 23090-31: streamable binary coding format described in ISO/IEC DIS 23090-31:
Haptics coding [ISO.IEC.23090-31]. This memo especially defines Haptics coding [ISO.IEC.23090-31]. This memo especially defines
optional parameters for this type in Section 6.2. A mapping of the optional parameters for this type in Section 6.2. A mapping of the
parameters into the Session Description Protocol (SDP) [RFC8866] is parameters into the Session Description Protocol (SDP) [RFC8866] is
also provided for applications that use SDP. Equivalent parameters also provided for applications that use SDP. Equivalent parameters
could be defined elsewhere for use with control protocols that do not could be defined elsewhere for use with control protocols that do not
use SDP. The receiver MUST ignore any parameter unspecified in this use SDP. The receiver MUST ignore any parameter unspecified in this
memo. memo.
6.1. Media Type Registration Update
The following entries identify the media type being updated: The following entries identify the media type being updated:
Type name: haptics Type name: haptics
Subtype name: hmpg Subtype name: hmpg
The following entries are replaced by this memo: The following entries are replaced by this memo:
Optional parameters: see section 6.2 of RFC XXX (note to RFC editor: Optional parameters: see section 6.2 of RFC XXX (note to RFC editor:
replace with this RFC's number). replace with this RFC's number).
Person & email address to contact for further information: Yeshwant Person & email address to contact for further information: Yeshwant
Muthusamy (yeshwant@yeshvik.com) and Hyunsik Yang Muthusamy (yeshwant@yeshvik.com) and Hyunsik Yang
(hyunsik.yang@interdigital.com) (hyunsik.yang@interdigital.com)
6.2. Optional Parameters Definition 6.2. Optional Parameters Definition
skipping to change at page 12, line 44 skipping to change at page 12, line 44
_hmpg-dvctypes_ indicates, using a coma-separated list, the types of _hmpg-dvctypes_ indicates, using a coma-separated list, the types of
actuators. The device type is defined in [ISO.IEC.23090-31]: actuators. The device type is defined in [ISO.IEC.23090-31]:
MPEG_haptics.reference_device object.type is a string which may in MPEG_haptics.reference_device object.type is a string which may in
the initial release of the specifications hold values among "LRA", the initial release of the specifications hold values among "LRA",
"VCA", "ERM", "Piezo" or "Unknown". "VCA", "ERM", "Piezo" or "Unknown".
_hmpg-silencesupp_ indicates whether silence suppression should be _hmpg-silencesupp_ indicates whether silence suppression should be
used (1) or not (0). The default value shall be 1. used (1) or not (0). The default value shall be 1.
6.3. SDP Parameter Registration
This memo registers an 'haptics' token in the media sub-registry of
the Session Description Protocols (SDP) Parameters registry. This
registration contains the required information elements outlined in
the SDP registration procedure defined in section 8.2 of [RFC8866].
(1) Contact Information:
Name: Hyunsik Yang
Email: hyunsikyang@interdigital.com
(2) Name being registered (as it will appear in SDP): haptics
(3) Long-form name in English: haptics
(4) Type of name ('media', 'proto', 'fmt', 'bwtype', 'nettype', or
'addrtype'): media
(5) Purpose of the registered name:
The 'haptics' media type for the Session Description Protocol
is used to describe a media stream whose content can be
rendered as touch-related sensations.
The media subtype further describes the specific
format of the haptics stream. The 'haptics' media type for
SDP is used to establish haptics media streams.
(6) Specification for the registered name: RFC XXXX
RFC Editor Note: Replace RFC XXXX with the published RFC number.
7. SDP Considerations 7. SDP Considerations
The mapping of above defined payload format media type to the The mapping of above defined payload format media type to the
corresponding fields in the Session Description Protocol (SDP) is corresponding fields in the Session Description Protocol (SDP) is
done according to [RFC8866]. done according to [RFC8866].
The media name in the "m=" line of SDP MUST be haptics. The media name in the "m=" line of SDP MUST be haptics.
The encoding name in the "a=rtpmap" line of SDP MUST be hmpg The encoding name in the "a=rtpmap" line of SDP MUST be hmpg
The clock rate in the "a=rtpmap" line may be any sampling rate, The clock rate in the "a=rtpmap" line may be any sampling rate,
typically 8000. typically 8000.
The OPTIONAL parameters (defined in Section 6.2), when present, MUST The OPTIONAL parameters (defined in Section 6.2), when present, MUST
be included in the "a=fmtp" line of SDP. This is expressed as a be included in the "a=fmtp" line of SDP. This is expressed as a
media type string, in the form of a semicolon-separated list of media type string, in the form of a semicolon-separated list of
parameter=value pairs. parameter=value pairs.
An example of media representation corresponding to the hmpg RTP An example of media representation corresponding to the hmpg RTP
payload in SDP is as follows: payload in SDP is as follows:
skipping to change at page 16, line 23 skipping to change at page 17, line 8
(MANE) from performing media-aware operations other than discarding (MANE) from performing media-aware operations other than discarding
complete packets. In the case of confidentiality protection, it will complete packets. In the case of confidentiality protection, it will
even be prevented from discarding packets in a media-aware way. To even be prevented from discarding packets in a media-aware way. To
be allowed to perform such operations, a MANE is required to be a be allowed to perform such operations, a MANE is required to be a
trusted entity that is included in the security context trusted entity that is included in the security context
establishment. establishment.
10. IANA Considerations 10. IANA Considerations
This memo updates the media type registration of haptics/hmpg with This memo updates the media type registration of haptics/hmpg with
IANA, in Section 6. IANA, in Section 6.1.
11. References 11. References
11.1. Normative References 11.1. Normative References
[ISO.IEC.23090-31] [ISO.IEC.23090-31]
ISO/IEC, "Text of ISO/IEC FDIS 23090-31 MPEG Haptics ISO/IEC, "Text of ISO/IEC FDIS 23090-31 MPEG Haptics
Coding", ISO/IEC 23090-31, 2024, Coding", ISO/IEC 23090-31, 2024,
<https://isotc.iso.org/livelink/livelink/open/ <https://isotc.iso.org/livelink/livelink/open/
jtc1sc29wg7>. jtc1sc29wg7>.
 End of changes. 11 change blocks. 
14 lines changed or deleted 55 lines changed or added

This html diff was produced by rfcdiff 1.45. The latest version is available from http://tools.ietf.org/tools/rfcdiff/