RFC 4597 INFORMATIONAL CONFERENCING · SCENARIOS · MULTIMEDIA

Conferencing Scenarios

A catalogue of group call situations, from simple dial-in meetings to sidebars, coaching and moderated chat, used to shape conferencing protocols.

On rfc-editor.org ↗
PUBLISHED
August 2006
AUTHORS
R. Even, N. Ismail
STREAM
IETF
QUADRATE VIEW
4 streams in a 2x2 arrangement
9 SUB-PICTURE VIEW
9 streams in a 3x3 arrangement
16 SUB-PICTURE VIEW
16 streams in a 4x4 arrangement
5+1 SUB-PICTURE VIEW
6 streams, one taking 4/9 of the screen
INTERACTIVE TEXT TRANSPORT
RTP, carrying one character at a time
BASIC PARTICIPANT REQUIREMENT
DTMF tones or voice responses to an IVR system
DOI
10.17487/RFC4597

RFC text

Contents
Original text · RFC Editor View on rfc-editor.org ↗
Network Working Group                                            R. Even
Request for Comments: 4597                                       Polycom
Category: Informational                                        N. Ismail
                                                     Cisco Systems, Inc.
                                                               July 2006


                         Conferencing Scenarios

Status of This Memo

   This memo provides information for the Internet community.  It does
   not specify an Internet standard of any kind.  Distribution of this
   memo is unlimited.

Copyright Notice

   Copyright (C) The Internet Society (2006).

Abstract

   This document describes multimedia conferencing scenarios.  It
   describes both basic and advanced conferencing scenarios involving
   voice, video, text, and interactive text sessions.  These scenarios
   will help with the definition and evaluation of the protocols being
   developed in the centralized conferencing XCON working group.

Table of Contents

   1. Introduction ....................................................3
   2. Basic Conferencing Scenarios ....................................3
      2.1. Ad Hoc Conferences .........................................4
      2.2. Extension of a Point-to-Point Call to a Multipoint Call ....4
      2.3. Reserved Conferences .......................................4
   3. Advanced Conferencing Scenarios .................................5
      3.1. Extending a Point-to-Point Call to a Multipoint Call .......5
      3.2. Lecture Mode Conferences ...................................5
      3.3. Conference with Conference-Aware and Unaware Participants ..6
      3.4. A Reserved or Ad Hoc Conference with
           Conference-Aware Participants ..............................6
      3.5. Advanced Conference Features ...............................6
   4. Scenarios for Media Policy Control ..............................9
      4.1. Video Mixing Scenarios ....................................10
      4.2. Typical Video Conferencing Scenario .......................11
      4.3. Conference Sidebar Scenario ...............................11
      4.4. Coaching Scenario .........................................12
      4.5. Presentation and Q & A Session ............................12
      4.6. Presence-Enabled Ad Hoc Conference ........................13
      4.7. Group Chat Text Conferencing ..............................13
      4.8. Interactive Text ..........................................13
      4.9. Moderated Group Chat ......................................14
      4.10. Text Sidebars ............................................14
      4.11. Conference Announcements .................................14
   5. Security Considerations ........................................14
   6. Acknowledgements ...............................................15
   7. Informative References .........................................15

1.  Introduction

   This document describes multimedia conferencing scenarios.  The
   development of these scenarios is intended to help with the
   definition and evaluation of the requirements for the centralized
   conferencing (XCON) working group.  Although this document uses some
   definitions and conventions described in the SIP Conferencing
   Framework document [1], these scenarios are not specific to SIP.  The
   document describes basic and advanced conferencing scenarios.  The
   advanced scenarios assume that the user agents support the set of
   XCON protocols, identified in the Framework and Data Model for
   Centralized Conferencing [3], in order to take advantage of the
   conference functionality.  However, note that many of these features
   can be implemented today by using an interactive voice response (IVR)
   or web interface to control the conferencing application.

   The entities comprising the Conferencing System are the conference
   that is the center point for signaling and the participants.  The
   participant who initiated the conference is called the initiating
   participant.

   The scenarios described here demonstrate different conferencing
   services.  These services can be offered in a multimedia environment
   that benefits from having some support in the user agents that enable
   more robust and easier-to-use conferencing services.  It is up to the
   conferencing system manufacturers and the conferencing service
   provider to decide what services can be built and which services are
   offered to the end users.

   The scenarios describe multimedia examples, but they are applicable
   to audio only as well as to audio and video conferences.

   Multimedia conferences may include any combination of different media
   types such as audio, video, text, interactive text, or presentation
   graphics.  The conference scenarios are similar, but the media
   handling may be dependent on the media type.

2.  Basic Conferencing Scenarios

   These scenarios enable a conference-unaware participant to create,
   join, and participate in a conference.  The participant may use out-
   of-band signaling to participate in a conference, but this is not
   mandatory.  The Conferencing System has all the functionality it
   needs in order to supply the service offered to the participants.
   Typical minimum requirements are that the participant support dual-
   tone multi-frequency (DTMF) tones/signal or provide voice responses
   to an IVR system.

2.1.  Ad Hoc Conferences

   A participant has a service provisioned to him that enables him to
   start an ad hoc conference when he calls the Conferencing System.
   When the participant wants to start a conference, he calls the
   conference service.  The participant may be identified by different
   means, including request destination, authenticated identity, or an
   IVR system using DTMF.  The conference is created automatically with
   the predefined functionality.  The participant who has such a service
   notifies the other participants how to call the conference via
   external means such as instant message or email.

   The participant may have Conferencing System functionality and thus
   can create an ad hoc conference using his own user agent.  An example
   of such a conference is an audio conference initiated by a
   participant who has a conference service that enables him to start a
   conference when he calls a specific URI.  The conference may be
   created by the first person calling this URI, or it may be created
   only after the owner is authenticated using an IVR system.  In the
   latter case, the other participants may get an announcement and are
   placed on hold if they call the conference before the owner.

2.2.  Extension of a Point-to-Point Call to a Multipoint Call

   This is a basic case.  The initiating participant (PA) is in a
   point-to-point call with another participant (PB).  PA wants to add a
   third participant (PC) to the call.  PA cannot provide the
   Conferencing System functionality on his user agent nor can the other
   participant PB.  PA and PB do not support call transfer.  PA has a
   conferencing service that uses the methods described in 2.1.  PA
   conveys the conference information to PB in the point-to-point call.
   Both participants disconnect and call the Conferencing System.  The
   Conferencing System may support dial-out (for example, via DTMF),
   allowing the initiating participant PA to call the third party PC
   through the Conferencing System.

2.3.  Reserved Conferences

   The reservation for this type of conference is typically done by an
   out-of-band mechanism in advance of the actual conference time.  The
   conference identification, which may be a URI or a phone number with
   a pin number, is allocated by the reservation system.  It is sent to
   all participants through email, IM, etc.  The participants join by
   using the conference identification.  The conference identification
   must be routable, enabling the allocation of a conference with free
   resources at the time when the conference actually runs.  The
   Conferencing System can also dial out to the conference participants.
   The participants may not be informed that they are in a conference,
   since their User Agent is not conference aware.  The participants may
   know, via announcement from the Conferencing System, that they are in
   a conference and who the other participants are.

3.  Advanced Conferencing Scenarios

   These scenarios assume user agents that support at least call
   transfer service and a way to communicate information on events from
   the Conferencing System to the user agent.  The Conferencing System
   may have the ability to discover the capabilities of the
   participants, for example, whether they support call transfer.  This
   section specifies the dependencies in each scenario.  An advanced
   conference can be initiated only by a user agent that has advanced
   features, but some user agents in the conference may have less
   functionality.

3.1.  Extending a Point-to-Point Call to a Multipoint Call

   The initiating participant PA is in a point-to-point call and wants
   to add a third participant.  PA can start a multipoint call on a
   conferencing bridge known to him.  The extension can be without
   consultation, which means that PA moves the point-to-point call to
   the Conferencing System and then adds the third party (this can be
   done in various ways).  Alternatively the extension can be done with
   consultation, which means that PA puts his current party on hold,
   calls the third party, asks him to join the conference, and then
   transfers all the participants to the Conferencing System.

3.2.  Lecture Mode Conferences

   This conference scenario enables a conference with a lecturer who
   presents a topic and can allow questions.  The lecturer needs to know
   who the participants are and needs to be able to give them the right
   to speak.  The right to speak can be based on floor control or an
   out-of-band mechanism.

   In general, the lecturer is seen/heard by the conference participants
   and often shares a presentation or application with the other
   participants.

   A participant joining this type of conference can get the identity of
   the lecturer and often the identities of the audience participants.

   This type of conference may have multiple media streams.  For
   example, if simultaneous language translation is available, a
   participant has the option of selecting the appropriate language
   audio stream.  Multiple video streams could include the speaker's
   face and a whiteboard/demonstration stream.

3.3.  Conference with Conference-Aware and Unaware Participants

   A conference can include a mix of participants that are conference-
   aware and unaware.  Conference-unaware participants may be using a
   proxy function that proxies the advanced functionality between the
   different protocols and the Conferencing System.  For example, an IVR
   system or a web page interface can be used to provide additional
   functionality.

3.4.  A Reserved or Ad Hoc Conference with Conference-Aware Participants

   In order to start the conference, the initiating participant calls
   the Conferencing System using, for example, a unique identifier.  The
   Conferencing System may use some authenticating method to qualify the
   participant.  The other participants may call the Conferencing System
   and join the conference.  The Conferencing System is able to find the
   capabilities of the participants.  In case of a reserved conference,
   the Conferencing System starts the conference at the scheduled time.
   The participants may join by calling the conference URI, or the
   Conferencing System may call them.  The conference may have privilege
   levels associated with a specific conference or participant.  The
   privileges are for the initiating participant and for a regular
   participant; the initiating participant may delegate privileges to
   the other participants.  The privileges allow functionality as
   defined in the next section.

3.5.  Advanced Conference Features

   The following features can be used in all the advanced conferencing
   scenarios.  In the examples given in this section, when referring to
   a participant that has a functionality, it means a participant with
   the right privileges.  These scenarios may be available in the
   advanced conferencing scenarios and are common in many conferencing
   applications.  This is not a requirement list, rather some examples
   of how specific functions may be used in a conference.

   o  Add Participants - A participant may add a new participant to the
      conference.  This can be done, for example, by instructing the
      Conferencing System to call the participant or by the first
      participant calling the new participant and pointing him to the
      conference.

   o  Delete Participant - A participant may delete participants from
      the conference if he can identify them.

   o  Changing User Agent/Modes - During the course of a conference, a
      participant may switch between user agents with different
      capabilities while still remaining part of the conference.  For
      example, a participant may initially join using a mobile phone and
      then switch to a desktop phone.  Or a participant may join with a
      phone, discover that the conference has video streams available,
      and switch to a video phone.

   o  Changing Media - During the conference, a participant may be able
      to select different media streams than the one he had when he
      joined the conference.  An example is a participant that initially
      joined the conference as an audio participant.  The participant is
      unable to understand the conversation properly, and he learns that
      there is also an interactive text available.  He will ask to
      receive the text stream also.

   o  Authenticate participants - A participant can authenticate other
      participants who want to join the conference.  This can be done,
      for example, in a video conferencing session by creating a sidebar
      between the two participants, allowing the authenticating
      participant to talk with the new participant and verify his
      identity.

   o  Authorize participants - A participant can authorize other
      participants in order to allow them to join the conference.  This
      can be done implicitly by assigning a password to the conference
      or to each participant and letting the Conferencing System decide
      if the new participant is allowed to join.  The authorization can
      be done explicitly by directing the entered password to the
      initiating participant who will authorize each participant.  The
      conferencing system may use an authentication mechanism to
      authenticate the participants.

   o  Controlling the presentation of media - During the conference, the
      participant may be able to manage whose media is being sent to
      each participant.  For example, the participant may be able to
      decide that he wants to be the speaker and all the rest to be
      listeners; he may also specify whose media he wants to receive.
      The participant may be able to mute a media stream during the
      conference.

   o  Giving privileges - During the conference, the participant may
      want to give a privilege to another participant.  The assigning of
      privileges may be implicit when requested or explicit by asking
      the participant to grant a privilege.

   o  Side conferences or sidebars - The participant may want to create
      a side conference that include some of the main conference
      participants.  When the side conference is finished, the
      participants return to the main conference.  A sidebar may have
      the same functionality as the main conference.  There can be
      several sidebar scenarios:

      1.  A basic sidebar requires that two participants have the
          capability to have two calls at the same time, with a point-
          to-point call in parallel to the main conference.  It is user
          agent implementation-specific whether both calls' streams are
          mixed automatically or the participants are allowed to
          manually switch between them.

      2.  A conferencing-system-based sidebar uses the Conferencing
          System to create the sidebar and compose the relevant sidebar
          stream mixes.  These mixes can include the main conference as
          an incoming stream to the mix.  Mechanisms to signal the
          creation of the sidebar, invite participants, and control the
          mixes should be available.

          For example, participants in an audio sidebar may not be heard
          by the rest of the conference.  However, the main conference
          audio may be mixed in the sidebar, but at a lower volume, or
          in a different channel.  As another example, a sidebar can
          have a different media type from the main conference: a video
          call can have an audio sidebar where the other participants
          can see the sidebar participants talking but cannot hear them;
          or an audio or video conference may have a text sidebar.

   o  Conference information - When a participant joins the conference,
      he is announced to the participants.  An announcement may be
      available when he leaves the conference.  The participants may
      query the conferencing system for the current participants of a
      specific conference.  This conference information may include
      other information, for example, the media streams available in the
      conference.

   o  Extending of a conference - Reserved conferences and ad hoc
      conferences may have a time limit.  The Conferencing System
      informs the participants when the limit is approaching and may
      allow the extension of the conference.

   o  Adding and removing a media type to the conference - A participant
      may want to start a data presentation during a conference.  He may
      want to distribute this new media to all the participants.  The
      participant asks the Conferencing System to start the new media
      channel and to allow him to send data in the new channel.

   o  Audio-only participants - In a multimedia conference, some of the
      participants who want to join may have no way to send and receive
      all the media types.  Typically, they can send and receive audio.
      Such participants join the conference as audio-only participants.
      The general case is that participants may send and receive only
      part of the media streams available in the multimedia conference.

   o  Passive participants - In a conference, some participants may be
      listeners to all or part of the media streams, but may be
      invisible to all other participants.

   o  Recorders - A recorder can be added to the conference.  A recorder
      can record all streams or a subset of the streams.  Recorders may
      be turned on and off during the conference.  Recorders may be used
      for a "role call" scenario in order to record a participant's
      name.  This name can be announced at a later stage automatically
      or based on a participant request.  A recorder is a case of a
      passive participant.

   o  Whisper/Private Message - A participant can send a one-way message
      (text, audio, or even some other media) to another participant
      that is immediately rendered.  This differs from a sidebar in that
      it is immediate and creates no long-lived session.

   o  Human operator - A participant may ask for assistance from a human
      operator during the conference.

4.  Scenarios for Media Policy Control

   During a conference, media streams may be controlled by authorized
   participants using either a media control protocol or a third-party
   application.  This section describes some typical media control
   scenarios.  The conference can be of any size.  Some of the media
   control scenarios are typical of specific conference sizes.  As a
   general rule, larger conferences scenarios tend to be more centrally
   managed or structured.

   The mixing of media in a conference may start when the conference
   starts or when the initiating participant joins.  In the later case,
   early participants may be put on hold and get "music on hold".

   The scenarios apply to audio conferences as well as to multimedia
   conferences.  In the sections below, there is some specific
   information about the mixed video layout and interactive text.

4.1.  Video Mixing Scenarios

   For video, the participant selects one of a set of predefined video
   presentations offered by the server.  Each video presentation is
   identified by a textual description as well as an image specifying
   how the presentation appears on the screen.  In this scenario, by
   choosing a video presentation, the participant chooses how many video
   streams (participants) are viewed at once and the layout of these
   video streams on the screen.

   The contents of each sub-window can be defined by a conference policy
   and/or controlled by authorized participants.  It may also be
   possible to have multiple mixes per conference, possibly as many as
   there are participants.  (Note that the same flexibility may be
   afforded to audio mixes as well.)

   The following is a list of typical video presentations.  Other
   layouts are available today in commercial products.

   - Single view: This presentation typically shows the video of the
     loudest speaker.

   - Dual view: This presentation shows two streams.  If the streams are
     to be multiplexed in one image (typical of centralized servers),
     the multiplexing can be:

     1.  Side-by-side windows, with no altered aspect ratio.  Thus,
         blanking of parts of the image might be necessary if the
         streams are to be combined as one image.

     2.  Side-by-side windows, with altered aspect ratios.  Thus,
         blanking parts of the image is not necessary.  The mixer
         handles the cropping of the images.

     3.  One window above the other, with no altered aspect ratio.

     4.  One window above the other, with altered aspect ratios.

   - Quadrate view: This presentation shows 4 streams.  If the streams
     are multiplexed into one image (centralized server), they are
     arranged in a 2x2 style.  Note that in this style the aspect ratios
     are maintained.

   - 9 sub-picture view: This presentation shows 9 streams.  If the
     streams are to be multiplexed in one image, they are arranged in a
     3x3 style.  In the multiplexing case, cropping is performed under
     the discretion of the mixer.

   - 16 sub-picture view: This presentation shows 16 streams.  If the
     streams are to be multiplexed into one image, they are arranged in
     a 4x4 style.  In this style, the aspect ratios are maintained, and
     no cropping or blanking is needed.

   - 5+1 sub-picture view: This presentation shows 6 streams.  If the
     streams are to be multiplexed into one image, then the pictures are
     laid so that one sub-window occupies 4/9 of the screen while each
     of the other five occupies 1/9 of the screen.

4.2.  Typical Video Conferencing Scenario

   This scenario is known as voice-activated video switch.  Every
   participant hears the N loudest participants but does not hear
   himself.  All the participants see the loudest speaker; the loudest
   speaker may see the previous loudest speaker.  This mode is typical
   for a small conference.

   A participant with proper authorization can exclude one or more
   participants from the audio or video mix.  An indication that they
   are not being seen/heard might be displayed to the affected
   participants.

   A participant with proper authorization can manipulate the gain level
   associated with one or more audio streams in the mix.

4.3.  Conference Sidebar Scenario

   An authorized participant creates a sidebar.  The participant selects
   whether the sidebar should include the media from the main conference
   or not and the audio gain level associated with the main conference
   audio.

   A participant invites participants to the sidebar, and upon
   acceptance they start receiving the sidebar media as specified by the
   sidebar creator.  If the new participant is not a participant of the
   conference, but is just a participant of the sidebar, the participant
   only receives the sidebar media without the media of the main
   conference.

   A participant with the right authorization can move another
   participant into the sidebar with no indication, in which case the
   participant suddenly starts receiving the sidebar media.

   Sidebar participants with the right authorization can select to hear
   or not to hear the main conference audio mixed with the sidebar
   audio.

   A participant can be a participant to more than one sidebar but can
   only actively participate in one.

   A participant can jump back and forth between the main conference and
   one or more sidebars.

4.4.  Coaching Scenario

   This is a call center or a remote training session where there is a
   supervisor who can monitor the conference.  The supervised
   participants may be the call center operators or the teachers.  A
   participant in the conference may be a supervised participant or a
   "customer".

   The supervisor is a hidden participant and is not part of the
   participant roster.

   The supervised participants might get an announcement/tone indicating
   that the supervisor has joined.  The other participants do not hear
   the announcement.

   The supervisor listens to or sees the session but can only be heard
   or seen by the supervised participant.

   The supervisor can become a normal participant, in which case the
   participants see the supervisor as part of the roster and start
   hearing and seeing him.

4.5.  Presentation and Q & A Session

   An example is an earning call scenario in which a group of presenters
   delivers material to a group of people.  After the presentation is
   finished, a Q & A session is opened.

   The conference is created as a panel, and the panel participants are
   identified.  Only their streams are mixed.

   After the end of the presentation, the session chair changes the
   conference type to normal, and now streams from all participants may
   be mixed.  Alternatively, a floor control protocol can be used.  The
   chair can grant the right to speak by adding the participant, whose
   turn it is to ask a question, to the conference mix.

4.6.  Presence-Enabled Ad Hoc Conference

   A presence-enabled ad hoc conference, sometimes described as "walkie
   talkie" service, is a scenario in which a participant sends media to
   the other participants of the conference after receiving a
   confirmation of the other participants' availability.  For example, a
   participant presses a talk button, which checks the presence of the
   participants to see if they are available for communication.  If they
   are, a confirmation tone is played, and the participant can then
   talk; as a result, the media is sent to the other participants in the
   conference.  These types of conferences tend to be long lived, hence
   the need for presence to ensure that the other participants are still
   available.  The ad hoc nature of the conference means that the
   participant list can be changed at any time.  Floor control can be
   used to allow other participants to speak, as the conference is
   usually half-duplex in nature.

4.7.  Group Chat Text Conferencing

   Group chat is a common scenario for text messaging in which a
   participant joins (or enters) a chat room in which text messages from
   participants are rendered in a single window and attributed to the
   participant that sent the message.  Changes in conference membership
   are often announced in the text window itself (e.g., "Alice has just
   entered the room.  Bob has just departed.").  Note that a real-time
   transcription/closed captioning service can provide a similar window
   in which audio media is converted into interactive text.  "Nicknames"
   or aliases are often chosen by participants or assigned by the
   Conferencing System and used as handles within the room.

4.8.  Interactive Text

   Interactive text uses RTP to carry text one character at a time,
   providing real-time interactivity, as described in RFC 4103 [2].  The
   interactive text session may be the main conference itself, or it may
   be used in conjunction with other media types.  Interactive text may
   be used to represent the audio in the conference using some
   translation services.  There can be more than one such stream where
   each text stream is in a different language.  These text streams may
   be used as subtitles to the audio stream.  The translation from to
   text to speech and back is done by transcoders.  These transcoders
   have similar functionality to transcoders between different audio or
   video algorithms.

   The conference participants should be able to select to receive text
   streams with the conference audio or those without it.

4.9.  Moderated Group Chat

   A moderated group chat scenario for text messaging is similar to
   group chat, but all text messages sent to the group are filtered/
   approved by a moderator.  Note that the moderator can be a human or
   an application.  The moderator also often has the ability to remove
   participants and provide feedback on their submissions (e.g., provide
   warnings before removal).

4.10.  Text Sidebars

   Interactive text or instant messaging sidebars are perhaps the most
   common sidebars in conferences today.  Often the text sessions are
   separate from the conference.  However, there are some advantages to
   having text sessions be a sidebar and as a result a part of the main
   conference.  For example, a conference that is providing anonymity/
   aliases to participants can also provide anonymous/alias sidebars.  A
   text sidebar can also benefit from other security/logging/recording
   services provided by the Conferencing System.

   Another use of a text sidebar is a text-only conversation/discussion
   between two or more conference participants who are following the
   main conference at the same time.

4.11.  Conference Announcements

   The conference moderator may be able to play announcements to all the
   conference participants.  An announcement may be prerecorded or
   composed by the moderator before it is sent.  The announcements may
   be text, audio, or audio-visual.  An example is a conference with
   several audio break-out sessions going on.  At some point, the
   moderator wants to record an audio message like "In 5 minutes,
   everyone please come back to the main meeting" and then play that
   message to all the breakout sessions.

5.  Security Considerations

   Conferences generally have authorization rules about who may or may
   not join a conference, what type of media may or may not be used,
   etc.  This information, sometimes called the conference policy or
   common conference information, is used by the Conferencing System to
   admit or deny participation in a conference.  For the conference
   policy to be implemented, the Conferencing System needs to be able to
   authenticate potential participants.  The methods used depend on the
   signaling protocols used by the conference.  This can include a
   challenge/response mechanism, certificates, shared secret, asserted
   identity, etc.

   Conferences often require that their content be confidential.  In
   addition, secure authorization of participants is incomplete if
   access to the media can be gained by unauthorized participants.
   Functions for securing the media and for key management and
   distribution to authorized participants need to be provided by the
   Conferencing System.  In some cases, the functions used for
   participant authorization can be leveraged for this purpose.

   Privacy is an important aspect of conferencing.  Users may wish to
   join a conference without anyone knowing that they have joined, in
   order to silently listen in.  In other applications, a participant
   may wish just to hide their identity from other participants, but
   otherwise let them know of their presence.  These functions need to
   be provided by the Conferencing System.

   These conference-specific security requirements are discussed further
   in the XCON framework document.

6.  Acknowledgements

   Thanks to Brian Rosen for contributing conferencing scenarios.

   Thanks to Alan Johnston for going over the document and adding some
   more scenarios; to Keith Lantz, Mary Barnes, and Dave Morgan for
   carefully reading the document.

7.  Informative References

   [1]  Rosenberg, J., "A Framework for Conferencing with the Session
        Initiation Protocol (SIP)", RFC 4353, February 2006.

   [2]  Hellstrom, G. and P. Jones, "RTP Payload for Text Conversation",
        RFC 4103, June 2005.

   [3]  Barnes, M., "A Framework and Data Model for Centralized
        Conferencing", Work in Progress, June 2006.

Authors' Addresses

   Roni Even
   Polycom
   94 Derech Em Hamoshavot
   Petach Tikva  49130
   Israel

   EMail: roni.even@polycom.co.il


   Nermeen Ismail
   Cisco Systems, Inc.
   170 West Tasman Drive
   San Jose  95134
   CA USA

   EMail: nismail@cisco.com

Full Copyright Statement

   Copyright (C) The Internet Society (2006).

   This document is subject to the rights, licenses and restrictions
   contained in BCP 78, and except as set forth therein, the authors
   retain all their rights.

   This document and the information contained herein are provided on an
   "AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS
   OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY AND THE INTERNET
   ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED,
   INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE
   INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED
   WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.

Intellectual Property

   The IETF takes no position regarding the validity or scope of any
   Intellectual Property Rights or other rights that might be claimed to
   pertain to the implementation or use of the technology described in
   this document or the extent to which any license under such rights
   might or might not be available; nor does it represent that it has
   made any independent effort to identify any such rights.  Information
   on the procedures with respect to rights in RFC documents can be
   found in BCP 78 and BCP 79.

   Copies of IPR disclosures made to the IETF Secretariat and any
   assurances of licenses to be made available, or the result of an
   attempt made to obtain a general license or permission for the use of
   such proprietary rights by implementers or users of this
   specification can be obtained from the IETF on-line IPR repository at
   http://www.ietf.org/ipr.

   The IETF invites any interested party to bring to its attention any
   copyrights, patents or patent applications, or other proprietary
   rights that may cover technology that may be required to implement
   this standard.  Please address the information to the IETF at
   ietf-ipr@ietf.org.

Acknowledgement

   Funding for the RFC Editor function is provided by the IETF
   Administrative Support Activity (IASA).

ISO Plain Language

On this page
PROBLEMA conferencing protocol has to work in many different situations, from a two-person call turned into a conference to a supervised training session, and it is hard to tell in advance which features a given situation needs.
MECHANISMThe document describes basic scenarios that need nothing special from the participants, advanced scenarios that assume conference-aware clients, and a set of media control scenarios covering video layouts, sidebars, text chat and announcements.
STATUS TODAYIt is an Informational catalogue, not a protocol. It is written to help the centralized conferencing working group define and evaluate its requirements, and it is deliberately not tied to SIP.

§1What a Conferencing System Is

The document describes multimedia conferencing scenarios, and it is intended to help with the definition and evaluation of the requirements for the centralised conferencing working group. It uses some definitions and conventions from the SIP Conferencing Framework, but the scenarios are not specific to SIP. The advanced scenarios assume that the user agents support the set of protocols identified in the framework and data model for centralised conferencing, so that they can take advantage of the conference functionality. Many of these features can be implemented today using an interactive voice response system or a web interface to control the conferencing application.

The entities making up a conferencing system are the conference, which is the centre point for signalling, and the participants. The participant who initiated the conference is called the initiating participant.

The scenarios demonstrate different conferencing services. These services can be offered in a multimedia environment that benefits from some support in the user agents, which makes the services more robust and easier to use. It is up to the manufacturers of conferencing systems and the service provider to decide which services can be built and which are offered to users. The scenarios describe multimedia examples, but they apply to audio-only conferences as well as to audio and video conferences. A multimedia conference may include any combination of media types such as audio, video, text, interactive text or presentation graphics; the scenarios are similar, but the media handling may depend on the media type.

A conferencing system has a server that handles the signalling for a call, and the people taking part. The document works through the situations that server has to cope with, and what each one needs from the phones and software of the participants.

§2Basic Scenarios That Need No Special Client

The basic scenarios let a participant who has no conference-aware software create, join and take part in a conference. The participant may use out-of-band signalling to take part, but that is not mandatory, and the conferencing system has all the functionality it needs to supply the service. The typical minimum requirement is that the participant supports dual-tone multi-frequency tones or can give voice responses to an interactive voice response system.

In an ad hoc conference, a participant has a service that lets him start a conference when he calls the conferencing system. He may be identified by the request destination, by an authenticated identity, or by an interactive voice response system using tones. The conference is created automatically with predefined functionality. The participant tells the other participants how to call in, by external means such as an instant message or email. The conference may be created by the first person to call that URI, or only after the owner is authenticated, in which case other participants who call first get an announcement and are placed on hold.

The second basic scenario extends a point-to-point call to a multipoint call. The initiating participant is in a call with another participant and wants to add a third. He has no conferencing functionality on his own user agent, the other participant has none either, and they do not support call transfer. He has a conferencing service of the kind described above, so he tells the other participant the conference information during the call, and both of them disconnect and call the conferencing system. The system may support dial-out, for example by tones, letting the initiating participant call the third party through it.

In a reserved conference the reservation is made out of band, in advance of the conference time. The conference identification, which may be a URI or a phone number with a pin number, is allocated by the reservation system and sent to all participants by email or instant message. The participants join using that identification, which must be routable so a conference with free resources can be allocated at the time it actually runs, and the conferencing system may also dial out to the participants. The participants may not know they are in a conference at all, since their user agent is not conference-aware, though they may learn from an announcement from the system that they are in a conference and who else is in it.

The basic cases need nothing from the participant's phone beyond the ability to press keys or speak. People dial a number, get put in a meeting, and are told who else is there. The harder part is joining an existing meeting or turning a two-person call into a group one, which in the basic case means both parties hang up and call in again.

AN AD HOC CONFERENCE, WITH THE INVITATION SENT OUT OF BAND
Initiating participantConferencing systemOther participant
  1. Call the conference serviceThe conference is created automatically with predefined functionality.
  2. Conference created
  3. Conference detailsSent out of band, by instant message or email.
  4. Join the conference

§3Advanced Scenarios and the Features They Need

The advanced scenarios assume user agents that support at least a call transfer service and a way to communicate information about events from the conferencing system to the user agent. The system may be able to discover the capabilities of the participants, for example whether they support call transfer. An advanced conference can be initiated only by a user agent with advanced features, but some user agents in the conference may have less functionality.

In the advanced version of extending a point-to-point call to a multipoint call, the initiating participant can start a multipoint call on a conferencing bridge he knows. The extension can be without consultation, in which case the participant moves the point-to-point call to the conferencing system and adds the third party, or with consultation, in which case he puts the current party on hold, calls the third party, asks him to join, and then transfers everyone to the conferencing system. A conference may mix conference-aware and conference-unaware participants, where the unaware ones may use a proxy function, such as an interactive voice response system or a web page interface, to provide some of the advanced functionality. A conference may have privilege levels associated with it or with individual participants, with privileges for the initiating participant and for regular participants, and the initiating participant may delegate privileges to others.

The advanced conference features listed are examples rather than a requirement list. A participant may add a new participant, for example by asking the system to call them, and may delete participants he can identify. During the conference a participant may switch between user agents with different capabilities while remaining in the conference, for example from a mobile phone to a desktop phone, or join by phone, discover that video streams are available, and switch to a video phone. A participant may also select different media streams from the ones he had when he joined, asking to receive an interactive text stream when he cannot follow the conversation.

A participant can authenticate another participant who wants to join, for example in a video conference by creating a sidebar between the two so the authenticating participant can talk to the newcomer and verify his identity, and can authorise participants by assigning a password to the conference or to each participant, or by approving each one directly. An authorised participant may control the presentation of media, choosing whose media is sent to each participant and muting a stream. Privileges can be given to another participant, implicitly when requested or explicitly by asking.

Side conferences, or sidebars, let a participant create a side conference with some of the main conference participants, and the participants return to the main conference when it is finished. A basic sidebar needs two participants to be able to hold two calls at once, with a point-to-point call in parallel to the main conference, and it is up to the user agent implementation whether the two streams are mixed automatically or the participants switch manually. A conferencing-system-based sidebar uses the system to create the sidebar and compose the stream mixes, which may include the main conference as an incoming stream. Mechanisms to signal the creation of the sidebar, invite participants and control the mixes should be available. Participants in an audio sidebar may not be heard by the rest of the conference, and the main conference audio may be mixed in at a lower volume or on a different channel. A sidebar may also carry a different media type from the main conference, so a video call may have an audio sidebar that the others can see but not hear, or an audio or video conference may have a text sidebar.

Further features include conference information, with participants announced when they join and optionally when they leave, and the ability to query the system for the current participants and the media streams available. A conference may have a time limit, with the system telling participants when it is approaching and allowing an extension. A participant may add or remove a media type, for example starting a data presentation during the conference. Some participants may join as audio-only, sending and receiving only part of the streams available. Some may be passive participants, listeners to all or part of the media but invisible to everyone else. A recorder can be added, recording all streams or a subset, and recorders may be turned on and off during the conference; a recorder is a case of a passive participant. A whisper is a one-way message to another participant, rendered immediately, which differs from a sidebar in that it creates no long-lived session. A participant may also ask for assistance from a human operator during the conference.

The advanced cases need clients that understand what the conference server is telling them, so that a call can be turned into a conference without hanging up, a newcomer can be checked before being let in, and a participant can start a private conversation with part of the group while the rest of the meeting carries on.

THE ADVANCED CONFERENCE FEATURES
  • Add or delete participantsA participant may add a new one, for example by asking the system to call them, and may delete participants he can identify.
  • Change device or mediaA participant may switch between user agents with different capabilities, for example from a mobile phone to a desktop phone, and may ask for an extra media stream such as interactive text.
  • Authenticate and authoriseA participant can authenticate a newcomer by creating a sidebar with them, and authorise them by assigning a password or approving them directly.
  • Control the media mixAn authorised participant may choose whose media everyone receives, mute a stream, and adjust the gain of an audio stream.
  • SidebarsA side conference may include some of the main conference, may carry a different media type, and may mix the main audio in at a lower volume or on a different channel.
  • Whispers and passive participantsA whisper is a one-way message rendered immediately with no long-lived session. A passive participant listens without appearing in the roster.

§4Media Control Scenarios in Detail

During a conference, media streams may be controlled by authorised participants using either a media control protocol or a third-party application. The conference can be of any size, and larger conferences tend to be more centrally managed or structured. The mixing of media may start when the conference starts or when the initiating participant joins, in which case early participants may be put on hold and get music on hold.

For video, the participant selects one of a set of predefined presentations offered by the server, each identified by a textual description and an image showing how it appears on screen. Choosing a presentation chooses how many video streams are viewed at once and the layout on the screen. The contents of each sub-window can be defined by conference policy or controlled by authorised participants, and there may be multiple mixes per conference, possibly as many as there are participants. The typical presentations are: single view, typically showing the video of the loudest speaker; dual view, showing two streams, multiplexed either as side-by-side windows or one above the other, with or without altered aspect ratios; quadrate view, showing four streams in a 2x2 arrangement with the aspect ratios maintained; the 9 sub-picture view, showing nine streams in a 3x3 arrangement with cropping at the discretion of the mixer; the 16 sub-picture view, showing sixteen streams in a 4x4 arrangement with the aspect ratios maintained and no cropping or blanking needed; and the 5+1 sub-picture view, showing six streams with one sub-window occupying 4/9 of the screen and each of the other five occupying 1/9.

The typical video conferencing scenario is known as voice-activated video switch. Every participant hears the N loudest participants but does not hear himself, and all participants see the loudest speaker, who may see the previous loudest speaker. This mode is typical for a small conference. A participant with the right authorisation can exclude one or more participants from the audio or video mix, and an indication that they are not being seen or heard might be displayed to the affected participants, and can manipulate the gain level associated with one or more audio streams in the mix.

In the conference sidebar scenario an authorised participant creates a sidebar and selects whether it should include the media from the main conference, and the audio gain level of the main conference audio. The participant invites others, and on acceptance they start receiving the sidebar media as the creator specified. A participant who is only in the sidebar receives the sidebar media without the main conference media. A participant with the right authorisation can move another participant into the sidebar with no indication, so that participant suddenly starts receiving the sidebar media, and sidebar participants with the right authorisation can select whether to hear the main conference audio mixed with the sidebar audio. A participant can be in more than one sidebar but can only actively participate in one, and can move between the main conference and the sidebars.

The coaching scenario is a call centre or a remote training session where a supervisor monitors the conference. The supervisor is a hidden participant and is not part of the participant roster. The supervised participants might get an announcement or tone indicating that the supervisor has joined, and the other participants do not hear it. The supervisor listens to or sees the session but can only be heard or seen by the supervised participant, until becoming a normal participant, at which point the participants see the supervisor in the roster.

In the presentation and question and answer session, the conference is created as a panel and the panel participants are identified, and only their streams are mixed. After the presentation the session chair changes the conference type to normal, and streams from all participants may then be mixed. Alternatively a floor control protocol can be used, and the chair can grant the right to speak by adding the participant whose turn it is to the conference mix.

A presence-enabled ad hoc conference, sometimes described as a walkie-talkie service, is one in which a participant sends media after receiving confirmation of the other participants' availability. The participant presses a talk button, which checks the presence of the participants; if they are available a confirmation tone is played and the participant can then talk, so the media is sent to the others. These conferences tend to be long lived, hence the need for presence, and the ad hoc nature means the participant list can change at any time. Floor control can be used because the conference is usually half-duplex.

Group chat is a common text scenario in which a participant joins a chat room where the text messages are rendered in a single window and attributed to the participant who sent them. Changes in membership are often announced in the window itself, and nicknames or aliases are often chosen by participants or assigned by the system and used as handles within the room. A real-time transcription or closed captioning service can provide a similar window by converting audio into interactive text.

Interactive text uses RTP to carry text one character at a time, providing real-time interactivity, as described in RFC 4103. The session may be the main conference itself or used alongside other media types, and may represent the audio in the conference using translation services, with more than one stream where each is in a different language, used as subtitles to the audio. The translation from text to speech and back is done by transcoders, with functionality similar to transcoders between different audio or video algorithms. Participants should be able to select whether to receive text streams with the conference audio or without it.

In a moderated group chat all messages sent to the group are filtered or approved by a moderator, who may be a human or an application, and who can also remove participants and give feedback on their submissions, such as warnings before removal. Interactive text or instant messaging sidebars are perhaps the most common sidebars in conferences today, and are often separate from the conference, though making them a sidebar and part of the main conference has advantages: a conference that provides anonymity or aliases can also provide anonymous sidebars, and a text sidebar can benefit from the security, logging and recording services provided by the conferencing system. A text sidebar can also be a text-only conversation between participants who are following the main conference at the same time. Finally, the conference moderator may play announcements to all participants, prerecorded or composed before being sent, in text, audio or audio-visual form, such as a message asking everyone to come back to the main meeting from several break-out sessions.

This section is about who sees and hears what. The server offers a set of standard screen layouts for video, and lets an authorised participant decide which streams go into the mix. It also covers the situations where somebody joins only part of a meeting: a hidden supervisor, a private sidebar, a moderated text chat room.

THE STANDARD VIDEO LAYOUTS
LayoutStreamsArrangement
Single view1Shows the video of the loudest speaker
Dual view2Side by side, or one above the other
Quadrate view42x2, with the aspect ratios maintained
9 sub-picture view93x3, with cropping at the discretion of the mixer
16 sub-picture view164x4, with no cropping or blanking needed
5+1 sub-picture view6One sub-window at 4/9 of the screen, the other five at 1/9 each

§5Conference Policy, Confidentiality and Privacy

Conferences generally have authorisation rules about who may or may not join, and what type of media may or may not be used. This information, sometimes called the conference policy or common conference information, is used by the conferencing system to admit or deny participation. For the policy to be implemented, the system has to be able to authenticate potential participants. The methods used depend on the signalling protocols the conference uses, and can include a challenge and response mechanism, certificates, a shared secret, or an asserted identity.

Conferences often require their content to be confidential. Secure authorisation of participants is incomplete if access to the media can be gained by unauthorised participants, so functions for securing the media, and for key management and distribution to authorised participants, need to be provided by the conferencing system. In some cases the functions used for participant authorisation can be used for this purpose as well.

Privacy is an important aspect of conferencing. Users may wish to join a conference without anyone knowing that they have joined, in order to listen in silently. In other applications a participant may wish to hide their identity from other participants but otherwise let them know of their presence. These functions need to be provided by the conferencing system. The conference-specific security requirements are discussed further in the XCON framework document.

The server decides who gets in, using the conference's own rules, and it has to check identities properly. It also has to protect the media itself, and it has to let a participant join quietly or hide who they are when the conference wants that.

§6References