RFC 3749 PROPOSED STANDARD TLS · COMPRESSION · SECURITY

TLS compression: Transport Layer Security Protocol Compression Methods

Adds a standardized DEFLATE compression method to TLS and defines identifier-allocation rules.

On rfc-editor.org ↗
PUBLISHED
May 2004
AUTHORS
S. Hollenbeck
STREAM
IETF
UPDATED BY
RFC 8447 — IANA Registry Updates for TLS and DTLS, RFC 8996 — Deprecate TLS 1.0/1.1
DEFLATE IDENTIFIER
1
STANDARDS TRACK RANGE
0-63
NON-STANDARDS TRACK RANGE
64-223
PRIVATE-USE RANGE
224-255
MAXIMUM CONTENT-LENGTH INCREASE
1,024 bytes
MAXIMUM TOTAL CONTENT LENGTH
2^14 bytes
DOI
10.17487/RFC3749

RFC text

Contents
Original text · RFC Editor View on rfc-editor.org ↗
Network Working Group                                      S. Hollenbeck
Request for Comments: 3749                                VeriSign, Inc.
Category: Standards Track                                       May 2004



         Transport Layer Security Protocol Compression Methods

Status of this Memo

   This document specifies an Internet standards track protocol for the
   Internet community, and requests discussion and suggestions for
   improvements.  Please refer to the current edition of the "Internet
   Official Protocol Standards" (STD 1) for the standardization state
   and status of this protocol.  Distribution of this memo is unlimited.

Copyright Notice

   Copyright (C) The Internet Society (2004).  All Rights Reserved.

Abstract

   The Transport Layer Security (TLS) protocol (RFC 2246) includes
   features to negotiate selection of a lossless data compression method
   as part of the TLS Handshake Protocol and to then apply the algorithm
   associated with the selected method as part of the TLS Record
   Protocol.  TLS defines one standard compression method which
   specifies that data exchanged via the record protocol will not be
   compressed.  This document describes an additional compression method
   associated with a lossless data compression algorithm for use with
   TLS, and it describes a method for the specification of additional
   TLS compression methods.

Table of Contents

   1.  Introduction . . . . . . . . . . . . . . . . . . . . . . . . .  2
   2.  Compression Methods  . . . . . . . . . . . . . . . . . . . . .  2
       2.1.  DEFLATE Compression. . . . . . . . . . . . . . . . . . .  3
   3.  Compression History and Packet Processing  . . . . . . . . . .  4
   4.  Internationalization Considerations  . . . . . . . . . . . . .  4
   5.  IANA Considerations  . . . . . . . . . . . . . . . . . . . . .  4
   6.  Security Considerations  . . . . . . . . . . . . . . . . . . .  5
   7.  Acknowledgements . . . . . . . . . . . . . . . . . . . . . . .  6
   8.  References . . . . . . . . . . . . . . . . . . . . . . . . . .  6
       8.1.  Normative References . . . . . . . . . . . . . . . . . .  6
       8.2.  Informative References . . . . . . . . . . . . . . . . .  6
       Author's Address . . . . . . . . . . . . . . . . . . . . . . .  7
       Full Copyright Statement . . . . . . . . . . . . . . . . . . .  8

1.  Introduction

   The Transport Layer Security (TLS) protocol (RFC 2246, [2]) includes
   features to negotiate selection of a lossless data compression method
   as part of the TLS Handshake Protocol and to then apply the algorithm
   associated with the selected method as part of the TLS Record
   Protocol.  TLS defines one standard compression method,
   CompressionMethod.null, which specifies that data exchanged via the
   record protocol will not be compressed.  While this single
   compression method helps ensure that TLS implementations are
   interoperable, the lack of additional standard compression methods
   has limited the ability of implementers to develop interoperable
   implementations that include data compression.

   TLS is used extensively to secure client-server connections on the
   World Wide Web.  While these connections can often be characterized
   as short-lived and exchanging relatively small amounts of data, TLS
   is also being used in environments where connections can be long-
   lived and the amount of data exchanged can extend into thousands or
   millions of octets.  XML [4], for example, is increasingly being used
   as a data representation method on the Internet, and XML tends to be
   verbose.  Compression within TLS is one way to help reduce the
   bandwidth and latency requirements associated with exchanging large
   amounts of data while preserving the security services provided by
   TLS.

   This document describes an additional compression method associated
   with a lossless data compression algorithm for use with TLS.
   Standardization of the compressed data formats and compression
   algorithms associated with this compression method is beyond the
   scope of this document.

   The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
   "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
   document are to be interpreted as described in RFC 2119 [1].

2.  Compression Methods

   TLS [2] includes the following compression method structure in
   sections 6.1 and 7.4.1.2 and Appendix sections A.4.1 and A.6:

   enum { null(0), (255) } CompressionMethod;

   which allows for later specification of up to 256 different
   compression methods.  This definition is updated to segregate the
   range of allowable values into three zones:

   1. Values from 0 (zero) through 63 decimal (0x3F) inclusive are
      reserved for IETF Standards Track protocols.

   2. Values from 64 decimal (0x40) through 223 decimal (0xDF) inclusive
      are reserved for assignment for non-Standards Track methods.

   3. Values from 224 decimal (0xE0) through 255 decimal (0xFF)
      inclusive are reserved for private use.

   Additional information describing the role of the IANA in the
   allocation of compression method identifiers is described in Section
   5.

   In addition, this definition is updated to include assignment of an
   identifier for the DEFLATE compression method:

   enum { null(0), DEFLATE(1), (255) } CompressionMethod;

   As described in section 6 of RFC 2246 [2], TLS is a stateful
   protocol.  Compression methods used with TLS can be either stateful
   (the compressor maintains its state through all compressed records)
   or stateless (the compressor compresses each record independently),
   but there seems to be little known benefit in using a stateless
   compression method within TLS.

   The DEFLATE compression method described in this document is
   stateful.  It is RECOMMENDED that other compression methods that
   might be standardized in the future be stateful as well.

   Compression algorithms can occasionally expand, rather than compress,
   input data.  A compression method that exceeds the expansion limits
   described in section 6.2.2 of RFC 2246 [2] MUST NOT be used with TLS.

2.1.  DEFLATE Compression

   The DEFLATE compression method and encoding format is described in
   RFC 1951 [5].  Examples of DEFLATE use in IETF protocols can be found
   in RFC 1979 [6], RFC 2394 [7], and RFC 3274 [8].

   DEFLATE allows the sending compressor to select from among several
   options to provide varying compression ratios, processing speeds, and
   memory requirements.  The receiving decompressor MUST automatically
   adjust to the parameters selected by the sender.  All data that was
   submitted for compression MUST be included in the compressed output,
   with no data retained to be included in a later output payload.
   Flushing ensures that each compressed packet payload can be
   decompressed completely.

3.  Compression History and Packet Processing

   Some compression methods have the ability to maintain state/history
   information when compressing and decompressing packet payloads.  The
   compression history allows a higher compression ratio to be achieved
   on a stream as compared to per-packet compression, but maintaining a
   history across packets implies that a packet might contain data
   needed to completely decompress data contained in a different packet.
   History maintenance thus requires both a reliable link and sequenced
   packet delivery.  Since TLS and lower-layer protocols provide
   reliable, sequenced packet delivery, compression history information
   MAY be maintained and exploited if supported by the compression
   method.

   As described in section 7 of RFC 2246 [2], TLS allows multiple
   connections to be instantiated using the same session through the
   resumption feature of the TLS Handshake Protocol.  Session resumption
   has operational implications when multiple compression methods are
   available for use within the session.  For example, load balancers
   will need to maintain additional state information if the compression
   state is not cleared when a session is resumed.  As a result, the
   following restrictions MUST be observed when resuming a session:

   1.  The compression algorithm MUST be retained when resuming a
       session.

   2.  The compression state/history MUST be cleared when resuming a
       session.

4.  Internationalization Considerations

   The compression method identifiers specified in this document are
   machine-readable numbers.  As such, issues of human
   internationalization and localization are not introduced.

5.  IANA Considerations

   Section 2 of this document describes a registry of compression method
   identifiers to be maintained by the IANA, including assignment of an
   identifier for the DEFLATE compression method.  Identifier values
   from the range 0-63 (decimal) inclusive are assigned via RFC 2434
   Standards Action [3].  Values from the range 64-223 (decimal)
   inclusive are assigned via RFC 2434 Specification Required [3].
   Identifier values from 224-255 (decimal) inclusive are reserved for
   RFC 2434 Private Use [3].

6.  Security Considerations

   This document does not introduce any topics that alter the threat
   model addressed by TLS.  The security considerations described
   throughout RFC 2246 [2] apply here as well.

   However, combining compression with encryption can sometimes reveal
   information that would not have been revealed without compression:
   data that is the same length before compression might be a different
   length after compression, so adversaries that observe the length of
   the compressed data might be able to derive information about the
   corresponding uncompressed data.  Some symmetric encryption
   ciphersuites do not hide the length of symmetrically encrypted data
   at all.  Others hide it to some extent, but still do not hide it
   fully.  For example, ciphersuites that use stream cipher encryption
   without padding do not hide length at all; ciphersuites that use
   Cipher Block Chaining (CBC) encryption with padding provide some
   length hiding, depending on how the amount of padding is chosen.  Use
   of TLS compression SHOULD take into account that the length of
   compressed data may leak more information than the length of the
   original uncompressed data.

   Compression algorithms tend to be mathematically complex and prone to
   implementation errors.  An implementation error that can produce a
   buffer overrun introduces a potential security risk for programming
   languages and operating systems that do not provide buffer overrun
   protections.  Careful consideration should thus be given to
   protections against implementation errors that introduce security
   risks.

   As described in Section 2, compression algorithms can occasionally
   expand, rather than compress, input data.  This feature introduces
   the ability to construct rogue data that expands to some enormous
   size when compressed or decompressed.  RFC 2246 describes several
   methods to ameliorate this kind of attack.  First, compression has to
   be lossless.  Second, a limit (1,024 bytes) is placed on the amount
   of allowable compression content length increase.  Finally, a limit
   (2^14 bytes) is placed on the total content length.  See section
   6.2.2 of RFC 2246 [2] for complete details.

7.  Acknowledgements

   The concepts described in this document were originally discussed on
   the IETF TLS working group mailing list in December, 2000.  The
   author acknowledges the contributions to that discussion provided by
   Jeffrey Altman, Eric Rescorla, and Marc Van Heyningen.  Later
   suggestions that have been incorporated into this document were
   provided by Tim Dierks, Pasi Eronen, Peter Gutmann, Elgin Lee, Nikos
   Mavroyanopoulos, Alexey Melnikov, Bodo Moeller, Win Treese, and the
   IESG.

8.  References

8.1.  Normative References

   [1]  Bradner, S., "Key words for use in RFCs to Indicate Requirement
        Levels", BCP 14, RFC 2119, March 1997.

   [2]  Dierks, T. and C. Allen, "The TLS Protocol Version 1.0", RFC
        2246, January 1999.

   [3]  Narten, T. and H. Alvestrand, "Guidelines for Writing an IANA
        Considerations Section in RFCs", BCP 26, RFC 2434, October 1998.

8.2.  Informative References

   [4]  Bray, T., Paoli, J., Sperberg-McQueen, C. and E. Maler,
        "Extensible Markup Language (XML) 1.0 (2nd ed)", W3C REC-xml,
        October 2000, <http://www.w3.org/TR/REC-xml>.

   [5]  Deutsch, P., "DEFLATE Compressed Data Format Specification
        version 1.3", RFC 1951, May 1996.

   [6]  Woods, J., "PPP Deflate Protocol", RFC 1979, August 1996.

   [7]  Pereira, R., "IP Payload Compression Using DEFLATE", RFC 2394,
        December 1998.

   [8]  Gutmann, P., "Compressed Data Content Type for Cryptographic
        Message Syntax (CMS)", RFC 3274, June 2002.

Author's Address

   Scott Hollenbeck
   VeriSign, Inc.
   21345 Ridgetop Circle
   Dulles, VA  20166-6503
   US

   EMail: shollenbeck@verisign.com

Full Copyright Statement

   Copyright (C) The Internet Society (2004).  This document is subject
   to the rights, licenses and restrictions contained in BCP 78, and
   except as set forth therein, the authors retain all their rights.

   This document and the information contained herein are provided on an
   "AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS
   OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY AND THE INTERNET
   ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED,
   INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE
   INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED
   WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.

Intellectual Property

   The IETF takes no position regarding the validity or scope of any
   Intellectual Property Rights or other rights that might be claimed to
   pertain to the implementation or use of the technology described in
   this document or the extent to which any license under such rights
   might or might not be available; nor does it represent that it has
   made any independent effort to identify any such rights.  Information
   on the procedures with respect to rights in RFC documents can be
   found in BCP 78 and BCP 79.

   Copies of IPR disclosures made to the IETF Secretariat and any
   assurances of licenses to be made available, or the result of an
   attempt made to obtain a general license or permission for the use of
   such proprietary rights by implementers or users of this
   specification can be obtained from the IETF on-line IPR repository at
   http://www.ietf.org/ipr.

   The IETF invites any interested party to bring to its attention any
   copyrights, patents or patent applications, or other proprietary
   rights that may cover technology that may be required to implement
   this standard.  Please address the information to the IETF at ietf-
   ipr@ietf.org.

Acknowledgement

   Funding for the RFC Editor function is currently provided by the
   Internet Society.

ISO Plain Language

On this page
PROBLEMTLS could negotiate compression, but its only standardized method meant no compression. Implementations lacked a shared compression method they could use interoperably.
MECHANISMRFC 3749 assigns identifier 1 to stateful DEFLATE and divides the one-byte compression-method space into standards, specification-required and private-use ranges. It also defines behavior for compression history and session resumption.
STATUS TODAYTLS gained a standardized compression method, with cautions about data-length leakage and expansion. RFC 3749 has been updated by RFC 8447 and RFC 8996.

§1Why TLS Compression Needed a Standard

TLS can negotiate a lossless compression method during its handshake and apply that method in the record protocol. Before RFC 3749, TLS standardized only CompressionMethod.null, which sends record data without compression.

Compression can reduce bandwidth and latency when a connection carries large amounts of data. RFC 3749 defines an additional method for TLS; specifying the compressed data format and algorithm themselves is outside its scope.

TLS already had a place to negotiate compression but no shared method beyond no compression. This RFC defines one method so implementations can use the same choice.

§2Compression Method Identifiers

The TLS CompressionMethod field is one byte and can identify up to 256 methods. RFC 3749 reserves values 0-63 for IETF Standards Track protocols, 64-223 for non-Standards Track methods and 224-255 for private use.

The existing null method keeps identifier 0. This RFC assigns identifier 1 to DEFLATE. IANA assigns identifiers from each range using its corresponding policy.

TLS identifies each compression method with a number. The RFC assigns a number to DEFLATE and reserves different number ranges for formal standards, other methods and private use.

THE TLS COMPRESSION METHOD IDENTIFIER RANGES
Identifier rangeUseAssignment policy
0-63IETF Standards TrackStandards Action
64-223Non-Standards Track methodsSpecification Required
224-255Private usePrivate Use

§2.1Stateful DEFLATE Compression

The DEFLATE compression method is described in RFC 1951. It is stateful: the compressor can maintain state across compressed records. RFC 3749 recommends that future standardized compression methods for TLS also be stateful.

DEFLATE lets the sender choose among settings with different compression ratios, processing speeds and memory needs. The receiver must adjust to the sender's selected settings. All submitted data must appear in compressed output; flushing ensures each packet payload can be decompressed completely.

A compression method that exceeds the expansion limits in the TLS specification must not be used with TLS.

DEFLATE can retain compression state across records. The receiver follows the sender's settings, and each output payload must contain enough data to be decompressed completely.

§3History and Session Resumption

Compression history across packets can improve the compression ratio, but a packet may then contain information needed to decompress another packet. History therefore requires reliable delivery in sequence. TLS and its lower layers provide those properties, so a compression method may use history when it supports it.

TLS session resumption creates another connection using an existing session. On resumption, the compression algorithm must remain the same, but the compression state and history must be cleared. This avoids requiring other systems, such as load balancers, to preserve the old compression state.

A compression method may use earlier records to improve compression. When a TLS session resumes, it keeps the same method but clears the old compression history.

§5IANA Assignment Policies

IANA maintains the TLS compression-method identifier registry. Values from 0-63 are assigned through Standards Action. Values from 64-223 use Specification Required, and values from 224-255 are for Private Use.

The registry includes DEFLATE's identifier and provides a defined path for later methods to receive identifiers without conflicting with the existing assignments.

IANA manages the list of TLS compression identifiers. The assignment process depends on which reserved range a method uses.

§6Length Leakage and Expansion Risks

Compression combined with encryption can reveal information through length. Two inputs with the same original length may produce compressed data of different lengths, and an observer may infer information from those differences. Some TLS cipher suites conceal length less than others, so the RFC says to consider this risk when using compression.

Compression implementations are complex and can contain errors such as buffer overruns. Compressed input can also expand greatly when processed. The TLS rules require lossless compression, limit content-length increase to 1,024 bytes and limit total content length to 2^14 bytes.

Encrypted data length can still reveal information after compression. Implementations must also enforce the TLS expansion limits so compressed input cannot grow without bound.

§7References