view Side-By-Side changes
Congestion and Pre-Congestion Philip. Eardley (Editor) Notification Working Group BT Internet-DraftAugust 8,October 26, 2007 Intended status: Informational Expires:February 9,April 28, 2008 Pre-Congestion Notification Architecturedraft-ietf-pcn-architecture-00draft-ietf-pcn-architecture-01 Status of this Memo By submitting this Internet-Draft, each author represents that any applicable patent or other IPR claims of which he or she is aware have been or will be disclosed, and any of which he or she becomes aware will be disclosed, in accordance with Section 6 of BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF), its areas, and its working groups. Note that other groups may also distribute working documents as Internet- Drafts. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." The list of current Internet-Drafts can be accessed at http://www.ietf.org/ietf/1id-abstracts.txt. The list of Internet-Draft Shadow Directories can be accessed at http://www.ietf.org/shadow.html. This Internet-Draft will expire onFebruary 9,April 28, 2008. Copyright Notice Copyright (C) The IETF Trust (2007). Abstract The purpose of this document is to describe a general architecture for flow admission and termination based on aggregated pre-congestion information in order to protect the quality of service of established inelastic flows within a single DiffServ domain. Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page 1] Internet-Draft DocumentAugustOctober 2007 Status Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 3 2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 6 3. Assumptions and constraints on scope . . . . . . . . . . . . .78 3.1. Assumption 1: Trust - controlled environment . . . . . . .89 3.2. Assumption 2: Real-time applications . . . . . . . . . . . 9 3.3. Assumption 3: Many flows and additional load . . . . . . . 9 3.4. Assumption 4: Emergency use out of scope . . . . . . . . .910 3.5. Other assumptions . . . . . . . . . . . . . . . . . . . . 10 4. High-level functional architecture . . . . . . . . . . . . . . 10 5. Detailed Functional architecture . . . . . . . . . . . . . . . 14 5.1. PCN-interior-node functions . . . . . . . . . . . . . . .1415 5.2. PCN-ingress-node functions . . . . . . . . . . . . . . . .1516 5.3. PCN-egress-node functions . . . . . . . . . . . . . . . . 16 5.4. Admission control functions . . . . . . . . . . . . . . .1617 5.5. Probing functions . . . . . . . . . . . . . . . . . . . . 17 5.6. Flow termination functions . . . . . . . . . . . . . . . .1819 5.7. Addressing . . . . . . . . . . . . . . . . . . . . . . . .1920 5.8. Tunnelling . . . . . . . . . . . . . . . . . . . . . . . .1921 5.9. Fault handling . . . . . . . . . . . . . . . . . . . . . .2022 6. Design goals and challenges . . . . . . . . . . . . . . . . .2122 7. Operations and Management . . . . . . . . . . . . . . . . . .2325 7.1. Fault OAM . . . . . . . . . . . . . . . . . . . . . . . .2325 7.2. Configuration OAM . . . . . . . . . . . . . . . . . . . .2326 7.3. Accounting OAM . . . . . . . . . . . . . . . . . . . . . .2527 7.4. Performance OAM . . . . . . . . . . . . . . . . . . . . .2528 7.5. Security OAM . . . . . . . . . . . . . . . . . . . . . . .2628 8. IANA Considerations . . . . . . . . . . . . . . . . . . . . .2628 9. Security considerations . . . . . . . . . . . . . . . . . . .2628 10. Conclusions . . . . . . . . . . . . . . . . . . . . . . . . .2730 11. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . .2730 12. Comments Solicited . . . . . . . . . . . . . . . . . . . . . .2830 13. Changes . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 14. References . . . . . . . . . . . . . . . . . . . . . . . . . .28 13.1.32 14.1. Normative References . . . . . . . . . . . . . . . . . . .28 13.2.32 14.2. Informative References . . . . . . . . . . . . . . . . . .2832 Author's Address . . . . . . . . . . . . . . . . . . . . . . . . .3135 Intellectual Property and Copyright Statements . . . . . . . . . .3236 Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page 2] Internet-Draft DocumentAugustOctober 2007 1. Introduction The purpose of this document is to describe a general architecture for flow admission and termination based on aggregated (pre-) congestion information in order to protect the quality of service of flows within a DiffServdomain,[RFC2475].domain[RFC2475]. This document defines an architecture for implementing two mechanisms to protect the quality of service of established inelastic flows within a single DiffServ domain, where all boundary and interior nodes are PCN-enabled and trust each other for correct PCN operation. Flow admission control determines whether a new flow should be admitted and protects the QoS of existing PCN-flows in normal circumstances, by avoiding congestion occurring. However, in abnormal circumstances, for instance a disaster affecting multiple nodes and causing traffic re-routes, then the QoS on existing PCN-flows may degrade even though care was exercised when admitting those flows before those circumstances. Therefore we also propose a mechanism for flow termination, which removes enough traffic in order to protect the QoS of the remaining PCN-flows. As a fundamental building block to enable these two mechanisms,PCN-interior-nodesPCN- interior-nodes generate, encode and transportpre- congestionpre-congestion information towards the PCN-egress-nodes. Two rates, aPCN-lower-ratePCN-lower- rate and a PCN-upper-rate, can be associated with each link of the PCN-domain. Each rate is used byan algorithma marking behaviour (specified in another document) that determines how and when a number ofPCN-packetsPCN- packets are marked, and how the markings are encoded in packet headers. PCN-egress-nodes make measurements of the packet markings and send information as necessary to the nodes that make the decision about which PCN-flows to accept/reject or terminate, based on this information. Another document will describe the decision-makingalgorithms.behaviours. Overall the aim is to enable PCN-nodes to give an "early warning" of potential congestion before there is any significant build-up of PCN-packets in the queue; the admission control mechanism limits the PCN-traffic on each link to *roughly* its PCN-lower-rate and the flow termination mechanism limits the PCN-traffic on each link to *roughly* its PCN-upper-rate. We believe that the key benefits of the PCN mechanisms described in this document are that they are simple, scalable, and robust because: o Per flow state is only required at the PCN-ingress-nodes ("stateless core"). This is required for policing purposes (to prevent non-admitted PCN traffic from entering the PCN-domain) and so on. It is not generally required that other network entities are aware of individual flows (although they may be in particular deployment scenarios). Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page 3] Internet-Draft DocumentAugustOctober 2007 o Admission control is resilient: PCN's QoSreservations areis decoupled from the routingsystem and sosystem; hence in general admitted flows can survive capacity, routing or topology changes without additionalsignalling.signalling, and they don't have to be told (or learn) about such changes. The PCN-lower-rates can be chosen small enough that admitted traffic can still be carried after a rerouting in most failure cases. This is an important feature as QoS violations in core networks due to link failures are more likely than QoS violations due to increased trafficvolume,volume [Iyer]. o The PCN-markingalgorithmsbehaviours only operate on the overall PCN-traffic on the link, not per flow. o The information of these measurements is signalled to the PCN- egress-nodes by the PCN-marks in the packet headers. No additional signalling protocol is required for transporting the PCN-marks. Therefore no secure binding is required between data packets and separate congestion messages. o The PCN-egress-nodes make separate measurements, operating on the overall PCN-traffic, for each PCN-ingress-node, ie not per flow. Similarly, signalling by the PCN-egress-node of PCN-feedback- information (which is used for flow admission and termination decisions) is at the granularity of the ingress-egress-aggregate. o The admitted PCN-load is controlled dynamically. Therefore it adapts as the traffic matrix changes, and also if the network topology changes (eg after a link failure). Hence an operator can be less conservative when deploying network capacity, and less accurate in their prediction of the PCN-traffic matrix. o The termination mechanism complements admission control. It allows the network to recover from sudden unexpected surges of PCN-traffic on some links, thus restoring QoS to the remaining flows. Such scenarios are expected to be rare but not impossible. They can be caused by large network failures that redirect lots of admitted PCN-traffic to other links, or by malfunction of the measurement-based admission control in the presence of admitted flows that send for a while with an atypically low rate and then increase their rates in a correlated way. o The PCN-upper-rate may be set below the maximum rate that PCN- traffic can be transmitted on a link, in order to trigger termination of some PCN-flows before loss (or excessive delay) of PCN-packetsoccursoccurs, or to keep the maximum PCN-load on a link below a level configured by the operator. Eardley (Editor) Expires April 28, 2008 [Page 4] Internet-Draft Document October 2007 o Provisioning of the network is decoupled from the process of adding new customers. By contrast, with the DiffServ architecture [RFC2475] the operator has to run the provisioning process each time a new customer is added to check that the Service Level Agreement can be fulfilled. Operators of networks will want to use the PCN mechanisms in various arrangements, for instance depending on how they are performingEardley (Editor) Expires February 9, 2008 [Page 4] Internet-Draft Document August 2007admission control outside the PCN-domain (users after all are concerned about QoS end-to-end), what their particular goals and assumptions are, and so on. Several deployment models are possible: o An operator may choose to deploy either admission control or flow termination or both (see Section 7.2). o IntServ over DiffServ [RFC2998]. The DiffServ region is PCN- enabled, RSVP signalling is used end-to-end and the PCN-domain is a single RSVP hop, ie only the PCN-boundary-nodes process RSVP messages. Outside the PCN-domain RSVP messages are processed on each hop. This is described in [I-D.briscoe-tsvwg-cl-architecture] o RSVP signalling is originated and/or terminated by proxies, with application-layer signalling between the end user and the proxy. For instance SIP signalling with a home hub. o Similar to previous bullets but NSIS signalling is used instead of RSVP. o NOTE: Consideration of signalling extensions for specific protocols is outside the scope of the PCN WG, however it will produce a "Requirements for signalling" document as potential input for the appropriate WGs. o Depending on the deployment scenario, the decision-making functionality (about flow admission and termination) could reside at the PCN-ingress-nodes or PCN-egress-nodes or at some central control node in the PCN-domain. NOTE: The Charter restrictsus to considering whenus: the decision-making functionality is at the PCN-boundary-nodes. o If the operator runs both the access network and the core network, one deployment scenario is that only the core network uses PCN admission control but per microflow policing is done at the ingress to the access network and not at the PCN-ingress-node. Note: to aid readability, the rest of this draft assumes that policing is done by the PCN-ingress-nodes. Eardley (Editor) Expires April 28, 2008 [Page 5] Internet-Draft Document October 2007 o There are several PCN-domains on the end-to-end path, each operating PCN mechanisms independently. NOTE: The Charter restricts us to considering a single PCN-domain. A possibility after re-chartering is to consideroperating PCN over concatenatedthat the PCN-domain encompasses several DiffServ domains that don't trust each other (ie weakens Assumption 1 about trust, see Section 3.1) o The PCN-domain extends to the end users. NOTE: This is outside the Charter because it breaks Assumption 3 (aggregation, see later; incidentally it doesn't necessarily break Assumption 1 (trust), because in some environments, eg corporate, the end user may have a controlled configuration and so be trusted). The scenario is described in [I-D.babiarz-pcn-sip-cap]. o Pseudowire: PCN may be used as a congestion avoidance mechanism for edge to edge pseudowire emulationsEardley (Editor) Expires February 9, 2008 [Page 5] Internet-Draft Document August 2007[I-D.ietf-pwe3-congestion-frmwk]. NOTE: Specific consideration of pseudowires is not in the PCN WG Charter. o MPLS: [RFC3270] defines how to support the DiffServ architecture in MPLS networks. [I-D.ietf-tsvwg-ecn-mpls] describes how to add PCN for admission control of microflows into a set ofMPLS-TEMPLS aggregates (Multi-protocol labelswitching traffic engineering).switching). PCN-marking is done in MPLS's EXP field.NOTE: This draft is a TSV WG draft, and is also being reviewed in the MPLS WG.o Similarly, it may be possible to extend PCN into Ethernet networks, where PCN-marking is done in the Ethernet header. NOTE: Specific consideration of this extension is outside thePCN WG Charter.IETF's remit. 2. Terminology o PCN-domain: a PCN-capableDiffServdomain; a contiguous set of PCN-enabled nodes that perform DiffServnodes.scheduling; the compete set of PCN- nodes whose PCN-marking can in principle influence decisions about flow admission and termination for the PCN-domain, including the PCN-egress-nodes which measure these PCN-marks. o PCN-boundary-node: anodePCN-node that connects one PCN-domain to a node either in another PCN-domain or in a non PCN-domain. o PCN-interior-node: a node in a PCN-domain that is not a PCN- boundary-node. o PCN-node: a PCN-boundary-node or a PCN-interior-node Eardley (Editor) Expires April 28, 2008 [Page 6] Internet-Draft Document October 2007 o PCN-egress-node: a PCN-boundary-node in its role in handling traffic as it leaves a PCN-domain. o PCN-ingress-node: a PCN-boundary-node in its role in handling traffic as it enters a PCN-domain. o PCN-traffic: A PCN-domain carries traffic of different DiffServ classes [RFC4594]. Those using the PCN mechanisms are called PCN- classes (collectively called PCN-traffic) and the corresponding packets are PCN-packets. The same network may carry traffic using other DiffServ classes. o Ingress-egress-aggregate: The collection of PCN-packets from all PCN-flows that travel in one direction between a specific pair of PCN-boundary-nodes. o PCN-lower-rate: a reference rate configured for each link in the PCN-domain, which is lower than the PCN-upper-rate. It is used byan algorithma marking behaviour that determines whether a packet should be PCN-markedEardley (Editor) Expires February 9, 2008 [Page 6] Internet-Draft Document August 2007with a first encoding. o PCN-upper-rate: a reference rate configured for each link in the PCN-domain, which is higher than the PCN-lower-rate. It is used byan algorithma marking behaviour that determines whether a packet should bePCN- markedPCN-marked with a second encoding. o Threshold-marking: a PCN-markingalgorithmbehaviour such that all PCN- traffic is marked if the PCN-traffic exceeds a particular rate (either the PCN-lower-rate or PCN-upper-rate). NOTE: The definition reflects the overall intentof the algorithmrather than its instantaneous behaviour, since the rate measured at a particular moment depends on thealgorithm,behaviour, its implementation and the traffic's variance as well as its rate. o Excess-rate-marking: a PCN-markingalgorithmbehaviour such that the amount of PCN-traffic that is PCN-marked is equal to the amount that exceeds a particular rate (either the PCN-lower-rate or PCN-upper- rate). NOTE: The definition reflects the overall intentof the algorithmrather than its instantaneous behaviour, since the rate measured at a particular moment depends on thealgorithm,behaviour, its implementation and the traffic's variance as well as its rate. o Pre-congestion: a condition of a link within a PCN-domain in which the PCN-node performs PCN-marking, in order to provide an "early warning" of potential congestion before there is any significant build-up of PCN-packets in the real queue. Eardley (Editor) Expires April 28, 2008 [Page 7] Internet-Draft Document October 2007 o PCN-marking: the process of setting the header in a PCN-packet based on defined rules, in reaction to pre-congestion. o {{if necessary: PCN-lower-rate-marking and PCN-upper-rate- marking}} o PCN-feedback-information: information signalled by a PCN-egress- node to a PCN-ingress-node or central control node, which is needed for the flow admission and flow termination mechanisms. 3. Assumptions and constraints on scope The PCN WG's charter restricts the initial scope by a set of assumptions. Here we list those assumptions and explain them. 1. these components are deployed in a single DiffServ domain, within which all PCN-nodes are PCN-enabled and trust each other for truthful PCN-marking and transportEardley (Editor) Expires February 9, 2008 [Page 7] Internet-Draft Document August 20072. all flows handled by these mechanisms are inelastic and constrained to a known peak rate through policing or shaping 3. the number of PCN-flows across any potential bottleneck link is sufficiently large that stateless, statistical mechanisms can be effective. To put it another way, the aggregate bit rate of PCN- traffic across any potential bottleneck link needs to be sufficiently large relative to the maximum additional bit rate added by one flow 4. PCN-flows may have different precedence, but the applicability of the PCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc.) is out of scope After completion of the initial phase, the PCN WG may re-charter to develop solutions for specific scenarios where some of these restrictions are not in place. It may also re-charter to consider applying the PCN mechanisms to additional deploymentscenarios (operation over concatenatedscenarios. One possible example is where a single PCN-domain encompasses several DiffServdomains, PCN-aware application mechanisms etc.).domains that don't trust each other (perhaps by using a mechanism like re-ECN,[I-D.briscoe-re-pcn-border-cheat]). The WG may also re-charter to investigate additional response mechanisms that act on (pre-)congestion information. One example could be flow-rate adaptation by elastic applications (rather than flow admission or termination).Another example of a possible future work item is the operation of PCN over concatenated PCN-domains that don't trust each other (perhaps re- ECN,[I-D.briscoe-re-pcn-border-cheat]).The details of these work items are outside the scope of the initial phase, but the WG may consider their requirements in order to design components that are sufficiently general to support such extensions in the future. The working assumption is that the Eardley (Editor) Expires April 28, 2008 [Page 8] Internet-Draft Document October 2007 standards developed in the initial phase should not need to be modified to satisfy the solutions for when these restrictions are removed. 3.1. Assumption 1: Trust - controlled environment We assume that the PCN-domain is a controlled environment, i.e. all the nodes in a PCN-domain run PCN and trust each other. There are several reasons for proposing this assumption: o The PCN-domain has to be encircled by a ring of PCN-boundary- nodes, otherwise PCN-packets could enter the PCN-domain without being subject to admission control, which would potentially destroy the QoS of existing flows. o Similarly, a PCN-boundary-node has to trust that all the PCN-nodes are doing PCN-marking. A non PCN-node wouldn't be able to alert that it is suffering pre-congestion, which potentially would lead to too many PCN-flows being admitted (or too few beingEardley (Editor) Expires February 9, 2008 [Page 8] Internet-Draft Document August 2007terminated). Worse, a rogue node could perform various attacks, as discussed in the Security Considerations section. One way of assuring the above two points is that the entire PCN- domain is run by a single operator. Another possibility is that there are several operators but they trust each other to a sufficient level, in their handling of PCN-traffic. 3.2. Assumption 2: Real-time applications We assume that any variation of source bit rate is independent of the level of pre-congestion. We assume that PCN-packets come from real time applications generating inelastic traffic [Shenker] like voice and video requiring low delay, jitter and packet loss, for example the Controlled Load Service, [RFC2211], and the Telephony service class, [RFC4594]. This assumption is to help focus the effort where it looks like PCN would be most useful, ie the sorts of applications where per flow QoS is a known requirement. For instance, the impact of this assumption would be to guide simulations work. 3.3. Assumption 3: Many flows and additional load We assume that there are many flows on any bottleneck link in the PCN-domain (or, to put it another way, the aggregate bit rate of PCN- traffic across any potential bottleneck link is sufficiently large relative to the maximum additional bit rate added by one flow). Measurement-based admission control assumes that the present is a reasonable prediction of the future: the network conditions are measured at the time of a new flow request, however the actual Eardley (Editor) Expires April 28, 2008 [Page 9] Internet-Draft Document October 2007 network performance must be OK during the call some time later. One issue is that if there are only a few variable rate flows, then the aggregate traffic level may vary a lot, perhaps enough to cause some packets to get dropped. If there are many flows then the aggregate traffic level should be statistically smoothed. How many flows is enough depends on a number of things such as the variation in each flow's rate, the total rate of PCN-traffic, and the size of the "safety margin" between the traffic level at which we start admission-marking and at which packets aredropped.dropped or significantly delayed. We do not make explicit assumptions on how many PCN-flows are in each ingress-egress-aggregate. Performance evaluation work may clarify whether it is necessary to make any additional assumption on aggregation at the ingress-egress-aggregate level. 3.4. Assumption 4: Emergency use out of scope PCN-flows may have different precedence, but the applicability of the PCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc) is out ofscope. Eardley (Editor) Expires February 9, 2008 [Page 9] Internet-Draft Document August 2007scope for consideration by the PCN WG. 3.5. Other assumptionsItAs a consequence of Assumption 2 above, it is assumed thatPCN-markingPCN- marking is being applied to traffic scheduled with the expedited forwarding per-hop behaviour,[RFC3246]. It is assumed that PCN-nodes do not perform ECN,[RFC3246], or traffic with similar characteristics. The following two assumptions apply if the PCN WG decides to encode PCN-marking in the ECN-field. o It is assumed that PCN-nodes do not perform ECN, [RFC3168], onPCN- packets.PCN-packets. o If a packet that is part of a PCN-flow arrives at aPCN-ingress-nodePCN-ingress- node with its CE (Congestion experienced) codepoint set, then we assume that the PCN-ingress-node drops the packet. After its initial Charter is complete, the WG may decide to work on a mechanism (such as through a signalling extension) that enables ECN-marking to be carried transparently across the PCN-domain. 4. High-level functional architecture The high-level approach is to split functionality between: Eardley (Editor) Expires April 28, 2008 [Page 10] Internet-Draft Document October 2007 o PCN-interior-nodes 'inside' the PCN-domain, which monitor their own state of pre-congestion on each outgoing interface and mark PCN-packets if appropriate. They are not flow-aware, nor aware of ingress-egress-aggregates. The functionality is also done by PCN- ingress-nodes for their outgoing interfaces (ie those 'inside' the PCN-domain). o PCN-boundary-nodes at the edge of the PCN-domain, which control admission of new PCN-flows and termination of existing PCN-flows, based on information fromPCN-interior-node.PCN-interior-nodes. This information is in the form of the PCN-marked data packets (which are intercepted by the PCN-egress-nodes) and not signalling messages.PCN- ingress-nodesGenerally PCN-ingress-nodes are flow-aware(required for policing purposes). Inand in several deployment scenarios PCN-egress-nodes will also be flow aware.(Normally this adds no complexity since a PCN-boundary- node acts as both a PCN-ingress-node and as a PCN-egress-node.)The aim of this split is to keep the bulk of the network simple, scalable and robust, whilst confining policy, application-level and security interactions to the edge of the PCN-domain. For example the lack of flow awareness means that the PCN-interior-nodes don't care about the flow information associated with the PCN-packets that they carry, nor do the PCN-boundary-nodes care about which PCN-interior- nodes its flows traverse. Flow admission: At a high level, flow admission control works as follows. In order to generate information about the current state of the PCN-domain, each PCN-node PCN-marks packets if it is "pre-congested". Exactly how a PCN-node decides if it is "pre-congested" (the algorithm) andEardley (Editor) Expires February 9, 2008 [Page 10] Internet-Draft Document August 2007exactly how packets are "PCN-marked" (the encoding) will be defined in a separate standards-track document, but at a high level it is expected to be as follows: o the algorithm: a PCN-node meters the amount of PCN-traffic on each one of its outgoing links. The measurement is made as an aggregate of all PCN-packets, and not per flow. The algorithm has a configured parameter, PCN-lower-rate. As the amount of PCN- traffic exceeds the PCN-lower-rate, then PCN-packets are PCN- marked. See NOTE below for more explanation. o the encoding: a PCN-node PCN-marks a PCN-packet (with a first encoding) by setting fields in the header to specific values. It is expected that the ECN and/or DSCP fields will be used. NOTE: Two main categories of algorithm have been proposed: if the algorithm uses threshold-marking then all PCN-packets are marked if the current rate exceeds the PCN-lower-rate, whereas if the algorithm uses excess-rate-marking the amount marked is equal to the amount in Eardley (Editor) Expires April 28, 2008 [Page 11] Internet-Draft Document October 2007 excess of the PCN-lower-rate. However, note that this description reflects the overall intent of the algorithm rather than its instantaneous behaviour, since the rate measured at a particular moment depends on the detailed algorithm, its implementation (eg virtual queue, token bucket...) and the traffic's variance as well as its rate (eg marking may well continue after a recent overload even after the instantaneous rate has dropped). The PCN-boundary-nodes monitor the PCN-marked packets in order to extract information about the current state of the PCN-domain. Based on this monitoring, a decision is made about whether to admit a prospective new flow. Exactly how the admission control decision is made will be definedinseparately (at the moment the intention is that there will be one or more informational-track RFCs), but at a high level it is expected to be as follows: o the PCN-egress-node measures (possibly as a moving average) the fraction of the PCN-traffic that is PCN-marked. The fraction is measured for a specific ingress-egress-aggregate. If the fraction is below a threshold value then the new flow is admitted. Note that the PCN-lower-rate is a parameter that can be configured by the operator. It will be set lower than the traffic rate at which the link becomes congested and the node drops packets. (Hence, by analogy with ECN we call our mechanism Pre-Congestion Notification.) Note also that the admission control decision is made for a particular ingress-egress-aggregate. So it is quite possible for a new flow to be admitted between one pair of PCN-boundary-nodes,Eardley (Editor) Expires February 9, 2008 [Page 11] Internet-Draft Document August 2007whilst at the same time another admission request is blocked between a different pair of PCN-boundary-nodes. Flow termination: At a high level, flow termination control works as follows. Each PCN-node PCN-marks packets in a similar fashion to above. An obvious approach is for the algorithm to use a second configured parameter, PCN-upper-rate, and a second header encoding ("PCN-upper-rate- marking"). However there is also a proposal to use the same rate and the same encoding. Several approaches have been proposed to date about how to convert this information into a flow termination decision; at a high level these are as follows: o One approach measures the rate of unmarked PCN-traffic (ie not PCN-upper-rate-marked) at the PCN-egress-node, which is the amount of PCN-traffic that can actually be supported; the PCN-ingress- node measures the rate of PCN-traffic that is destined for this specific PCN-egress-node, and hence can calculate the excess Eardley (Editor) Expires April 28, 2008 [Page 12] Internet-Draft Document October 2007 amount that should be terminated. o Another approach instead measures the rate of PCN-upper-rate- marked traffic and calculates and selects the flows that should be terminated. o Another approach terminates any PCN-flow with a PCN-upper-rate- marked packet.ItCompared with the approaches above, PCN-marking needs to be done at adifferent marking algorithm,reduced rate otherwise far too much traffic would be terminated. o Another approach uses only one sort of marking, which is based on the PCN-lower-rate, to decide not only whether to admit more PCN- flows but also whether any PCN-flows need to be terminated. It assumes that the ratio of the (implicit) PCN-upper-rate and the PCN-lower-rate is the same on all links. This approach measures the rate of unmarked PCN-traffic at a PCN-egress-node. The PCN- ingress-node uses this measurement to compute the implicit PCN- upper-rate of the bottleneck link. It then measures the rate of PCN-traffic that is destined for this specific PCN-egress-node and hence can calculate the amount that should be terminated. Since flow termination is designed for "abnormal" circumstances, it is quite likely that some PCN-nodes are congested and hence packets are being dropped and/or significantly queued. The flow termination mechanism must bear this in mind. Note also that the termination control decision is made for a particular ingress-egress-aggregate. So it is quite possible for PCN-flows to be terminated between one pair of PCN-boundary-nodes,Eardley (Editor) Expires February 9, 2008 [Page 12] Internet-Draft Document August 2007whilst at the same time none are terminated between a different pair of PCN-boundary-nodes. Although designed to work together, flow admission and flow termination are independent mechanisms, and the use of one does not require or prevent the use of the other (discussed further in Section 7.2). Information transport: The transport of pre-congestion information from a PCN-node to a PCN- egress-node is through PCN-markings in data packet headers, no signalling protocol messaging is needed. However, signalling is needed to transport PCN-feedback-information between the PCN- boundary-nodes, for example to convey the fraction of PCN-marked traffic from a PCN-egress-node to the relevant PCN-ingress-node. Exactly what information needs to be transported will be described in the future PCN WG document(s) about the boundary mechanisms. The Eardley (Editor) Expires April 28, 2008 [Page 13] Internet-Draft Document October 2007 signalling could be done by an extension of RSVP or NSIS, for instance; protocol work will be done by the relevant WG, but for example[I-D.lefaucheur-rsvp-ecn]describes[I-D.lefaucheur-rsvp-ecn] describes the extensions needed for RSVP. The following are some high-level points about how PCN works: o There needs to be a way for a PCN-node to distinguish PCN-traffic from non PCN-traffic. They may be distinguished using the DSCP field and/or ECN field.[I-D.chan-pcn-encoding-comparison] discusses further.o The PCN mechanisms may be applied to more than one traffic class (which are distinguished by DSCP). o There may be traffic that is more important than PCN, perhaps a particular application or an operator's control messages. A PCN- node may dedicate capacity to such traffic or priority schedule it over PCN. In the latter case its traffic needs to contribute to the PCN meters. o There will be traffic less important than PCN. For instance best effort or assured forwarding traffic. It will be scheduled at lower priority than PCN, and use a separate queue or queues. However, a PCN-nodemayshould dedicate some capacity to lower priority traffic so that it isn't starved. o There may be other traffic with the same priority as PCN-traffic. For instance, Expedited Forwarding sessions that are originated either without capacity admission or with traffic engineering. InEardley (Editor) Expires February 9, 2008 [Page 13] Internet-Draft Document August 2007[I-D.ietf-tsvwg-admitted-realtime-dscp] the two traffic classes are called EF and EF-ADMIT. A PCN-node could either use separate queues, or separate policers and a common queue; the draft provides some guidance when each is better, but for instance the latter is preferred when the two traffic classes are carrying the same type of application with the same jitter requirements. 5. Detailed Functional architecture This section is intended to provide a systematic summary of the new functional architecture in thePCN-domain, which maps to the additional functionality required byPCN-domain. First it describes functions needed at thePCN-nodes,three specific types of PCN-node; these are data plane functions and are in addition to their normal router functions.The section discusses theThen it describes further functionality needed for both flow admission control and flowtermination. Ittermination; these are signalling and decision-making functions, and there are various possibilities for where the functions are physically located. The section is split into: Eardley (Editor) Expires April 28, 2008 [Page 14] Internet-Draft Document October 2007 1. functions needed at PCN-interior-nodes 2. functions needed at PCN-ingress-nodes 3. functions needed at PCN-egress-nodes 4. other functions needed for flow admission control 5. other functions needed for probing (which may be needed sometimes) 6. other functions needed for flow termination control The section then discusses some other detailed topics: 1. addressing 2. tunnelling 3. fault handling 5.1. PCN-interior-node functions Eachlinkinterface of the PCN-domain is upgraded with the following functionality: o Packet classify - decide whether an incoming packet is a PCN- packet or not. Another PCN WG document will specify encoding, using theDSCPand/orDSCP and/or ECN fields.Eardley (Editor) Expires February 9, 2008 [Page 14] Internet-Draft Document August 2007o PCN-meter - measure the 'amount of PCN-traffic'. The measurement is made as an aggregate of all PCN-packets, and not per flow. o PCN-mark - algorithms determine whether to PCN-mark PCN-packets and what packet encoding is used (as specified in another PCN WG document). The same general approach of metering and PCN-marking is performed for both flow admission control and flow termination, however the algorithms and encoding may be different. These functions are needed for eachlinkinterface of thePCN-region.PCN-domain. They are therefore needed on alllinksinterfaces of PCN-interior-nodes, and on thelinksinterfaces of PCN-boundary-nodes that are internal to the PCN-domain. There may be more than one PCN-meter and marker installed at a givenlink,interface, eg one for admission and one for termination. Eardley (Editor) Expires April 28, 2008 [Page 15] Internet-Draft Document October 2007 5.2. PCN-ingress-node functions Each ingresslinkinterface of the PCN-domain is upgraded with the following functionality: o Packet classify - decide whether an incoming packet is part of a previously admitted microflow, by using a filter spec (eg DSCP, source and destination addresses and port numbers) o Police - police, by dropping or re-marking with a non-PCN DSCP, any packets received with a DSCP demanding PCN transport that do not belong to an admitted flow. Similarly, police packets that are part of a previously admitted microflow, to check that the microflow keeps to the agreed rate or flowspec (eg RFC1633 [RFC1633] and NSIS equivalent). o PCN-colour - set the DSCP field or DSCP and ECN fields to the appropriate value(s) for a PCN-packet. The draft about PCN- encoding will discuss further. o PCN-meter - make "measurements of PCN-traffic". Some approaches to flow termination require the PCN-ingress-node to measure the (aggregate) rate of PCN-traffic towards a particular PCN-egress- node. The first two are policing functions, needed to make sure that PCN- packets let into the PCN-domain belong to a flow that's been admitted(and probably alsoand to ensure that the flow doesn't go at a faster rate thanallowed by its service level agreement).agreed. The filter spec will for example come from the flow request message (outside scope of PCN WG, see [I-D.briscoe-tsvwg-cl-architecture] for an example usingEardley (Editor) Expires February 9, 2008 [Page 15] Internet-Draft Document August 2007RSVP). PCN-colouring allows the rest of thePCN-domainPCN- domain to recognise PCN-packets. 5.3. PCN-egress-node functions Each egresslinkinterface of the PCN-domain is upgraded with the following functionality: o Packet classify - determine which PCN-ingress-node a PCN-packet has come from. o PCN-meter - make"measurementsmeasurements ofPCN-traffic".PCN-traffic. The measurement(s) is made as an aggregate (ie not per flow) of all PCN-packets from a particular PCN-ingress-node. o PCN-colour - for PCN-packets, set the DSCPfield or DSCPand ECN fields to the appropriatevalue(s)values for use outside the PCN-domain. Eardley (Editor) Expires April 28, 2008 [Page 16] Internet-Draft Document October 2007 Another PCN WG document, about boundary mechanisms, will describe what the "measurements of PCN-traffic" are. This depends on whether the measurement is targeted at admission control or flow termination. It also depends on what encoding and PCN-marking algorithms are specified by the PCN WG. 5.4. Admission control functions Specific admission control functions can be performed at a PCN- boundary-node (PCN-ingress-node or PCN-egress-node) or at a centralised node, but not at normal PCN-interior-nodes. The functions are: o Make decision about admission - compare the required "measurements of PCN-traffic" (output of the PCN-egress-node's PCN-meter function) with some reference level, and hence decide whether to admit the potential new PCN-flow. As well as the PCN measurements, the decision takes account of policy and application layer requirements. o Communicate decision about admission - signal the decision to the node making the admission control request (which may be outside the PCN-region), and to the policer (PCN-ingress-node function) There are various possibilities for how the functionality can be distributed (we assume the operator would configure which is used): o The decision is made at the PCN-egress-node and signalled to the PCN-ingress-nodeEardley (Editor) Expires February 9, 2008 [Page 16] Internet-Draft Document August 2007o The decision is made at the PCN-ingress-node, which requires that the PCN-egress-node signals to the PCN-ingress-node the fraction of PCN-traffic that is PCN-marked (or whatever the PCN WG agrees as the required "measurements of PCN-traffic"). o The decision is made at a centralised node, which requires that the PCN-egress-node signals its measurements to the centralised node, and that the centralised node signals to the PCN-ingress- node about the decision about admission control. It would be possible for the centralised node to be one of the PCN-boundary- nodes, when clearly the signalling would sometimes be replaced by a message internal to the node. 5.5. Probing functions Probing functions are optional, and can be used for admission control.A PCN-ingress-node generates and sends probe packets in order to test the pre-congestion level. ProbingEardley (Editor) Expires April 28, 2008 [Page 17] Internet-Draft Document October 2007 PCN's admission control, as described so far, isuseful or even essential underessentially a reactive mechanism where thefollowing conditions: o whenPCN-egress-node monitors the pre- congestion level for traffic from each PCN-ingress-node; if the level rises then it blocks new flows on that ingress-egress-aggregate. However, it's possible that an ingress-egress-aggregate carries notraffic (or too little traffic fortraffic, and so the PCN-egress-nodeto accuratelycan't makethe "measurements of PCN-traffic" that are required foran admissiondecision). It maydecision using the usual method described earlier. One approach is to bethat"optimistic" and simply admit the new flow. However it's possible to envisage a scenario where the traffic levels on otheringress- egress-aggregatesingress-egress-aggregates are already so high that they're blocking new PCN-flows and admitting a new flowshouldn't be admitted on theonto this 'empty'ingress-egress-aggregate. Probing is useful to check this. o iningress-egress-aggregate would add extra traffic onto thepresence of multipath routing (ECMP) betweenlink that's already pre-congested - which may 'tip thePCN- boundary-nodes, whenbalance' so that PCN's flow termination mechanism is activated or somepathspackets arepre-congested there maydropped. This risk could beother paths which aren't pre-congested. Probinglessened by configuring on each link sufficient 'safety margin' above the PCN-lower-rate. An alternative approach isusefultodetermine whethermake PCN a more proactive mechanism. The PCN-ingress-node explicitly determines, before admitting the prospective newflow would follow a path that isn't pre- congested and henceflow, whether the ingress-egress-aggregate can support it. This can beadmitted. Probe packets may be simple data addressedseen as a "pessimistic" approach, in contrast to thePCN-egress-node and require no protocol standardisation, although there will be best practice for their number, size and rate. There are two possibilities for how probing is triggered: o the PCN-egress-node requests (signals)"optimism" of the approach above. It involves probing: a PCN-ingress-nodeto generategenerates and sends probetraffic o if the PCN-ingress-node knows which PCN-egress-node is associated with the destination addresspackets in order to test theadmission request, thenpre-congestion level that the flow would experience. A probe packet is just a dummy data packet, generated by the PCN-ingress-nodecould know it has no reservation with that PCN- egress-nodeandunilaterally start probing. The probing functions are: Eardley (Editor) Expires February 9, 2008 [Page 17] Internet-Draft Document August 2007 o Make decision that probing is needed o (if required) Communicateaddressed to therequest thatPCN-egress-node. A downside of probing isneeded - the PCN-egress-node signalsthat it adds delay to thePCN-ingress-nodeadmission control process. Also note thatprobein the scenario described in the previous paragraph (where traffic levels on other ingress-egress-aggregates isneeded o Generatealready very high), the probetraffic -packets may also 'tip thePCN-ingress-node generatesbalance'. However, theprobe traffic. The appropriate number (or rate) ofrisk should be reduced because it should be possible to send probe packetswill depend on the PCN-marking algorithm;forexample an excess-rate- marking algorithm generates fewer PCN-marksa shorter time and at a lower rate than athreshold- marking algorithm. o Forward probe packets - as far as PCN-interior-nodes are concerned, probe packets must be handled the same as (ordinary data) PCN-packets. o Consume probe packets - the PCN-egress-node consumes probe packets to ensure that they don't travel beyondtypical data flow. The situation is more complicated if there is multipath routing (ECMP) in the PCN-domain.5.6. Flow termination functions Specific termination control functions can be performed at a PCN- boundary-node (PCN-ingress-node or PCN-egress-node) or at a centralised node, but not at normal PCN-interior-nodes. There are various possibilitiesIt is then possible forhow the functionality can be distributed, similarsome paths tothose discussed above in the Admission control section; the flow termination decision couldbemade at the PCN-ingress-node,pre-congested whilst other paths within thePCN-egress-nodesame ingress-egress- aggregate aren't pre-congested. One approach essentially ignores ECMP: as usual, admit orat some centralised node. The functions are: o PCN-meter at PCN-egress-node - (as described in Section 5.3) make "measurements of PCN-traffic" from a particular PCN-ingress-node. o (if required) PCN-meter at PCN-ingress-node - make "measurements of PCN-traffic" being sent towardsblock aparticular PCN-egress-node; again, this is done fornew flow depending on theingress-egress-aggregate and not per flow. o (if required) Communicate"measurements of PCN-traffic"to the node that makes the flow termination decision. For example, if the PCN-ingress-node makes the decision then communicateon thePCN- egress-node's measurementsingress- egress-aggregate. This is rather similar toit (as in [I-D.briscoe-tsvwg-cl-architecture]). o Make decision about flow termination - usethe"measurements of PCN-traffic" to decide which PCN-flow"optimistic" approach above. An alternative ("pessimistic" orPCN-flows"proactive") approach is toterminate.probe the ECMP path. Thedecision takes account of policyPCN-ingress-node generates andapplication layer requirements.sends probe packets (dummy data) that follow the specific ECMP path that the new Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page 18] Internet-Draft DocumentAugustOctober 2007o Communicate decision aboutflowtermination - signal the decision to the node that is ablewould do, in order toterminatetest theflow (which may be outsidepre-congestion level along it. An ECMP algorithm typically examines: thePCN-region),source andto the policer (PCN-ingress-node function) One particular proposal, [I-D.charny-pcn-single-marking], for PCN- markingdestination IP addresses andperforming flow admissionport numbers, the protocol ID andtermination would require a global parameter to be defined on all PCN-boundary-nodes inthePCN- domain. [I-D.charny-pcn-single-marking] discussesDSCP. Hence these fields must have the same values infulltheimpact of this particular proposal onprobe packets as theoperation of PCN. 5.7. Addressing PCN-nodes may need to knowfuture data packets would have. On theaddress ofotherPCN-nodes: o in all cases PCN-interior-nodeshand, the PCN-egress- node needs to consume the probe packets to ensure that they don'tneedtravel beyond the PCN-domain (eg they might confuse the destination end node). Hence somehow the PCN-egress-node has toknowbe able to disambiguate a probe packet from a data packet, via theaddresscharacteristic setting ofany other PCN-nodes, except their next hop neighbours oparticular bit(s) in thecases of admissionpacket's header ortermination decisionbody - but these bit(s) mustn't be used by any PCN-interior-node's ECMP algorithm. This should be possible with a typical ECMP algorithm, but isn't in the general case. The probing functions are: o Make decision that probing is needed. As described above, this is when the ingress-egress-aggregate or the ECMP path carries no PCN-boundary-node,traffic. An alternative is always to probe, ie probe before admitting every PCN-flow. o (if required) Communicate the request that probing is needed - the PCN-egress-nodeneedssignals toknow the address ofthe PCN-ingress-nodeassociated with a flow, at a minimum sothat probing is needed o Generate probe traffic - the PCN-ingress-nodecan be informed to enforcegenerates theadmission decision through policing.probe traffic. Theaddressing information can be gathered from signalling,appropriate number (or rate) of probe packets will depend on the PCN-marking algorithm; for example an excess-rate- marking algorithm generates fewer PCN-marks than a threshold- marking algorithm, and so will need more probe packets. o Forward probe packets - asdescribed for RSVP in [I-D.lefaucheur-rsvp-ecn]. Alternatively, if PCN-traffic is always tunnelled across the PCN-domain, then the PCN-ingress- node's address is simplyfar as PCN-interior-nodes are concerned, probe packets must be handled thesource addresssame as (ordinary data) PCN-packets, in terms ofthe outer packet header.routing, scheduling and PCN- marking. oinConsume probe packets - thecases of admission orPCN-egress-node consumes probe packets to ensure that they don't travel beyond the PCN-domain. 5.6. Flow termination functions Specific terminationdecision by a centralcontrol functions can be performed at a PCN- boundary-node (PCN-ingress-node or PCN-egress-node) or at a centralised node, but not at normal PCN-interior-nodes. There are various possibilities for how thePCN-egress-node needs tofunctionality can beconfigured withdistributed, similar to those discussed above in theaddress ofAdmission control section; thecentralised node. In addition, depending onflow termination decision could be made at theexact deployment scenario and its signalling,PCN-ingress-node, the PCN-egress-node or at some centralisednode may need to know the addressesnode. The functions are: Eardley (Editor) Expires April 28, 2008 [Page 19] Internet-Draft Document October 2007 o PCN-meter at PCN-egress-node - (as described in Section 5.3) make "measurements ofthePCN-traffic" from a particular PCN-ingress-node. o (if required) PCN-meter at PCN-ingress-nodeand PCN- egress-node, and the PCN-egress-node know the address- make "measurements ofthe PCN- ingress-node. NOTE: Consideration of the centralised case is out of scope of the initial PCN WG Charter. 5.8. Tunnelling It is possible that tunnels terminate atPCN-traffic" being sent towards aPCN-node. It is important that any PCN-marking is preserved after decapsulation, so that itparticular PCN-egress-node; again, this isstill seen by the PCN-egress-node. To ensure this, on decapsulation the following rules are applied: o the PCN-marking state ofdone for theinneringress-egress-aggregate andouter headers are compared Eardley (Editor) Expires February 9, 2008 [Page 19] Internet-Draft Document August 2007 o if the inner header's marking state is more severe then it is preserved o if the outer header's marking state is more severe then it is copied onto the inner headernot per flow. oNB the order(if required) Communicate "measurements ofincreasing severity is: unmarked; PCN-marking with first encoding (ie associated withPCN-traffic" to thePCN-lower-rate); PCN- marking with second encoding (ie associated withnode that makes thePCN-upper- rate) Similarly,flow termination decision. For example, ifencapsulation is done withinthePCN-domain,PCN-ingress-node makes the decision then communicate thefollowing rule is applied:PCN- egress-node's measurements to it (as in [I-D.briscoe-tsvwg-cl-architecture]). oany PCN-marking is copied intoMake decision about flow termination - use theouter header Tunnelling considerations also depend on"measurements of PCN-traffic" to decide whichheader bits the PCN WG decidesPCN-flow or PCN-flows touse. If the ECN bits are used then [I-D.briscoe-tsvwg-ecn-tunnel] applies;terminate. The decision takes account of policy and application layer requirements. o Communicate decision about flow termination - signal therules above conformdecision toits spirit. IftheDSCP fieldnode that isused then [RFC2983] needsable to terminate the flow (which may beconsidered carefully. An operator may wishoutside the PCN-region), and totunnel PCN-traffic from PCN-ingress-nodesthe policer (PCN-ingress-node function) One particular proposal, [I-D.charny-pcn-single-marking], for PCN- marking and performing flow admission and termination would require a global parameter toPCN-egress-nodes,be defined on all PCN-boundary-nodes inwhich casetherules above aren't needed. The potential reasons for doing such tunnelling are:PCN- domain. [I-D.charny-pcn-single-marking] discusses in full thePCN-egress-node then automatically knowsimpact of this particular proposal on theaddressoperation of PCN. 5.7. Addressing PCN-nodes may need to know therelevant PCN-ingress-node for a flow; even if ECMP is running,address of other PCN-nodes: o in allPCN-packets on a particular ingress-egress-aggregate followcases PCN-interior-nodes don't need to know thesame path. But it also has drawbacks: additional overheadaddress of any other PCN-nodes (except as normal their next hop neighbours) o intermsthe cases ofbandwidth and processing; andadmission or termination decision by a PCN- boundary-node, the PCN-egress-node needs to know theeffective eliminationaddress ofECMP asthe PCN-ingress-node associated with aload balancing mechanism. 5.9. Fault handling Ifflow, at aPCN-interior-node fails (or one of its links), then lower layer protection mechanisms orminimum so that theregular IP routing protocol will eventually re-route round it. IfPCN-ingress-node can be informed to enforce thenew routeadmission decision (and any flow termination decision) through policing. The addressing information cancarry allbe gathered from signalling, for example as described for RSVP in [I-D.lefaucheur-rsvp-ecn]. Another alternative is to use a probe packet that includes as payload theadmitted traffic, flows will gracefully continue. If instead this causes early warningaddress ofpre-congestion onthenew route,PCN-ingress-node. Alternatively, if PCN-traffic is always tunnelled across the PCN-domain, thenadmission control based on pre-congestion notification will ensure new flows will not be admitted until enough existing flows have departed. Finally re-routing may result in heavy (pre-)congestion, when the flow termination mechanism will kick in. If a PCN-boundary-node fails then we would liketheregular QoS signalling protocol to take care of things. As an example [I-D.briscoe-tsvwg-cl-architecture] considers what happens if RSVPPCN-ingress-node's address is simply theQoS signalling protocol. The details for a specific signalling protocol are out of scopesource address of thePCN WG, however there is a WGEardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page 20] Internet-Draft DocumentAugustOctober 2007Milestone on generic "Requirements for signalling". 6. Design goals and challenges Prior work on PCN and similar mechanisms has thrown up a number of considerations about PCN's design goals (things PCN should be good at) and some issues that have been hardouter packet header - but then the PCN-ingress-node needs tosolve in a fully satisfactory manner. Taken as a whole it represents a listknow the address oftrade- offs (it's unlikely that they can all be 100% achieved) and perhaps as evaluation criteria to help an operator (ortheIETF) decide between options. The following are key design goals for PCN (based on [I-D.chan-pcn-problem-statement]): o The PCN-enabled packet forwarding network should be simple, scalable and robustPCN-egress-node. oCompatibility with other traffic (i.e. a proposed solution should work well when non-PCN traffic is also presentin thenetwork) o Support of different typescases ofreal-time traffic (eg should work welladmission or termination decision by a central control node, the PCN-egress-node needs to be configured withCBR and VBR voice and video sources treated together) o Reaction timethe address of themechanisms should be commensurate withcentralised node. In addition, depending on thedesired application-level requirements (e.g. a termination mechanism needsexact deployment scenario and its signalling, the centralised node may need toterminate flows before significant QoS issues are experienced by real-time traffic,know the addresses of the PCN-ingress-node andbefore most users hang up) o Compatibility with different precedence levelsPCN- egress-node, the PCN-egress-node know the address ofreal-time applications (e.g. preferential treatmentthe PCN- ingress-node, and the PCN-ingress-node know the address ofhigher precedence calls over lower precedence calls, [ITU-MLPP]. The following are open issues. They are taken from [I-D.briscoe-tsvwg-cl-architecture] which also describes some possible solutions (potential solutions arethe centralised node. NOTE: Consideration of the centralised case is out of scopefor this document). Note that some may be considered unimportant in general or in specific deployment scenarios. o ECMP (Equal Cost Multi-Path) Routing: The levelofpre-congestion is measured on a specific ingress-egress-aggregate. However, ifthePCN-domain runs ECMP, then traffic on this ingress-egress- aggregateinitial PCN WG Charter. 5.8. Tunnelling Tunnels mayfollow several different paths - someoriginate and/or terminate within a PCN-domain. It is important that the PCN-marking of any packet can potentially influence PCN's flow admission control and termination - it shouldn't matter whether thepaths couldpacket happens to bepre-congested whilst others are not. There are two potential problems: Eardley (Editor) Expires February 9, 2008 [Page 21] Internet-Draft Document August 2007 1. over-admission: a new flow is admitted (becausetunnelled at thepre- congestion level measured byPCN-node that PCN-marks thePCN-egress-node is sufficiently dilutedpacket, or indeed whether it's decapsulated or encapsulated byunmarked packets from non-congested paths that a new flow is admitted), but its packets travel through a pre-congested PCN-node 2. ineffective termination: flows are terminated, however their path doesn't travel through the (pre-)congested router(s). The overall PCN solution for flow termination must solve the second problem, since flow termination is a 'last resort'. For flow admission, the risk of slight over-admission may be acceptable (particularly with flow termination asafall-back), at least for some operators. o Bi-Directional Sessions: Many applications have bi-directional sessions - hence there are two flowssubsequent PCN-node. This suggests that the "uniform conceptual model" described in [RFC2983] should beadmitted (or terminated) as a pair - for instance a bi-directional voice call only makes sense if flowsre- applied inboth directions are admitted. However, PCN's mechanisms concern admissionthe PCN context. In line with this andterminationthe approach ofa single flow,[RFC4303] andcoordination of[I-D.briscoe-tsvwg-ecn-tunnel], thedecision for both flowsfollowing rule isa matter forapplied if encapsulation is done within thesignalling protocol and outPCN-domain: o any PCN-marking is copied into the outer header Similarly, in line with the "uniform conceptual model" ofscope[RFC2983] and the "full-functionality option" ofPCN. One possible example would use SIP pre-conditions; there[RFC3168], the following rules areothers.applied if decapsulation is done within the PCN-domain: oGlobal Coordination: PCN makes its admission decision based on PCN-markings on a particular ingress-egress-aggregate. Decisions about flows through a different ingress-egress-aggregate are made independently. However, one can imagine network topologies and traffic matrices where from a global perspectiveif the outer header's marking state is more severe then itwould be better to make a coordinated decision across allis copied onto theingress- egress-aggregates forinner header o NB thewhole PCN-domain. For example, to block (or even terminate) flows on one ingress-egress-aggregate so that more important flows through a different ingress-egress-aggregate could be admitted. Mechanisms to solve these problems may well be out of scope. o Aggregate Traffic Characteristics: Even when the numberorder offlows is stable, the traffic level throughincreasing severity is: unmarked; PCN-marking with first encoding (ie associated with thePCN-domain will vary becausePCN-lower-rate); PCN- marking with second encoding (ie associated with thesources vary their traffic rates. PCN works best when there's not too much variability inPCN-upper- rate) Another reason for thetotal traffic level at a PCN-node's interface (ie incopying operations described above is to simplify dealing with theaggregate traffic from all sources). Too much variation means that a node may (at one moment) not be doing anyvarious headers: PCN-markingandis then(at another moment) drop packets because it's overloaded. This makes it hardorthogonal totune the admission control schemetunnel encapsulation /decapsulation. An operator may wish tostop admitting new flows attunnel PCN-traffic from PCN-ingress-nodes to PCN-egress-nodes. The PCN-marks shouldn't be visible outside theright time.PCN-domain, which can be achieved by doing the PCN-colour function (Section 5.3) after all the other (PCN and tunnelling) functions. Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page22]21] Internet-Draft DocumentAugustOctober 2007o Flash crowds and SpeedThe potential reasons for doing such tunnelling are: the PCN-egress- node then automatically knows the address ofReaction: PCNthe relevant PCN- ingress-node for a flow; even if ECMP is running, all PCN-packets on ameasurement-based mechanism and soparticular ingress-egress-aggregate follow the same path. But it also hasa limited speeddrawbacks, for example the additional overhead in terms ofreaction. For example, potentially if a big burst of admission requests occurs inbandwidth and processing. 5.9. Fault handling If avery short spacePCN-interior-node fails (or one oftime (eg prompted by a televote), they could all get admitted before enough PCN-marks are seen to blockits links), then lower layer protection mechanisms or the regular IP routing protocol will eventually re-route round it. If the newflows. In other words, any additional load offered withinroute can carry all thereaction timeadmitted traffic, flows will gracefully continue. If instead this causes early warning of pre-congestion on the new route, then admission control based on pre-congestion notification will ensure new flows will not be admitted until enough existing flows have departed. Finally re-routing may result in heavy (pre-)congestion, when the flow termination mechanismmustn't movewill kick in. If a PCN-boundary-node fails then we would like thePCN-domain directly from no congestionregular QoS signalling protocol tooverload. This 'vulnerability period' may impact attake care of things. As an example [I-D.briscoe-tsvwg-cl-architecture] considers what happens if RSVP is the QoS signallinglevel,protocol. The details forinstance QoS requests shouldn't be handled any faster than the vulnerability period. o Compatibility of PCN-encoding with ECN-encoding. This issue will be considered further in [I-D.chan-pcn-encoding-comparison]. 7. Operations and Management EDITOR'S NOTE: A re-writea specific signalling protocol are out ofthis section is planned; somescope of thesub-sections are very short! ThePCN WG, however there is a WGCharter says that the architecture document should include security, manageabilityMilestone on generic "Requirements for signalling". 6. Design goals andoperational considerations. This Section considers operationschallenges Prior work on PCN andmanagement issues, under the FCAPS headings: OAMsimilar mechanisms has thrown up a number ofFaults, Configuration, Accounting, Performance and Security. 7.1. Fault OAM Fault OAM isconsiderations abouthow to tell the management system (or manual operator)PCN's design goals (things PCN should be good at) and some issues thatthe system has recovered (or not) from a failure. Faults include node or link failures, a wrongly configured address in a node, a wrong address givenhave been hard to solve in asignalling protocol,fully satisfactory manner. Taken as awrongly configured parameter inwhole it represents aqueueing algorithm,list of trade- offs (it's unlikely that they can all be 100% achieved) andso on. 7.2. Configuration OAM Perhapsperhaps as evaluation criteria to help an operator (or themost important consideration hereIETF) decide between options. The following are key design goals for PCN (based on [I-D.chan-pcn-problem-statement]): o The PCN-enabled packet forwarding network should be simple, scalable and robust o Compatibility with other traffic (i.e. a proposed solution should work well when non-PCN traffic isthatalso present in thelevel of detailnetwork) o Support ofthe standardisation affects what can be configured. We would likedifferentimplementations and configurationstypes of real-time traffic (egchoiceshould work well with CBR and VBR voice and video sources treated together) Eardley (Editor) Expires April 28, 2008 [Page 22] Internet-Draft Document October 2007 o Reaction time ofparameters) that are compliantthe mechanisms should be commensurate with thePCN standarddesired application-level requirements (e.g. a termination mechanism needs towork together successfully. Obvious configuration parametersterminate flows before significant QoS issues arethe PCN-lower-rateexperienced by real-time traffic, andPCN- upper-rate. A larger PCN-lower-rate enables more PCN-traffic tobefore most users hang up) o Compatibility with different precedence levels of real-time applications (e.g. preferential treatment of higher precedence calls over lower precedence calls, [ITU-MLPP]. The following are open issues. They are mainly taken from [I-D.briscoe-tsvwg-cl-architecture] which also describes some possible solutions. Note that some may beadmitted on a link, hence improving capacity utilisation. A PCN- upper-rate set further above the PCN-lower-rate allows greater increasesconsidered unimportant intraffic (whether due to natural fluctuationsgeneral or in specific deployment scenarios or by someEardley (Editor) Expires February 9, 2008 [Page 23] Internet-Draft Document August 2007 unexpected event) before any flowsoperators. NOTE: Potential solutions areterminated, ie minimises the chancesout ofunnecessarily triggering the termination mechanism. A greater gap, between the maximum rate at which PCN-traffic can be forwardedscope for this document. o ECMP (Equal Cost Multi-Path) Routing: The level of pre-congestion is measured on alink and the PCN-lower-rate and PCN-upper-rate, increasesspecific ingress-egress-aggregate. However, if the'safety margin' - which can cover unexpected surges inPCN-domain runs ECMP, then trafficdue to a re-routing event for instance. For instance an operatoron this ingress-egress- aggregate maywant to design their network so that it can cope with a failurefollow several different paths - some ofany single PCN-node without terminating any flows. Setting the rates will therefore depend on things like:theoperator's requirements,paths could be pre-congested whilst others are not. There are three potential problems: 1. over-admission: a new flow is admitted (because thelink's capacity,pre- congestion level measured by thetypical number of flows and perhaps their traffic characteristics, and so on. Other configurable parameters concernPCN-egress-node is sufficiently diluted by unmarked packets from non-congested paths that a new flow is admitted), but its packets travel through a pre-congested PCN-node 2. under-admission: a new flow is blocked (because thePCN-boundary-nodes. For example,pre- congestion level measured by theamount ofPCN-egress-node is sufficiently increased by PCN-markedtraffic above whichpackets from pre- congested paths that a new flow is blocked), but its packets travel along an uncongested path 3. ineffective termination: flows areblocked. Another configuration choiceterminated, however their path doesn't travel through the (pre-)congested router(s). Since flow termination is a 'last resort' that protects thedistribution ofnetwork should over-admission occur, this problem is probably more important to solve than thefunctions concerning flows admissionother two. o ECMP andtermination, givensignalling: It is possible that, inSection 5.4 and 5.6, and which could potentially be undera PCN-domain running ECMP, thecontrol ofsignalling packets (eg RSVP, NSIS) follow aconfiguration parameter. Another configuration decision is whether to operate bothdifferent path than theadmission control and termination mechanisms. Although we suggest that an operator uses both, this isn't required and some operators may wantdata packets. This depends on which fields the ECMP algorithm uses. Eardley (Editor) Expires April 28, 2008 [Page 23] Internet-Draft Document October 2007 o Tunnelling: There are scenarios where tunnelling makes it hard toimplement only one. For example, an operator could use just admission control, solving heavy congestion (caused by re- routing) by 'just waiting' - as sessions end, existing microflows naturally depart fromdetermine thesystem over time,path in the PCN-domain. The problem, its impact and theadmission control mechanism will prevent admission of new microflows that use the affected links. So the PCN-domain will naturally returnpotential solutions are similar tonormal operation, butthose for ECMP. o Scenarios withreduced capacity.only one tunnel endpoint in the PCN domain: (1) Thedrawback of this approach would be that until PCN-flows naturally depart to relievetunnel starts outside a PCN-domain and finishes inside it. If thecongestion, all PCN-flows as well as lower priority services will be adversely affected. Onpacket arrives at theother hand, an operator could just rely for admission control on statically provisioned capacity per PCN- ingress-node (regardless oftunnel ingress with thePCN-egress-node of a flow),same encoding asis typical in the hose model ofused within theDiffServ architecture [RFC2475]. Such traffic conditioning agreements can leadPCN-domain tofocused overload: many flows happenindicate PCN-marking, then this could lead the PCN-egress-node tofocus onfalsely measure pre-congestion. (2) The tunnel starts inside aparticular linkPCN-domain and finishes outside it. If the packet arrives at the tunnel ingress already PCN-marked, thenall flows throughit will still have thecongested link fail catastrophically. The flow termination mechanismsame encoding when it's decapsulated which couldthen be used to counteract such a problem. A different possibility is to configure onlypotentially confuse nodes beyond thePCN-lower-rate and hencetunnel egress. (3) Scenarios with onlydoonetype of PCN-marking, but generate admission and flow termination responses from different levels of marking. This is suggestedtunnel endpoint in[I-D.charny-pcn-single-marking] which gives some ofthepros and cons of this approach. Eardley (Editor) Expires February 9, 2008 [Page 24] Internet-Draft Document August 2007 AnotherPCNWG document will specify PCN-marking, in particular how many PCN-packets get PCN-marked according to what measure of PCN- traffic. For instance an algorithm relatingdomain may also make it harder for thecurrent rate of PCN- trafficPCN-egress-node to gather from theprobabilitysignalling messages (eg RSVP, NSIS) the identity ofadmission-marking a packet. Depending on how tightly it is decided to specify this,the PCN- ingress-node. o Bi-Directional Sessions: Many applications have bi-directional sessions - hence there arepotentially quitetwo flows that should be admitted (or terminated) as afew configuration choices,pair - forinstance: o does the probability go from 0% at one rate of PCN-traffic (the PCN-lower-rate) to 100% atinstance aslightly higher rate (ie threshold- marking), or does it 'ramp up' gradually (asbi-directional voice call only makes sense if flows inRED)? Does the standard allow both? o how is the current rateboth directions are admitted. However, PCN's mechanisms concern admission and termination ofPCN-traffic measured? Rate cannot be measured instantaneously, so how is this smoothed? A sliding window or exponentially weighted moving average? o is the PCN-lower-rateafixed parameter? An idea raised in [Songhurst] is that the PCN-lower-rate on each router should depend on the current amountsingle flow, and coordination ofnon-PCN-traffic;theaimdecision for both flows isthat resource allocation reflects the traffic mix -a matter forinstance more PCN-traffic could be admitted ifthefractionsignalling protocol and out ofPCN-traffic was higher. Is this allowed? Another question is whetherscope of PCN. One possible example would use SIP pre-conditions; there areany configuration parameters that have to be set once to 'globally' control the whole PCN-domain (as required by some proposals). This may affect operational complexity and the chances of interoperability problems between kitothers. o Global Coordination: PCN makes its admission decision based on PCN-markings on a particular ingress-egress-aggregate. Decisions about flows through a different ingress-egress-aggregate are made independently. However, one can imagine network topologies and traffic matrices where, from a global perspective, it would be better to make a coordinated decision across all the ingress- egress-aggregates for the whole PCN-domain. For example, to block (or even terminate) flows on one ingress-egress-aggregate so that more important flows through a differentvendors. 7.3. Accounting OAM Accountingingress-egress-aggregate could be admitted. The problem may well be second order. o Aggregate Traffic Characteristics: Even when the number of flows is stable, the traffic level through the PCN-domain will vary because the sources vary their traffic rates. PCN works best when there's not too much variability in the total traffic level at a PCN-node's interface (ie in the aggregate traffic from all sources). Too much variation means that a node may (at one moment) not be doing any PCN-marking and then (at another moment) drop packets because it's overloaded. This makes it hard to tune the admission control scheme to stop admitting new flows at the right time. Therefore the problem is more likely with fewer, Eardley (Editor) Expires April 28, 2008 [Page 24] Internet-Draft Document October 2007 burstier flows. o Flash crowds and Speed of Reaction: PCN is a measurement-based mechanism and so there is an inherent delay between packet marking by PCN-interior-nodes and any admission control reaction at PCN- boundary-nodes. For example, potentially if a big burst of admission requests occurs in a very short space of time (eg prompted by a televote), they could all get admitted before enough PCN-marks are seen to block new flows. In other words, any additional load offered within the reaction time of the mechanism mustn't move the PCN-domain directly from no congestion to overload. This 'vulnerability period' may impact at the signalling level, for instance QoS requests should be rate limited to bound the number of requests able to arrive within the vulnerability period. o Silent at start: after a successful admission request the source may wait some time before sending data (eg waiting for the called party to answer). Then the risk is that, in some circumstances, PCN's measurements underestimate what the pre-congestion level will be when the source does start sending data. o Compatibility of PCN-encoding with ECN-encoding. This issue will be considered further in the PCN WG Milestone 'Survey of encoding choices'. 7. Operations and Management EDITOR'S NOTE: A re-write of this section is planned; some of the sub-sections are very short! The PCN WG Charter says that the architecture document should include security, manageability and operational considerations. This Section considers operations and management issues, under the FCAPS headings: OAM of Faults, Configuration, Accounting, Performance and Security. 7.1. Fault OAM Fault OAM is about how to tell the management system (or manual operator) that the system has recovered (or not) from a failure. Faults include node or link failures, a wrongly configured address in a node, a wrong address given in a signalling protocol, a wrongly configured parameter in a queueing algorithm, and so on. Eardley (Editor) Expires April 28, 2008 [Page 25] Internet-Draft Document October 2007 7.2. Configuration OAM Perhaps the most important consideration here is that the level of detail of the standardisation affects what can be configured. We would like different implementations and configurations (eg choice of parameters) that are compliant with the PCN standard to work together successfully. Obvious configuration parameters are the PCN-lower-rate and PCN- upper-rate. A larger PCN-lower-rate enables more PCN-traffic to be admitted on a link, hence improving capacity utilisation. A PCN- upper-rate set further above the PCN-lower-rate allows greater increases in traffic (whether due to natural fluctuations or some unexpected event) before any flows are terminated, ie minimises the chances of unnecessarily triggering the termination mechanism. A greater gap, between the maximum rate at which PCN-traffic can be forwarded on a link and the PCN-lower-rate and PCN-upper-rate, increases the 'safety margin' - which can cover unexpected surges in traffic due to a re-routing event for instance. For instance an operator may want to design their network so that it can cope with a failure of any single PCN-node without terminating any flows. Setting the rates will therefore depend on things like: the operator's requirements, the link's capacity, the typical number of flows and perhaps their traffic characteristics, and so on. Other configurable parameters concern the PCN-boundary-nodes. For example, the amount of PCN-marked traffic above which new flows are blocked. Another configuration choice is the distribution of the functions concerning flows admission and termination, given in Section 5.4 and 5.6, and which could potentially be under the control of a configuration parameter. Another configuration decision is whether to operate both the admission control and termination mechanisms. Although we suggest that an operator uses both, this isn't required and some operators may want to implement only one. For example, an operator could use just admission control, solving heavy congestion (caused by re- routing) by 'just waiting' - as sessions end, existing microflows naturally depart from the system over time, and the admission control mechanism will prevent admission of new microflows that use the affected links. So the PCN-domain will naturally return to normal operation, but with reduced capacity. The drawback of this approach would be that until PCN-flows naturally depart to relieve the congestion, all PCN-flows as well as lower priority services will be adversely affected. On the other hand, an operator could just rely for admission control on statically provisioned capacity per PCN- Eardley (Editor) Expires April 28, 2008 [Page 26] Internet-Draft Document October 2007 ingress-node (regardless of the PCN-egress-node of a flow), as is typical in the hose model of the DiffServ architecture [RFC2475]. Such traffic conditioning agreements can lead to focused overload: many flows happen to focus on a particular link and then all flows through the congested link fail catastrophically. The flow termination mechanism could then be used to counteract such a problem. A different possibility is to configure only the PCN-lower-rate and hence only do one type of PCN-marking, but generate admission and flow termination responses from different levels of marking. This is suggested in [I-D.charny-pcn-single-marking] which gives some of the pros and cons of this approach. Another PCN WG document will specify PCN-marking, in particular how many PCN-packets get PCN-marked according to what measure of PCN- traffic. For instance an algorithm relating the current rate of PCN- traffic to the probability of admission-marking a packet. Depending on how tightly it is decided to specify this, there are potentially quite a few configuration choices, for instance: o does the probability go from 0% at one rate of PCN-traffic (the PCN-lower-rate) to 100% at a slightly higher rate (ie threshold- marking), or does it 'ramp up' gradually (as in RED)? Does the standard allow both? o how is the current rate of PCN-traffic measured? Rate cannot be measured instantaneously, so how is this smoothed? A sliding window or exponentially weighted moving average? o is the PCN-lower-rate a fixed parameter? An idea raised in [Songhurst] is that the PCN-lower-rate on each router should depend on the current amount of non-PCN-traffic; the aim is that resource allocation reflects the traffic mix - for instance more PCN-traffic could be admitted if the fraction of PCN-traffic was higher. Is this allowed? Another question is whether there are any configuration parameters that have to be set once to 'globally' control the whole PCN-domain (as required by some proposals). This may affect operational complexity and the chances of interoperability problems between kit from different vendors. 7.3. Accounting OAM Accounting at the flow level will have to record instances of flow admission, rejection and termination, but accounting itself is outside the scope of PCN. The ability to enable or disable flow Eardley (Editor) Expires April 28, 2008 [Page 27] Internet-Draft Document October 2007 accounting for specific classes of flow and to specify retrieval of accounting records in real time for specified classes of flow is a general requirement not specific to PCN that may, however, find specific use when diagnosing faults affecting PCN operation. 7.4. Performance OAM Performance OAM is about monitoring performance at run-time. There are a wide variety of performance metrics that it may be worth collecting at PCN-ingress-nodes, PCN-egress-nodes and PCN-interior- nodes. A detailed list of metrics is not part of this architecture document, but the sorts of things would be: o can the operator identify 'hot spots' in the network (links which most often do PCN-marking)? This would help them plan to install extra capacity where it is most needed. o what is the rate at which flows are admitted and terminated (for each pair of PCN-boundary-nodes)? Such information would be useful for fault management, networking planning and service level monitoring. 7.5. Security OAM Security OAM is finding out about security breaches or near-misses at run-time. 8. IANA Considerations This memo includes no request to IANA. 9. Security considerations Security considerations essentially come from the Trust Assumption (Section 3.1), ie that all PCN-nodes are PCN-enabled and trust each other for truthful PCN-marking and transport. PCN splits functionality between PCN-interior-nodes and PCN-boundary-nodes, and the security considerations are somewhat different for each, mainly because PCN-boundary-nodes are flow-aware and PCN-interior-nodes are not. o because the PCN-boundary-nodes are flow-aware, they are trusted to use that awareness correctly. The degree of trust required depends on the kinds of decisions they have to make and the kinds of information they need to make them. For example when the PCN- boundary-node needs to know the contents of the sessions for Eardley (Editor) Expires April 28, 2008 [Page 28] Internet-Draft Document October 2007 making the admission and termination decisions (perhaps based on the MLPP precedence), or when the contents are highly classified, then theflow levelsecurity requirements for the PCN-boundary-nodes involved willhavealso need torecord instances ofbe high. o the PCN-ingress-nodes police packets to ensure a flowadmission, rejectionsticks within its agreed limit, andtermination, but accounting itself is outsideto ensure that only flows which have been admitted contribute PCN-traffic into thescope of PCN.PCN-domain. Theabilitypolicer must drop (or perhaps re-mark toenable or disable flow accounting for specific classes of flow anda different DSCP) any PCN-packets received that are outside this remit. This is similar tospecify retrievalthe existing IntServ behaviour. Between them the PCN-boundary- nodes must encircle the PCN-domain, otherwise PCN-packets could enter the PCN-domain without being subject to admission control, which would potentially destroy the QoS ofaccounting recordsexisting flows. o PCN-interior-nodes aren't flow-aware. This prevents some security attacks where an attacker targets specific flows inreal timethe data plane - forspecified classes of flowinstance for DoS or eavesdropping. o PCN-marking by the PCN-interior-nodes along the packet forwarding path needs to be trusted, because the PCN-boundary-nodes rely on this information. For instance a rogue PCN-interior-node could PCN-mark all packets so that no flows were admitted. Another possibility is that it doesn't PCN-mark any packets, even when it's pre-congested. More subtly, the rogue PCN-interior-node could perform these attacks selectively on particular flows, or it could PCN-mark the correct fraction overall, but carefully choose which flows it marked. o the PCN-boundary-nodes should be able to deal with DoS attacks and state exhaustion attacks based on fast changes in per flow signalling. o the signalling between the PCN-boundary-nodes (and possibly ageneral requirement not specificcentral control node) must be protected from attacks. For example the recipient needs toPCNvalidate thatmay, however, find specific use when diagnosing faults affecting PCN operation. 7.4. Performance OAM Performance OAMthe message isabout monitoring performance at run-time. There are a wide variety of performance metricsindeed from the node thatit may be worth collecting at PCN-ingress-nodes, PCN-egress-nodesclaims to have sent it. Possible measures include digest authentication andPCN-interior- nodes. A detailed list of metricsprotection against replay and man-in- the-middle attacks. For the specific protocol RSVP, hop-by-hop authentication isnot part of this architecture document, butin [RFC2747], and [I-D.behringer-tsvwg-rsvp-security-groupkeying] may also be useful; for a generic signalling protocol thesorts of things would be:PCN WG document on "Requirements for signalling" will describe the requirements in more detail. Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page25]29] Internet-Draft DocumentAugustOctober 2007o can the operator identify 'hot spots'10. Conclusions The document describes a general architecture for flow admission and termination based on aggregated pre-congestion information inthe network (links which most often do PCN-marking)? This would help them planorder toinstall extra capacity where it is most needed. o what isprotect therate at which flows are admitted and terminated (for each pairquality ofPCN-boundary-nodes)? Such information would be useful for fault management, networking planning andservicelevel monitoring. 7.5. Security OAM Security OAM is finding out about security breaches or near-misses at run-time. 8. IANA Considerations This memo includes no request to IANA. 9. Security considerations Security considerations essentially come fromof established inelastic flows within a single DiffServ domain. The main topic is theTrust Assumption (Section 3.1), ie that all PCN-nodes are PCN-enabledfunctional architecture (first covered at a high level andtrust eachthen at a greater level of detail). It also mentions otherfor truthful PCN-marking and transport. PCN splits functionality between PCN-interior-nodes and PCN-boundary-nodes, andtopics like thesecurity considerations are somewhat different for each, mainly because PCN-boundary-nodes are flow-awareassumptions andPCN-interior-nodes are not. o because the PCN-boundary-nodes are flow-aware, theyopen issues. 11. Acknowledgements This document is a revised version of [I-D.eardley-pcn-architecture]. Its authors were: P. Eardley, J. Babiarz, K. Chan, A. Charny, R. Geib, G. Karagiannis, M. Menth, T. Tsou. They aretrustedtherefore contributors touse that awareness correctly. The degree of trust required dependsthis document. Thanks to those who've made comments on [I-D.eardley-pcn-architecture] and on earlier versions of this draft: Lachlan Andrew, Joe Babiarz, Fred Baker, David Black, Steven Blake, Bob Briscoe, Ken Carlberg, Anna Charny, Joachim Charzinski, Andras Csaszar, Lars Eggert, Ruediger Geib, Robert Hancock, Georgios Karagiannis, Michael Menth, Tom Taylor, Tina Tsou, Delei Yu. This document is thekindsresult ofdecisions they have to makediscussions in the PCN WG and forerunner activity in thekindsTSVWG. A number ofinformation they need to make them. For example when the PCN- boundary-node needsprevious drafts were presented toknow the contentsTSVWG: [I-D.chan-pcn-problem-statement], [I-D.briscoe-tsvwg-cl-architecture], [I-D.briscoe-tsvwg-cl-phb], [I-D.charny-pcn-single-marking], [I-D.babiarz-pcn-sip-cap], [I-D.lefaucheur-rsvp-ecn], [I-D.westberg-pcn-load-control].The authors ofthe sessions for making the admissionthem were: B, Briscoe, P. Eardley, D. Songhurst, F. Le Faucheur, A. Charny, J. Babiarz, K. Chan, S. Dudley, G. Karagiannis, A. Bader, L. Westberg, J. Zhang, V. Liatsos, X-G. Liu, A. Bhargava. 12. Comments Solicited Comments andtermination decisions (perhaps based on the MLPP precedence), or when the contentsquestions arehighly classified, then the security requirements for the PCN-boundary-nodes involved will also need to be high. o the PCN-ingress-nodes police packets to ensure a flow sticks within its agreed limit,encouraged and very welcome. They can be addressed toensure that only flows which have been admitted contribute PCN-traffic intothePCN-domain. The policer must drop (or perhaps re-mark to a different DSCP) any PCN-packets received that are outside this remit. This is similarIETF PCN working group mailing list <pcn@ietf.org>. 13. Changes In addition to clarifications and nit squashing, theexisting IntServ behaviour. Between them the PCN-boundary- nodes must encircle the PCN-domain, otherwise PCN-packets could enter the PCN-domain without being subject to admission control,main changes are: Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page26]30] Internet-Draft DocumentAugustOctober 2007which would potentially destroy the QoS of existing flows. o PCN-interior-nodes aren't flow-aware. This prevents some security attacks where an attacker targets specific flows in the data plane - for instance for DoS or eavesdropping. o PCN-marking by the PCN-interior-nodes along the packet forwarding path needs to be trusted, because the PCN-boundary-nodes rely on this information. For instance a rogue PCN-interior-node could PCN-mark all packets so that no flows were admitted. Another possibility is that it doesn't PCN-mark any packets, even when it's pre-congested. More subtly, the rogue PCN-interior-node could perform these attacks selectively on particular flows, or it could PCN-mark the correct fraction overall, but carefully choose which flows it marked. o the PCN-boundary-nodes should be able to deal with DoS attacks and state exhaustion attacks based on fast changes in per flow signalling.othe signalling between the PCN-boundary-nodesS1: Benefits: added one about provisioning (andpossibly a central control node) must be protected from attacks. For example the recipient needs to validatecontrast with DiffServ SLAs) o S1: Benefits: clarified that themessageobjective isindeed from the node that claimsalso tohave sent it. Possible measures include digest authenticationstop PCN- packets being significantly delayed (previously only mentioned not dropping pkts) o S1: Deployment models: added one where policing is done at ingress of acess network andprotection against replaynot at ingress of PCN-domain (assume trust between networks) o S1: Deployment models: corrected MPLS-TE to MPLS o S2: Terminology: adjusted definition of PCN-domain o S3.5: Other assumptions: corrected, so that two assumptions (PCN- nodes not performing ECN andman-in- the-middle attacks. ForPCN-ingress-node discarding arriving CE packet) only apply if thespecific protocol RSVP, hop-by-hop authentication isPCN WG decides to encode PCN-marking in[RFC2747],the ECN-field. o S4 & S5: changed PCN-marking algorithm to marking behaviour o S4: clarified that PCN-interior-node functionality applies for each outgoing interface, and[I-D.behringer-tsvwg-rsvp-security-groupkeying] mayadded clarification: "The functionality is alsobe useful;done by PCN-ingress-nodes fora generic signalling protocoltheir outgoing interfaces (ie those 'inside' the PCN-domain)." o S4 (near end): altered to say that a PCN-node "should" dedicate some capacity to lower priority traffic so that it isn't starved (was "may") o S5: clarified to say that PCNWG documentfunctionality is done on"Requirements for signalling" will describean 'interface' (rather than on a 'link') o S5.2: deleted erroneous mention of service level agreement o S5.5: Probing: re-written, especially to distinguish probing to test therequirementsingress-egress-aggregate from probing to test a particular ECMP path. o S5.7: Addressing: added mention of probing; added that inmore detail. 10. Conclusions {ToDo:} 11. Acknowledgements This documentthe case where traffic is always tunnelled across the PCN-domain, add arevised version of [I-D.eardley-pcn-architecture]. Its authors were: P. Eardley, J. Babiarz, K. Chan, A. Charny, R. Geib, G. Karagiannis, M. Menth, T. Tsou. They are therefore contributorsnote that he PCN-ingress-node needs tothis document. Thanksknow the address of the PCN-egress-node. o S5.8: Tunnelling: re-written, especially tothose who've made commentsprovide a clearer description of copying on[I-D.eardley-pcn-architecture]: Bob Briscoe, Michael Menth, Lars Eggert, Steven Blake, Tina Tsou, Tom Taylor, Ruediger Geib, Joetunnel entry/exit, by adding explanation (keeping tunnel encaps/decaps and PCN-marking orthogonal), Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page27]31] Internet-Draft DocumentAugustOctober 2007Babiarz, Anna Charny, Joachim Charzinski, Georgios Karagiannis. This document is the result of discussions indeleting one bullet ("if thePCN WGinner header's marking state is more sever then it is preserved" - shouldn't happen), andforerunner activity in the TSVWG. A number of previous drafts were presented to TSVWG: [I-D.chan-pcn-problem-statement], [I-D.briscoe-tsvwg-cl-architecture], [I-D.briscoe-tsvwg-cl-phb], [I-D.charny-pcn-single-marking], [I-D.babiarz-pcn-sip-cap], [I-D.lefaucheur-rsvp-ecn]. The authorsbetter referencing ofthem were: B, Briscoe, P. Eardley, D. Songhurst, F. Le Faucheur, A. Charny, J. Babiarz, K. Chan, S. Dudley, G. Karagiannis, A. Bader, L. Westberg, J. Zhang, V. Liatsos, X-G. Liu. 12. Comments Solicited Comments and questionsother IETF documents. o S6: Open issues: stressed that "NOTE: Potential solutions areencouragedout of scope for this document" andvery welcome. They can be addressededited a couple of sentences that were close to solution space. o S6: Open issues: added one about scenarios with only one tunnel endpoint in theIETFPCNworking group mailing list <pcn@ietf.org>. 13.domain . o S6: Open issues: ECMP: added under-admission as another potential risk o S6: Open issues: added one about "Silent at start" o S10: Conclusions: a small conclusions section added. 14. References13.1.14.1. Normative References [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, March 1997.13.2.14.2. Informative References [I-D.briscoe-tsvwg-cl-architecture] Briscoe, B., "An edge-to-edge Deployment Model for Pre- Congestion Notification: Admission Control over a DiffServ Region", draft-briscoe-tsvwg-cl-architecture-04 (work in progress), October 2006. [I-D.briscoe-tsvwg-cl-phb] Briscoe, B., "Pre-Congestion Notification marking", draft-briscoe-tsvwg-cl-phb-03 (work in progress), October 2006. [I-D.charny-pcn-single-marking] Charny, A., "Pre-Congestion Notification Using Single Marking for Admission and Termination", draft-charny-pcn-single-marking-02 (work in progress), July 2007. [I-D.ietf-tsvwg-admitted-realtime-dscp] Baker, F., "DSCPs for Capacity-Admitted Traffic", draft-ietf-tsvwg-admitted-realtime-dscp-01 (work in Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page28]32] Internet-Draft DocumentAugustOctober 2007 progress), March 2007. [I-D.babiarz-pcn-sip-cap] Babiarz, J., "SIP Controlled Admission and Preemption", draft-babiarz-pcn-sip-cap-00 (work in progress), October 2006. [I-D.ietf-tsvwg-ecn-mpls] Davie, B., "Explicit Congestion Marking in MPLS", draft-ietf-tsvwg-ecn-mpls-01 (work in progress), June 2007. [I-D.lefaucheur-rsvp-ecn] Faucheur, F., "RSVP Extensions for Admission Control over Diffserv using Pre-congestion Notification (PCN)", draft-lefaucheur-rsvp-ecn-01 (work in progress), June 2006. [I-D.chan-pcn-problem-statement] Chan, K., "Pre-Congestion Notification Problem Statement", draft-chan-pcn-problem-statement-01 (work in progress), October 2006. [I-D.ietf-pwe3-congestion-frmwk] Bryant, S., "Pseudowire Congestion Control Framework", draft-ietf-pwe3-congestion-frmwk-00 (work in progress), February 2007. [I-D.briscoe-tsvwg-ecn-tunnel]"","Layered Encapsulation of Congestion Notification", June 2007, <http://www.watersprings.org/pub/id/ briscoe-tsvwg-ecn-tunnel-00.txt>. [I-D.briscoe-re-pcn-border-cheat]"", <http://www.watersprings.org/pub/id/ briscoe-re-pcn-border-cheat-00.txt>. [I-D.behringer-tsvwg-rsvp-security-groupkeying] "","Emulating Border Flow Policing using Re-ECN on Bulk Data", June 2006, <http://www.watersprings.org/pub/id/behringer-tsvwg-rsvp-security-groupkeying-00.txt>.briscoe-re-pcn-border-cheat-01.txt>. [I-D.eardley-pcn-architecture]"", <http://www.watersprings.org/pub/id/"Pre-Congestion Notification Architecture", June 2007, <ht tp://www.watersprings.org/pub/id/ draft-eardley-pcn-architecture-00.txt>.[I-D.chan-pcn-encoding-comparison] "", <http://www.watersprings.org/pub/id/ draft-chan-pcn-encoding-comparison-00.txt>.[I-D.westberg-pcn-load-control] "LC-PCN: The Load Control PCN Solution", August 2007, <htt p://www.watersprings.org/pub/id/ draft-westberg-pcn-load-control-01.txt>. Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page29]33] Internet-Draft DocumentAugustOctober 2007[RFC4774] Floyd, S., "Specifying Alternate Semantics[I-D.behringer-tsvwg-rsvp-security-groupkeying] "A Framework forthe Explicit Congestion Notification (ECN) Field", BCP 124,RSVP Security Using Dynamic Group Keying", June 2007, <http://www.watersprings.org/pub/id/ draft-behringer-tsvwg-rsvp-security-groupkeying-00.txt>. [RFC4303] Kent, S., "IP Encapsulating Security Payload (ESP)", RFC4774, November 2006.4303, December 2005. [RFC2475] Blake, S., Black, D., Carlson, M., Davies, E., Wang, Z., and W. Weiss, "An Architecture for Differentiated Services", RFC 2475, December 1998. [RFC3246] Davie, B., Charny, A., Bennet, J., Benson, K., Le Boudec, J., Courtney, W., Davari, S., Firoiu, V., and D. Stiliadis, "An Expedited Forwarding PHB (Per-Hop Behavior)", RFC 3246, March 2002. [RFC4594] Babiarz, J., Chan, K., and F. Baker, "Configuration Guidelines for DiffServ Service Classes", RFC 4594, August 2006. [RFC3168] Ramakrishnan, K., Floyd, S., and D. Black, "The Addition of Explicit Congestion Notification (ECN) to IP", RFC 3168, September 2001. [RFC2211] Wroclawski, J., "Specification of the Controlled-Load Network Element Service", RFC 2211, September 1997. [RFC2998] Bernet, Y., Ford, P., Yavatkar, R., Baker, F., Zhang, L., Speer, M., Braden, R., Davie, B., Wroclawski, J., and E. Felstaine, "A Framework for Integrated Services Operation over Diffserv Networks", RFC 2998, November 2000. [RFC3270] Le Faucheur, F., Wu, L., Davie, B., Davari, S., Vaananen, P., Krishnan, R., Cheval, P., and J. Heinanen, "Multi- Protocol Label Switching (MPLS) Support of Differentiated Services", RFC 3270, May 2002. [RFC1633] Braden, B., Clark, D., and S. Shenker, "Integrated Services in the Internet Architecture: an Overview", RFC 1633, June 1994. [RFC2983] Black, D., "Differentiated Services and Tunnels", RFC 2983, October 2000. [RFC2747] Baker, F., Lindell, B., and M. Talwar, "RSVP Cryptographic Authentication", RFC 2747, January 2000. Eardley (Editor) Expires April 28, 2008 [Page 34] Internet-Draft Document October 2007 [ITU-MLPP] "Multilevel Precedence and Pre-emption Service (MLPP)", ITU-T Recommendation I.255.3, 1990.Eardley (Editor) Expires February 9, 2008 [Page 30] Internet-Draft Document August 2007[Iyer] "An approach to alleviate link overload as observed on an IP backbone", IEEE INFOCOM , 2003, <http://www.ieee-infocom.org/2003/papers/10_04.pdf>. [Shenker] "Fundamental design issues for the future Internet", IEEE Journal on selected areas in communications pp 1176 - 1188, Vol 13 (7), 1995. [Songhurst] "Guaranteed QoS Synthesis for Admission Control with Shared Capacity", BT Technical Report TR-CXR9-2006-001, Feburary 2006, <http://www.cs.ucl.ac.uk/staff/B.Briscoe/ projects/ipe2eqos/gqs/papers/GQS_shared_tr.pdf>. Author's Address Philip Eardley BT B54/77, Sirius House Adastral Park Martlesham Heath Ipswich, Suffolk IP5 3RE United Kingdom Email: philip.eardley@bt.com Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page31]35] Internet-Draft DocumentAugustOctober 2007 Full Copyright Statement Copyright (C) The IETF Trust (2007). This document is subject to the rights, licenses and restrictions contained in BCP 78, and except as set forth therein, the authors retain all their rights. This document and the information contained herein are provided on an "AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY, THE IETF TRUST AND THE INTERNET ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Intellectual Property The IETF takes no position regarding the validity or scope of any Intellectual Property Rights or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; nor does it represent that it has made any independent effort to identify any such rights. Information on the procedures with respect to rights in RFC documents can be found in BCP 78 and BCP 79. Copies of IPR disclosures made to the IETF Secretariat and any assurances of licenses to be made available, or the result of an attempt made to obtain a general license or permission for the use of such proprietary rights by implementers or users of this specification can be obtained from the IETF on-line IPR repository at http://www.ietf.org/ipr. The IETF invites any interested party to bring to its attention any copyrights, patents or patent applications, or other proprietary rights that may cover technology that may be required to implement this standard. Please address the information to the IETF at ietf-ipr@ietf.org. Acknowledgment Funding for the RFC Editor function is provided by the IETF Administrative Support Activity (IASA). Eardley (Editor) ExpiresFebruary 9,April 28, 2008 [Page32]36] ----