view Side-By-Side changes
Congestion and Pre-Congestion Philip. Eardley (Editor) Notification Working Group BT Internet-DraftFebruary 8,July 14, 2008 Intended status: Informational Expires:August 11, 2008January 15, 2009 Pre-Congestion Notification Architecturedraft-ietf-pcn-architecture-03draft-ietf-pcn-architecture-04 Status of this Memo By submitting this Internet-Draft, each author represents that any applicable patent or other IPR claims of which he or she is aware have been or will be disclosed, and any of which he or she becomes aware will be disclosed, in accordance with Section 6 of BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF), its areas, and its working groups. Note that other groups may also distribute working documents as Internet- Drafts. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." The list of current Internet-Drafts can be accessed at http://www.ietf.org/ietf/1id-abstracts.txt. The list of Internet-Draft Shadow Directories can be accessed at http://www.ietf.org/shadow.html. This Internet-Draft will expire onAugust 11, 2008.January 15, 2009. Copyright Notice Copyright (C) The IETF Trust (2008). Abstract The purpose of this document is to describe a general architecture for flow admission and termination based on pre-congestion information in order to protect the quality of service of established inelastic flows within a single DiffServ domain. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page 1] Internet-Draft DocumentFebruaryJuly 2008 Status Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 4 2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . .75 3. Benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 4. Deployment scenarios . . . . . . . . . . . . . . . . . . . . . 8 5. Assumptions and constraints on scope . . . . . . . . . . . . .9 3.1.10 5.1. Assumption 1: Trust and support of PCN - controlled environment . . . . . . . . . . . . . . . . . . . . . . .9 3.2.11 5.2. Assumption 2: Real-time applications . . . . . . . . . . .10 3.3.11 5.3. Assumption 3: Many flows and additional load . . . . . . .10 3.4.12 5.4. Assumption 4: Emergency use out of scope . . . . . . . . .11 3.5. Other assumptions12 6. High-level functional architecture . . . . . . . . . . . . . . 12 6.1. Flow admission . . . . . . .11 4. High-level functional architecture. . . . . . . . . . . . . .11 4.1. Flow admission. 14 6.2. Flow termination . . . . . . . . . . . . . . . . . . . . .12 4.2.15 6.3. Flow admission and flow termination when there are only two PCN encoding states . . . . . . . . . . . . . . . 16 6.4. Information transport . . . . . .13 4.3. Flow admission and flow termination. . . . . . . . . . .14 4.4. Information transport. 16 6.5. PCN-traffic . . . . . . . . . . . . . . . . .15 4.5. PCN-traffic. . . . . . 17 6.6. Backwards compatibility . . . . . . . . . . . . . . . . .15 5.17 7. Detailed Functional architecture . . . . . . . . . . . . . . .16 5.1.18 7.1. PCN-interior-node functions . . . . . . . . . . . . . . .17 5.2.19 7.2. PCN-ingress-node functions . . . . . . . . . . . . . . . .17 5.3.19 7.3. PCN-egress-node functions . . . . . . . . . . . . . . . .18 5.4.20 7.4. Other admission control functions . . . . . . . . . . . .19 5.5.20 7.5. Other flow termination functions . . . . . . . . . . . . .19 5.6.21 7.6. Addressing . . . . . . . . . . . . . . . . . . . . . . . .20 5.7.22 7.7. Tunnelling . . . . . . . . . . . . . . . . . . . . . . . .21 5.8.23 7.8. Fault handling . . . . . . . . . . . . . . . . . . . . . .22 6.24 8. Design goals and challenges . . . . . . . . . . . . . . . . .23 7. Probing .24 9. Operations and Management . . . . . . . . . . . . . . . . . . 27 9.1. Configuration OAM . . . . . . . .25 7.1. Introduction. . . . . . . . . . . . 27 9.1.1. System options . . . . . . . . . . .25 7.2. Probing functions. . . . . . . . . 28 9.1.2. Parameters . . . . . . . . . . .26 7.3. Discussion of rationale for probing, its downsides and open issues. . . . . . . . . . . 29 9.2. Performance & Provisioning OAM . . . . . . . . . . . .27 8. Operations and Management. . 31 9.3. Accounting OAM . . . . . . . . . . . . . . . .30 8.1. Configuration OAM. . . . . . 32 9.4. Fault OAM . . . . . . . . . . . . . .30 8.1.1. System options. . . . . . . . . . 32 9.5. Security OAM . . . . . . . . . .31 8.1.2. Parameters. . . . . . . . . . . . . 33 10. IANA Considerations . . . . . . . . .31 8.2. Performance & Provisioning OAM. . . . . . . . . . . . 34 11. Security considerations . .33 8.3. Accounting OAM. . . . . . . . . . . . . . . . . 34 12. Conclusions . . . . .34 8.4. Fault OAM. . . . . . . . . . . . . . . . . . . . 35 13. Acknowledgements . . . .34 8.5. Security OAM. . . . . . . . . . . . . . . . . . . 35 14. Comments Solicited . . . .35 9. IANA Considerations. . . . . . . . . . . . . . . . . . 36 15. Changes . . .36 10. Security considerations. . . . . . . . . . . . . . . . . . .36 11. Conclusions. . . . . 36 15.1. Changes from -03 to -04 . . . . . . . . . . . . . . . . . 36 Eardley (Editor) Expires January 15, 2009 [Page 2] Internet-Draft Document July 2008 15.2. Changes from -02 to -03 . . . . . . . . . . .37 12. Acknowledgements. . . . . . 37 15.3. Changes from -01 to -02 . . . . . . . . . . . . . . . . . 3813. Comments Solicited15.4. Changes from -00 to -01 . . . . . . . . . . . . . . . . . 39 16. Appendix A: Possible work items beyond the scope of the current PCN WG Charter . . . . .38 Eardley (Editor) Expires August 11, 2008 [Page 2] Internet-Draft Document February 2008 14. Changes. . . . . . . . . . . . . . . 40 17. Appendix B: Probing . . . . . . . . . . . .38 14.1. Changes from -02 to -03. . . . . . . . . 42 17.1. Introduction . . . . . . . .38 14.2. Changes from -01 to -02. . . . . . . . . . . . . . . 42 17.2. Probing functions . .39 14.3. Changes from -00 to -01. . . . . . . . . . . . . . . . .40 15. Appendix A: Possible work items beyond the scope. 43 17.3. Discussion ofthe current PCN WG Charterrationale for probing, its downsides and open issues . . . . . . . . . . . . . . . . . . . .42 16.. . . 43 18. Informative References . . . . . . . . . . . . . . . . . . . .4446 Author's Address . . . . . . . . . . . . . . . . . . . . . . . . .4751 Intellectual Property and Copyright Statements . . . . . . . . . .4852 Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page 3] Internet-Draft DocumentFebruaryJuly 2008 1. Introduction The purpose of this document is to describe a general architecture for flow admission and termination based on (pre-) congestion information in order to protect the quality of service of flows within a DiffServ domain [RFC2475]. This document defines an architecture for implementing two mechanisms to protect the quality of service of established inelastic flows within a single DiffServ domain, where all boundary and interior nodes are PCN-enabled and trust each other for correct PCN operation. Flow admission control determines whether a new flow should be admitted, in order to protect the QoS of existing PCN-flows in normal circumstances. However, in abnormal circumstances, for instance a disaster affecting multiple nodes and causing traffic re-routes, then the QoS on existing PCN- flows may degrade even though care was exercised when admitting thoseflows before those circumstances.flows. Therefore we also propose a mechanism for flow termination, which removes enough traffic in order to protect the QoS of the remaining PCN-flows. As a fundamental building block to enable these two mechanisms, PCN- interior-nodes generate, encode and transport pre-congestion information towards the PCN-egress-nodes. Two rates, aPCN-lower- ratePCN- threshold-rate and aPCN-upper-rate, can bePCN-excess-rate, are associated with each link of the PCN-domain. Each rate is used by a marking behaviour(specified in another document)that determines how and whena number of PCN- packetsPCN-packets are marked, and how the markings are encoded in packet headers.PCN-egress-nodes make measurements of the packet markings and send information as necessary to the nodes that make the decision about which PCN-flows to accept/reject or terminate, based on this information. Another document will describe the decision-making behaviours.Overall the aim is to enablePCN-nodesPCN- nodes to give an "early warning" of potential congestion before there is any significant build-up of PCN-packets in thequeue; thequeue. PCN-boundary-nodes convert measurements of these PCN-markings into decisions about flow admission and termination. The admission control mechanism limits the PCN-traffic on each link to *roughly* itsPCN-lower-ratePCN-threshold-rate and the flow termination mechanism limits the PCN-traffic on each link to *roughly* itsPCN-upper-rate. We believe that the key benefits ofPCN-excess-rate. This document describes the PCNmechanisms described in this document are that they are simple, scalable,architecture androbust because: o Per flow stateoutlines some benefits, deployment scenarios, assumptions and terminology for PCN. The behaviour of PCN-interior-nodes isonly required atstandardised in three documents, which are summarised in this document.[I-D.eardley-pcn-marking-behaviour] standardises thePCN-ingress-nodes ("stateless core"). This is required for policing purposes (to prevent non-admitted PCNtwo marking behaviours of PCN-nodes: threshold marking and excess trafficfrom enteringmarking. Threshold marking marks all PCN-packets if thePCN-domain) and so on. ItPCN traffic rate isnot generally requiredgreater than a first configured rate, "PCN-threshold-rate". Excess traffic marking marks a proportion of PCN-packets, such thatother network entities are awarethe amount marked equals the traffic rate in excess ofindividual flows (although they may bea second configured rate, "PCN-excess-rate". PCN encoding uses a combination of the DSCP field and ECN field inparticular deployment scenarios).the IP header to indicate that a packet is a PCN-packet and whether it is PCN-marked. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page 4] Internet-Draft DocumentFebruaryJuly 2008o Admission control is resilient: PCN's QoS is decoupled from the routing system; hence in general admitted flows can survive capacity, routing or topology changes without additional signalling,[I-D.moncaster-pcn-baseline-encoding] standardises two PCN encoding states (PCN-marked andthey don't have to be told (or learn) about such changes. The PCN-lower-rates can be chosen small enough that admitted traffic can still be carried after a rerouting in most failure cases [Menth]. This isnot PCN-marked) whilst [I-D.moncaster-pcn-3-state-encoding] standardises animportant feature as QoS violations in core networks due to link failures are more likely than QoS violations due to increased traffic volume [Iyer]. o The PCN-marking behaviours only operate onextended scheme with three encoding states (threshold-marked, excess-traffic-marked, not PCN-marked) but requires an extra DiffServ codepoint. PCN therefore defines semantics for theoverall PCN-traffic onECN field different from thelink, not per flow. o The informationdefault semantics ofthese measurements is signalled[RFC3168]; PCN's encoding has been chosen to meet the guidelines of BCP124, [RFC4774]. The behaviour of PCN-egress-nodes by the PCN-marks in the packet headers, ie "in-band". No additional signalling protocol is required for transporting the PCN-marks. Therefore no secure bindingboundary-nodes isrequired between data packetsdescribed in Informational documents. Several possibilities are outlined in this document; detailed descriptions andseparate congestion messages.comparisons are in [I-D.charny-pcn-comparison] and [Menth08]. 2. Terminology oThe PCN-egress-nodes make separate measurements, operating on the aggregate PCN-traffic from each PCN-ingress-node, ie not per flow. Similarly, signalling byPCN-domain: a PCN-capable domain; a contiguous set of PCN-enabled nodes that perform DiffServ scheduling; thePCN-egress-nodecomplete set ofPCN-feedback- information (which is used forPCN- nodes whose PCN-marking can in principle influence decisions about flow admission and terminationdecisions) is at the granularity offor theingress-egress-aggregate. An alternative approach is thatPCN-domain, including the PCN-egress-nodesmonitor the PCN-traffic and signal PCN-feedback-information (which is used for flow admission and termination decisions) at the granularity ofwhich measure these PCN-marks. o PCN-boundary-node: a PCN-node that connects one(orPCN-domain to afew) PCN-marks.node either in another PCN-domain or in a non PCN-domain. oThe admitted PCN-loadPCN-interior-node: a node in a PCN-domain that iscontrolled dynamically. Thereforenot a PCN- boundary-node. o PCN-node: a PCN-boundary-node or a PCN-interior-node o PCN-egress-node: a PCN-boundary-node in its role in handling traffic as itadaptsleaves a PCN-domain. o PCN-ingress-node: a PCN-boundary-node in its role in handling traffic astheit enters a PCN-domain. o PCN-traffic, PCN-packets, PCN-BA: a PCN-domain carries trafficmatrix changes,of different DiffServ behaviour aggregates (BAs) [RFC2475]. The PCN-BA uses the PCN mechanisms to carry PCN-traffic andalso ifthe corresponding packets are PCN-packets. The same networktopology changes (eg afterwill carry traffic of other DiffServ BAs. The PCN-BA is distinguished by alink failure). Hence an operator can be less conservative when deploying network capacity, and less accurate in their predictioncombination of thePCN-traffic matrix. o The termination mechanism complements admission control. It allowsDiffServ codepoint (DSCP) and ECN fields; note that a packet that shares thenetwork to recover from sudden unexpected surges ofsame DSCP as PCN-trafficon some links, thus restoring QoS to the remaining flows. Such scenarios are expected to be rarebut its ECN field is 00 (Not ECT) is notimpossible. They can be caused by large network failures that redirect lots of admitted PCN-traffic to other links, or by malfunctionpart of themeasurement-based admission control inPCN-BA. o PCN-flow: thepresenceunit ofadmitted flowsPCN-traffic thatsend for a while with an atypically low rate and then increase their rates in a correlated way. o The PCN-upper-rate may be set belowthemaximum rate that PCN- traffic canPCN-boundary-node admits (or terminates); the unit could betransmitted onalink,single microflow (as defined inorder to trigger termination of[RFC2475]) or somePCN-flows before loss (or excessive delay)identifiable collection of microflows. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page 5] Internet-Draft DocumentFebruaryJuly 2008 o Ingress-egress-aggregate: The collection of PCN-packetsoccurs, or to keep the maximum PCN-load onfrom all PCN-flows that travel in one direction between alink belowspecific pair of PCN-boundary-nodes. o PCN-threshold-rate: alevelreference rate configured for each link in the PCN-domain, which is lower than the PCN-excess-rate. It is used by a marking behaviour that determines whether a packet should be PCN-marked with a first encoding, "threshold-marked". It's roughly theoperator.rate up to which PCN admission control should accept new flows. oProvisioning ofPCN-excess-rate: a reference rate configured for each link in thenetworkPCN-domain, which isdecoupled fromhigher than theprocess of adding new customers. By contrast,PCN-threshold-rate. It is used by a marking behaviour that determines whether a packet should be PCN-marked with a second encoding, "excess-traffic- marked". It's roughly that rate down to which flow termination should, if necessary, terminate already admitted flows. o Threshold-marking: a PCN-marking behaviour with theDiffServ architecture [RFC2475] operators rely on subscription-time Service Level Agreementsobjective thatstatically defineall PCN-traffic is marked if theparametersPCN-traffic exceeds the PCN- threshold-rate. o Excess-traffic-marking: a PCN-marking behaviour with the objective that the amount of PCN-traffic that is PCN-marked is equal to thetrafficamount thatwill be accepted fromexceeds the PCN-excess-rate. o Pre-congestion: acustomer, and socondition of a link within a PCN-domain in which theoperator hasPCN-node performs PCN-marking, in order torunprovide an "early warning" of potential congestion before there is any significant build-up of PCN-packets in the real queue. (Hence, by analogy with ECN we call our mechanism Pre-Congestion Notification.) o PCN-marking: theprovisioningprocesseach timeof setting the header in anew customer is addedPCN-packet based on defined rules, in reaction tocheckpre-congestion; either threshold-marking or excess-traffic-marking. o PCN-feedback-information: information signalled by a PCN-egress- node to a PCN-ingress-node or central control node, which is needed for the flow admission and flow termination mechanisms. 3. Benefits We believe that theService Level Agreement can be fulfilled. A PCN- domain doesn't need such traffic conditioning. Operatorskey benefits ofnetworks will want to usethe PCN mechanisms described invarious arrangements, for instance depending on how theythis document areperforming admission control outside the PCN-domain (users after allthat they areconcerned about QoS end-to-end), what their particular goals and assumptions are,simple, scalable, andso on. Several deployment models are possible:robust because: oAn operator may choose to deploy either admission control orPer flowtermination or both (see Section 4.3). o IntServ over DiffServ [RFC2998]. The DiffServ region is PCN- enabled and the PCN-domainstate isa single RSVP hop, ieonlythe PCN- boundary-nodes process RSVP messages. Outside the PCN-domain RSVP messages are processed on each hop. The case where RSVP signalling is used end-to-end is described in [I-D.briscoe-tsvwg-cl-architecture]; it would also be possible for the RSVP signalling to be originated and/or terminated by proxies, with application-layer signalling between the end user and the proxy (eg SIP signalling with a home hub). o Similar to previous bullet but NSIS signalling is used instead of RSVP. o Depending on the deployment scenario, the decision-making functionality (about flow admission and termination) could residerequired at the PCN-ingress-nodesor PCN-egress-nodes or (see Appendix) at some central control node in the PCN-domain. o There are several PCN-domains on the end-to-end path, each operating PCN mechanisms independently. o The PCN-domain extends to the end users. The scenario is described in [I-D.babiarz-pcn-sip-cap]. A variant("stateless core"). This isthat the PCN-domain extends out as far as the LAN edge switch. o The operator runs both the access network (not a PCN-domain) and the core network (a PCN-domain); per flowrequired for policingis devolved topurposes (to Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page 6] Internet-Draft DocumentFebruaryJuly 2008 prevent non-admitted PCN traffic from entering theaccess networkPCN-domain) and so on. It is notdone at the PCN-ingress-node. Note: to aid readability, the rest of this draft assumesgenerally required thatpolicing is done by the PCN-ingress-nodes. o Pseudowire: PCNother network entities are aware of individual flows (although they may beused as a congestion avoidance mechanism for edge to edge pseudowire emulations [I-D.ietf-pwe3-congestion-frmwk].in particular deployment scenarios). oMPLS: [RFC3270] defines how to supportAdmission control is resilient: PCN's QoS is decoupled from theDiffServ architecturerouting system; hence inMPLS networks. [RFC5129] describes howgeneral admitted flows can survive capacity, routing or topology changes without additional signalling, and they don't have toadd PCN for admission control of microflows intobe told (or learn) about such changes. The PCN-threshold-rate on each PCN-node can be chosen small enough that admitted traffic can still be carried after aset of MPLS aggregates (Multi-protocol label switching). PCN-markingrerouting in most failure cases [Menth]. This isdonean important feature as QoS violations inMPLS's EXP field. o Similarly, it may be possiblecore networks due toextend PCN into Ethernet networks, wherelink failures are more likely than QoS violations due to increased traffic volume [Iyer]. o The PCN-markingis done inbehaviours only operate on theEthernet header. NOTE: Specific considerationoverall PCN-traffic on the link, not per flow. o The information ofthis extensionthese measurements isoutsidesignalled to theIETF's remit. FromPCN- egress-nodes by theperspective ofPCN-marks in theoutside world, a PCN-domain essentially looks like a DiffServ domain. PCN-trafficpacket headers, ie "in-band". No additional signalling protocol iseither transported across it transparently or policed atrequired for transporting thePCN-ingress-node (ie dropped or carried at a lower QoS). A couple of differences are that:PCN-marks. Therefore no secure binding is required between data packets and separate congestion messages. o The PCN-egress-nodes make separate measurements, operating on the aggregate PCN-traffichas better QoS guarantees than normal DiffServ traffic (because PCN's mechanisms better protectfrom each PCN-ingress-node, ie not per flow. Similarly, signalling by theQoSPCN-egress-node ofadmitted flows);PCN-feedback- information (which is used for flow admission andin rare circumstances (failures), on the one hand some PCN-flows may get terminated, but on the other hand other flows will get their QoS restored. Non PCN-traffictermination decisions) istreated transparently, ieat thePCN-domain is a normal DiffServ domain. 2. Terminology o PCN-domain: a PCN-capable domain; a contiguous setgranularity ofPCN-enabled nodesthe ingress-egress-aggregate. An alternative approach is thatperform DiffServ scheduling;thecompete set of PCN- nodes whose PCN-marking can in principle influence decisions aboutPCN-egress-nodes monitor the PCN-traffic and signal PCN-feedback-information (which is used for flow admission and terminationfor the PCN-domain, includingdecisions) at thePCN-egress-nodes which measure these PCN-marks. o PCN-boundary-node: a PCN-node that connectsgranularity of onePCN-domain to a node either in another PCN-domain or in(or anon PCN-domain.few) PCN-marks. oPCN-interior-node: a node in a PCN-domain thatThe admitted PCN-load isnot a PCN- boundary-node. o PCN-node: a PCN-boundary-node or a PCN-interior-node Eardley (Editor) Expires August 11, 2008 [Page 7] Internet-Draft Document February 2008 o PCN-egress-node: a PCN-boundary-node in its role in handling traffic ascontrolled dynamically. Therefore itleaves a PCN-domain. o PCN-ingress-node: a PCN-boundary-node in its role in handling trafficadapts asit enters a PCN-domain. o PCN-traffic: A PCN-domain carries traffic of different DiffServ behaviour aggregates [RFC2475]. Those usingthePCN mechanisms are called PCN-BAs (collectively called PCN-traffic)traffic matrix changes, and also if thecorresponding packets are PCN-packets. The samenetworkmay carry traffic using other DiffServ BAs. A PCN-flow is the unit of PCN- traffic that the PCN-boundary-node admits (or terminates); the unit could betopology changes (eg after asingle microflow (as definedlink failure). Hence an operator can be less conservative when deploying network capacity, and less accurate in[RFC2475]) or some identifiable collectiontheir prediction ofmicroflows.the PCN-traffic matrix. oIngress-egress-aggregate:Thecollection of PCN-packetstermination mechanism complements admission control. It allows the network to recover fromall PCN-flowssudden unexpected surges of PCN-traffic on some links, thus restoring QoS to the remaining flows. Such scenarios are expected to be rare but not impossible. They can be caused by large network failures thattravel in one direction between a specific pairredirect lots of admitted PCN-traffic to other links, or by malfunction ofPCN-boundary-nodes. o PCN-lower-rate: a reference rate configured for each link inthePCN-domain, which is lower thanmeasurement-based admission control in thePCN-upper-rate. It is used by a marking behaviourpresence of admitted Eardley (Editor) Expires January 15, 2009 [Page 7] Internet-Draft Document July 2008 flows thatdetermines whethersend for apacket should be PCN-markedwhile with an atypically low rate and then increase their rates in afirst encoding.correlated way. oPCN-upper-rate: a reference rate configured for each linkFlow termination can also enable an operator to be less conservative when deploying network capacity. It is an alternative to running links at low utilisation inthe PCN-domain, whichorder to protect against link or node failures. This ishigher thanespecially thePCN-lower-rate. It is used by a marking behaviour that determines whether a packet should be PCN-markedcase with SRLGs (shared risk link groups, which are links that share asecond encoding. o Threshold-marking: a PCN-marking behaviourresource, suchthat all PCN- traffic is marked if the PCN-traffic exceeds a particular rate (either the PCN-lower-rate or PCN-upper-rate). NOTE: The definition reflects the overall intent rather than its instantaneous behaviour, since the rate measured at a particular moment depends on the behaviour, its implementation and the traffic's variance as wellasits rate. o Excess-rate-marking:aPCN-marking behaviour such that the amount of PCN-traffic that is PCN-marked is equalfibre, whose failure affects all those links [RFC4216]. A requirement tothe amount that exceedsfully protect traffic against aparticular rate (eithersingle SRLG failure requires low utilisation (~10%) of thePCN-lower-rate or PCN-upper- rate). NOTE:link bandwidth on some links before failure [PCN-email-SRLG]. o Thedefinition reflects the overall intent rather than its instantaneous behaviour, sincePCN-excess-rate may be set below the maximum ratemeasured at a particular moment dependsthat PCN- traffic can be transmitted onthe behaviour, its implementation and the traffic's variance as well as its rate. o Pre-congestion:acondition of a link within a PCN-domain in which the PCN-node performs PCN-marking,link, in order toprovide an "early warning"trigger termination ofpotential congestionsome PCN-flows beforethere is any significant Eardley (Editor) Expires August 11, 2008 [Page 8] Internet-Draft Document February 2008 build-uploss (or excessive delay) of PCN-packetsinoccurs, or to keep thereal queue. (Hence,maximum PCN-load on a link below a level configured byanalogy with ECN we call our mechanism Pre-Congestion Notification.)the operator. oPCN-marking:Provisioning of the network is decoupled from the process ofsettingadding new customers. By contrast, with theheader in a PCN-packet basedDiffServ architecture [RFC2475] operators rely ondefined rules, in reaction to pre-congestion. o PCN-feedback-information: information signalled by a PCN-egress- node to a PCN-ingress-node or central control node, which is needed forsubscription-time Service Level Agreements that statically define theflow admission and flow termination mechanisms. 3. Assumptions and constraints on scope The scopeparameters ofPCN is, at least initially (see Appendix A), restricted bythefollowing assumptions: 1. these components are deployed intraffic that will be accepted from asingle DiffServ domain, within which all PCN-nodes are PCN-enabled and trust each other for truthful PCN-marking and transport 2. all flows handled by these mechanisms are inelasticcustomer, andconstrainedso the operator has toa known peak rate through policing or shaping 3.run thenumber of PCN-flows across any potential bottleneck linkprovisioning process each time a new customer issufficiently largeadded to check thatstateless, statistical mechanismsthe Service Level Agreement can beeffective. To put it another way, the aggregate bit rate offulfilled. A PCN- domain doesn't need such trafficacross any potential bottleneck link needs to be sufficiently large relative to the maximum additional bit rate added by one flow. This is the basic assumption of measurement- based admission control.conditioning. 4.PCN-flows may have different precedence, but the applicabilityDeployment scenarios Operators of networks will want to use the PCN mechanisms in various arrangements, foremergency use (911, GETS, WPS, MLPP, etc.) is out of scope. 3.1. Assumption 1: Trust and support of PCN - controlled environment We assume thatinstance depending on how they are performing admission control outside the PCN-domainis a controlled environment, i.e.(users after all are concerned about QoS end-to-end), what their particular goals and assumptions are, how many PCN encoding states are available, and so on. From thenodes inperspective of the outside world, a PCN-domainrun PCN and trust each other. There are several reasons for proposing this assumption: o The PCN-domain has to be encircled byessentially looks like aringDiffServ domain. PCN-traffic is either transported across it transparently or policed at the PCN-ingress-node (ie dropped or carried at a lower QoS). A couple ofPCN-boundary- nodes, otherwisedifferences are that: PCN-traffic has better QoS guarantees than normal DiffServ trafficcould enter a PCN BA without being subject to admission control, which would potentially degrade(because PCN's mechanisms better protect the QoS ofexisting PCN-flows. o Similarly, a PCN-boundary-node has to trust that alladmitted flows); and in rare circumstances (failures), on thePCN-nodes markone hand some PCN-flows may get terminated, but on the other hand other flows will get their QoS restored. Non PCN-trafficconsistently. A node not doing PCN-markingis treated transparently, ie the PCN-domain is a normal DiffServ domain. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page9]8] Internet-Draft DocumentFebruaryJuly 2008wouldn't be ableAn operator may choose toalert when it suffered pre-congestion, which potentially would leaddeploy either admission control or flow termination or both. Although designed totoo many PCN-flows being admitted (or too few being terminated). Worse, a rogue node could perform various attacks, as discussed inwork together, they are independent mechanisms, and theSecurity Considerations section. One wayuse ofassuringone does not require or prevent theabove two points is thatuse of theentire PCN- domain is runother. For example, an operator could use just PCN's admission control, solving heavy congestion (caused bya single operator. Another possibility is that there are several operators but they trust each otherre-routing) by 'just waiting' - as sessions end, PCN-traffic naturally reduces, and meanwhile the admission control mechanism will prevent admission of new flows that use the affected links. So the PCN-domain will naturally return toa sufficient level, in their handlingnormal operation, but with reduced capacity. The drawback ofPCN-traffic. Note: All PCN-nodes needthis approach would be that until PCN-traffic naturally departs to relieve the congestion, all PCN-flows as well as lower priority services will betrustworthy. However if it's knownadversely affected. Another example is that aninterface cannot become pre-congested then it's not strictly necessaryoperator could just rely forit to be capableadmission control on statically provisioned capacity per PCN-ingress-node (regardless ofPCN-marking. But this must be known even in unusual circumstances, eg afterthefailure of some links. 3.2. Assumption 2: Real-time applications We assume that any variationPCN-egress-node ofsource bit ratea flow), as isindependent oftypical in thelevelhose model ofpre-congestion. We assume that PCN-packets come from real time applications generating inelastic traffic [Shenker] like voice and video requiring low delay, jitter and packet loss, for example the Controlled Load Service, [RFC2211], andtheTelephony service class, [RFC4594]. This assumption isDiffServ architecture [RFC2475]. Such traffic conditioning agreements can lead to focused overload: many flows happen tohelpfocus on a particular link and then all flows through theeffort where it looks like PCN wouldcongested link fail catastrophically. PCN's flow termination mechanism could then bemost useful, ie the sortsused to counteract such a problem. The possibility ofapplications where perdeploying just one of PCN's flowQoSadmission and termination mechanisms isa known requirement. In other words we focus oncertainly an option when only two PCNproviding a benefit to inelastic traffic (PCN may or mayencoding states are available (PCN-marked and notprovide a benefit to other types of traffic). For instance, the impact ofPCN-marked), as in [I-D.moncaster-pcn-baseline-encoding]. Another option in thisassumption would becircumstance is toguide simulations work. 3.3. Assumption 3: Many flowstrigger both admission control andadditional load We assume that there are many PCN-flows on any bottleneck link in the PCN-domain (or, to put it another way,flow termination from theaggregate bit ratesingle type ofPCN- traffic across any potential bottleneck link is sufficiently large relative toPCN-marking; themaximum additional bit rate added by one PCN-flow). Measurement-basedmain downside is that admission controlassumes thatis less accurate. Within thepresentPCN-domain there isa reasonable prediction ofsome flexibility about where thefuture:decision making functionality is located. For admission control, thenetwork conditions are measured atmost natural place is thetime of a newPCN-ingress-node. For flowrequest, howevertermination, whether theactual network performance must be OK duringPCN-ingress-node or PCN-egress-node is more natural depends on thecall some time later. One issuemechanism used to convert packet markings into a flow termination decision. These possibilities are outlined more later and also discussed elsewhere, such as in [Menth08]. Another possibility is thatif there are only a few variable rate flows, thentheaggregate traffic level may vary a lot, perhaps enough to causedecision making functionality is at somepacketscentral control node. This is briefly discussed in Appendix A and described in [I-D.tsou-pcn-racf-applic]. The flow admission and termination decisions need toget dropped.be enforced through per-flow policing by the PCN-ingress-nodes. If there aremany flows then the aggregate traffic level should be statistically smoothed. How many flows is enough dependsseveral PCN-domains ona number of things such asthevariation inend-to-end path then eachflow's rate, the total rate of PCN-traffic, andneeds to police at its PCN-ingress-nodes. One exception is if thesize ofoperator runs both the"safety margin" betweenaccess network (not a PCN-domain) and thetraffic level at which we startcore network (a PCN- Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page10]9] Internet-Draft DocumentFebruaryJuly 2008admission-markingdomain); per flow policing could be devolved to the access network andat which packets are dropped or significantly delayed. We donotmake explicit assumptions on how many PCN-flows are in each ingress-egress-aggregate. Performance evaluation work may clarify whether it is necessary to make any additional assumption on aggregationdone at theingress-egress-aggregate level. 3.4. Assumption 4: Emergency use out of scope PCN-flows may have different precedence, butPCN-ingress-node. Note: to aid readability, theapplicabilityrest ofthe PCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc)this draft assumes that policing isout of scope for considerationdone by the PCN-ingress- nodes. PCNWG. 3.5. Other assumptions As a consequence of Assumption 2 above, it is assumed that PCN- marking is being appliedadmission control has totraffic scheduled with the expedited forwarding per-hop behaviour, [RFC3246], or trafficfit withsimilar characteristics. The following two assumptions apply ifthePCN WG decidesoverall approach toencode PCN-marking inadmission control. For instance [I-D.briscoe-tsvwg-cl-architecture] describes theECN-field. o It is assumed that PCN-nodes do not perform ECN, [RFC3168], on PCN-packets. o What to do if a packet thatcase where RSVP signalling runs end-to-end. The PCN- domain ispart ofaPCN-flow arrives at a PCN-ingress-nodesingle RSVP hop, ie only the PCN-boundary-nodes process RSVP messages, withits CE (Congestion experienced) codepoint set (or if it detects thatRSVP messages processed on each hop outside theECN-nonce in use). There are several possibilities (not discussed furtherPCN-domain, as inthis document) about whatIntServ over DiffServ [RFC2998]. It would also be possible for thePCN-ingress-node should do: * dropRSVP signalling to be originated and/or terminated by proxies, with application-layer signalling between thepacket * downgradeend user and thepacketproxy (eg SIP signalling with a home hub). A similar example would use NSIS signalling is used instead of RSVP. It is possible that a user wants its inelastic traffic to use the PCN mechanisms but also react to ECN marking outside the PCN-domain [I-D.sarker-pcn-ecn-pcn-usecases]. Two ways to do this are tonon PCN-BA, eg best effort *tunnel all PCN-packets across thepacket,PCN-domain, so that theECN-markingECN marks is carried transparently across thePCN-domain. 4. High-level functional architecture The high-level approach isPCN-domain, or tosplit functionality between: o PCN-interior-nodes 'inside'use thePCN-domain, which monitor their ownthree stateof pre-congestion on each outgoing interface and mark PCN-packets if appropriate. They are not flow-aware, nor aware of Eardley (Editor) Expires August 11, 2008 [Page 11] Internet-Draft Document February 2008 ingress-egress-aggregates. The functionality is also done by PCN- ingress-nodes for their outgoing interfaces (ie those 'inside' the PCN-domain). o PCN-boundary-nodes at the edge of the PCN-domain, which control admission of new PCN-flows and termination of existing PCN-flows, based on information from PCN-interior-nodes.PCN encoding [I-D.moncaster-pcn-3-state-encoding]. Thisinformationis discussed further inthe form of the PCN-marked data packets (whichSection Section 7. Some possible deployment models that areintercepted byoutside thePCN-egress-nodes) and not signalling messages. Generally PCN-ingress-nodescurrent PCN WG Charter areflow-aware.outlined in Appendix A. 5. Assumptions and constraints on scope Theaim of this split is to keep the bulkscope of PCN is, at least initially (see Appendix A), restricted by thenetwork simple, scalablefollowing assumptions: 1. these components are deployed in a single DiffServ domain, within which all PCN-nodes are PCN-enabled androbust, whilst confining policy, application-leveltrust each other for truthful PCN-marking andsecurity interactionstransport 2. all flows handled by these mechanisms are inelastic and constrained to a known peak rate through policing or shaping 3. theedge of the PCN-domain. For example the lacknumber offlow awareness means that the PCN-interior-nodes don't care about the flow information associated with the PCN-packets that they carry, nor do the PCN-boundary-nodes care about which PCN-interior- nodes its flows traverse. The objectivePCN-flows across any potential bottleneck link isto standardise PCN-marking behaviour, but potentially produce more than one (informational) RFC describing how PCN-boundary-nodes react to PCN-marks. Note: Section 4 and Section 5 talk about PCN functionality being configured on outgoing interfaces of PCN-nodes. Alternatively, PCN functionality couldsufficiently large that stateless, statistical mechanisms can beconfigured oneffective. To put it another way, theingress interfacesaggregate bit rate of PCN-nodes, however a consistent choice must be madetraffic acrossthe PCN-domainany potential bottleneck link needs to be sufficiently large relative toensure thatthePCN mechanisms protect all links.maximum additional bit rate added by one flow. Thisdocument assumes configuration on the egress interfaces, because in DiffServ networks today DiffServ functionalityisusually implemented on egress interfaces. 4.1. Flowthe basic assumption of measurement- based admissionAt a high level, flow admission control works as follows. In order to generate information aboutcontrol. Eardley (Editor) Expires January 15, 2009 [Page 10] Internet-Draft Document July 2008 4. PCN-flows may have different precedence, but thecurrent stateapplicability of thePCN-domain, each PCN-node PCN-marks packets if it is "pre-congested". Exactly how a PCN-node decides if it is "pre-congested" (the algorithm) and exactly how packets are "PCN-marked" (the encoding) will be defined in a separate standards-track document, but at a high level itPCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc.) isexpected to be as follows: o the algorithm: a PCN-node meters the amountout ofPCN-traffic on each onescope. 5.1. Assumption 1: Trust and support ofits outgoing links. The measurementPCN - controlled environment We assume that the PCN-domain ismade as an aggregate ofa controlled environment, ie allPCN-packets,the nodes in a PCN-domain run PCN andnot per flow.trust each other. There are several reasons for proposing this assumption: o ThealgorithmPCN-domain has to be encircled by aconfigured parameter, PCN-lower-rate. As the amountring ofPCN-PCN-boundary- nodes, otherwise trafficexceedscould enter a PCN BA without being subject to admission control, which would potentially degrade thePCN-lower-rate, then PCN-packets are PCN- marked. See NOTE below for more explanation. Eardley (Editor) Expires August 11, 2008 [Page 12] Internet-Draft Document February 2008QoS of existing PCN-flows. othe encoding: a PCN-node PCN-marks a PCN-packet (withSimilarly, afirst encoding) by setting fields in the headerPCN-boundary-node has tospecific values. It is expectedtrust that all theECN and/or DSCP fields willPCN-nodes mark PCN-traffic consistently. A node not doing PCN-marking wouldn't beused. NOTE: Two main categories of algorithm have been proposed: if the algorithm uses threshold-marking then all PCN-packets are marked if the current rate exceeds the PCN-lower-rate, whereas if the algorithm uses excess-rate-marking the amount marked is equalable tothe amount in excess of the PCN-lower-rate. However, note that this description reflects the overall intent of the algorithm rather than its instantaneous behaviour, since the rate measured atalert when it suffered pre-congestion, which potentially would lead to too many PCN-flows being admitted (or too few being terminated). Worse, aparticular moment depends on the detailed algorithm, its implementation and the traffic's variance as wellrogue node could perform various attacks, asits rate (eg marking may well continue after a recent overload even after the instantaneous rate has dropped). The PCN-boundary-nodes monitor the PCN-marked packetsdiscussed inorder to extract information aboutthecurrent stateSecurity Considerations section. One way of assuring thePCN-domain. Based on this monitoring, a decisionabove two points ismade about whether to admit a prospective new flow. Exactly howthat theadmission control decisionentire PCN- domain ismade will be defined separately (at the moment the intentionrun by a single operator. Another possibility is that therewill be one or more informational-track RFCs),are several operators butat a high level two approaches have been proposedthey trust each other todate: o the PCN-egress-node measures (possibly asamoving average) the fractionsufficient level, in their handling ofthe PCN-trafficPCN-traffic. Note: All PCN-nodes need to be trustworthy. However if it's known thatis PCN-marked. The fraction is measured for a specific ingress-egress-aggregate. If the fraction is below a threshold valuean interface cannot become pre-congested thenthe new flow is admitted. o if the PCN-egress-node receives one (or several) PCN-marked packets, then a new flow is blocked, otherwiseit's not strictly necessary for itis admitted. Note that the PCN-lower-rate is a parameter that canto beconfigured by the operator. It willcapable of PCN-marking. But this must beset lower thanknown even in unusual circumstances, eg after thetrafficfailure of some links. 5.2. Assumption 2: Real-time applications We assume that any variation of source bit rate is independent of the level of pre-congestion. We assume that PCN-packets come from real time applications generating inelastic traffic, ie it sends packets atwhichthelink becomes congested andrate thenode drops packets. Note also thatcodec produces them, regardless of theadmission control decision is made for a particular pairavailability ofPCN-boundary-nodes. So itcapacity [RFC4594]. For example, voice and video requiring low delay, jitter and packet loss, the Controlled Load Service, [RFC2211], and the Telephony service class, [RFC4594]. This assumption isquite possible for a new flowto help focus the effort where it looks like PCN would beadmitted between one pair of PCN-boundary-nodes, whilst atmost useful, ie thesame time another admission requestsorts of applications where per flow QoS isblocked betweenadifferent pair of PCN-boundary-nodes. 4.2. Flow termination Atknown requirement. In other words we focus on PCN providing ahigh level, flow termination control works as follows. Each PCN-node PCN-marks packets inbenefit to inelastic traffic (PCN may or may not provide asimilar fashionbenefit toabove, with all proposals using an excess-rate-marking approach (Section 4.1). An obvious approach is forother types of traffic). For instance, thealgorithm to use a second configuredimpact of this assumption Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page13]11] Internet-Draft DocumentFebruaryJuly 2008parameter, PCN-upper-rate, andwould be to guide simulations work. As asecond header encoding. However thereconsequence, it isalso a proposalassumed that PCN-marking is being applied tousetraffic scheduled with thesame rateexpedited forwarding per-hop behaviour, [RFC3246], or traffic with similar characteristics. 5.3. Assumption 3: Many flows andthe same encoding. Several approaches have been proposed to date about how to convert this information into a flow termination decision; at a high level theseadditional load We assume that there areas follows: o In one approachmany PCN-flows on any bottleneck link in thePCN-egress-node measuresPCN-domain (or, to put it another way, the aggregate bit rate ofunmarked PCN-traffic (ie not PCN-upper-rate-marked), whichPCN- traffic across any potential bottleneck link is sufficiently large relative to theamount of PCN-trafficmaximum additional bit rate added by one PCN-flow). Measurement-based admission control assumes thatcan actually be supported. AlsothePCN-ingress- node measurespresent is a reasonable prediction of theratefuture: the network conditions are measured at the time ofPCN-traffic that is destined for this specific PCN-egress-node, and hence can calculatea new flow request, however theexcess amount that shouldactual network performance must beterminated. o Another approach instead measuresOK during the call some time later. One issue is that if there are only a few variable rateof PCN-upper-rate- marked traffic and calculates and selectsflows, then the aggregate traffic level may vary a lot, perhaps enough to cause some packets to get dropped. If there are many flowsthatthen the aggregate traffic level should beterminated. o Another approach terminates any PCN-flow withstatistically smoothed. How many flows is enough depends on aPCN-upper-rate- marked packet. Compared withnumber of things such as theapproaches above, PCN-marking needs to be done at a reducedvariation in each flow's rate, the total rate(every "s" bytesofexcess traffic) otherwise far too much traffic would be terminated. o Another approach uses only one sortPCN-traffic, and the size ofmarking, which is based onthePCN-lower-rate, to decide"safety margin" between the traffic level at which we start admission-marking and at which packets are dropped or significantly delayed. We do notonlymake explicit assumptions on how many PCN-flows are in each ingress-egress-aggregate. Performance evaluation work may clarify whether it is necessary toadmit more PCN- flows but also whethermake anyPCN-flows need to be terminated. It assumes thatadditional assumption on aggregation at theratioingress-egress-aggregate level. 5.4. Assumption 4: Emergency use out of scope PCN-flows may have different precedence, but the(implicit) PCN-upper-rate andapplicability of thePCN-lower-ratePCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc) isthe same on all links. This approach measures the rateout ofunmarked PCN-traffic at a PCN-egress-node.scope for consideration by the PCN WG. 6. High-level functional architecture ThePCN- ingress-node uses this measurementhigh-level approach is tocomputesplit functionality between: o PCN-interior-nodes 'inside' theimplicit PCN- upper-ratePCN-domain, which monitor their own state ofthe bottleneck link. It then measures the ratepre-congestion and mark PCN-packets if appropriate. They are not flow-aware, nor aware ofPCN-traffic thatingress-egress-aggregates. The functionality isdestinedalso done by PCN-ingress-nodes forthis specific PCN-egress-node and hence can calculatetheir outgoing interfaces (ie those 'inside' theamount that should be terminated. Since flow termination is designed for "abnormal" circumstances, it is quite likely that some PCN-nodes are congested and hence packets are being dropped and/or significantly queued. The flow termination mechanism must bear this in mind. Note also that the termination control decision is made for a particular pair of PCN-boundary-nodes. So it is quite possible for PCN-flows to be terminated between one pair of PCN-boundary-nodes, whilst at the same time none are terminated between a different pair of PCN-boundary-nodes. 4.3. Flow admission and flow termination Although designed to work together, flow admission and flow termination are independent mechanisms, and the use of one does notPCN-domain). Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page14]12] Internet-Draft DocumentFebruaryJuly 2008require or prevento PCN-boundary-nodes at theuseedge of theother. For example, an operator could use justPCN-domain, which control admissioncontrol, solving heavy congestion (caused by re-routing) by 'just waiting' - as sessions end,of new PCN-flows and termination of existingmicroflows naturally departPCN-flows, based on information from PCN-interior-nodes. This information is in thesystem over time, and the admission control mechanism will prevent admissionform ofnew microflows that usetheaffected links. SoPCN-marked data packets (which are intercepted by thePCN-domain will naturally return to normal operation, but with reduced capacity.PCN-egress-nodes) and not signalling messages. Generally PCN-ingress-nodes are flow-aware. Thedrawbackaim of thisapproach would be that until PCN-flows naturally departsplit is torelieve the congestion, all PCN-flows as well as lower priority services will be adversely affected. Onkeep theother hand, an operator could just rely for admission control on statically provisioned capacity per PCN-ingress-node (regardlessbulk of thePCN- egress-node of a flow), as is typical innetwork simple, scalable and robust, whilst confining policy, application-level and security interactions to thehose modeledge of theDiffServ architecture [RFC2475]. Such traffic conditioning agreements can lead to focused overload: many flows happen to focus on a particular link and then all flows throughPCN-domain. For example thecongested link fail catastrophically. Thelack of flowtermination mechanism could then be used to counteract such a problem. A different possibility is to configure onlyawareness means that the PCN-interior-nodes don't care about thePCN-lower-rate and hence only do one type of PCN-marking, but generate admission andflowtermination responses from different levels of marking. This is suggested in [I-D.charny-pcn-single-marking] which gives some ofinformation associated with thepros and cons of this approach. 4.4. Information transportPCN-packets that they carry, nor do the PCN-boundary-nodes care about which PCN-interior- nodes its flows traverse. Thetransport of pre-congestion information from a PCN-node to a PCN- egress-node is through PCN-markings in data packet headers, ie "in- band": no signalling protocol messaging is needed. However, signallingobjective isneededtotransport PCN-feedback-information between the PCN-boundary-nodes, for examplestandardise PCN- marking behaviour, but potentially produce more than one (informational) RFC describing how PCN-boundary-nodes react toconvey the fraction ofPCN-marked traffic from a PCN-egress-nodemarks. In order tothe relevant PCN-ingress- node. Exactly whatgenerate informationneeds to be transported will be described in the future PCN WG document(s)about theboundary mechanisms. The signalling could be done by an extensioncurrent state ofRSVP or NSIS, for instance; protocol work will be done by the relevant WG, but for example [I-D.lefaucheur-rsvp-ecn] describestheextensions needed for RSVP. 4.5. PCN-traffic The following are some high-level points aboutPCN- domain, each PCN-node PCN-marks packets if it is "pre-congested". Exactly when a PCN-node decides if it is "pre-congested" (the algorithm) and exactly howPCN works:packets are "PCN-marked" (the encoding) are defined in separate standards-track documents, but at a high level it is as follows: oThere needs to bethe algorithms: awayPCN-node meters the amount of PCN-traffic on each one of its outgoing (or incoming) links. The measurement is made as an aggregate of all PCN-packets, and not per flow. There are two algorithms, one for threshold-marking and one for excess- traffic-marking. o the encoding(s): a PCN-nodeto distinguish PCN-traffic from non PCN-traffic. They may be distinguished usingPCN-marks a PCN-packet by setting theDSCP field and/orECNfield. Eardley (Editor) Expires August 11, 2008 [Page 15] Internet-Draft Document February 2008 ofield to 11 and potentially altering the DSCP. ThePCN mechanisms may be appliedPCN-boundary-nodes monitor the PCN-marked packets in order tomore than one behaviour aggregate (which are distinguished by DSCP). o There may be traffic thatextract information about the current state of the PCN-domain. Based on this monitoring, a decision ismore important than PCN, perhapsmade about whether to admit aparticular applicationprospective new flow oran operator's control messages. A PCN- node may dedicate capacitywhether tosuch traffic or priority schedule it over PCN. In the latter case its trafficterminate existing flow(s). PCN-marking needs tocontributebe configured on all links in the PCN-domain to ensure that the PCNmeters. o There willmechanisms protect all links. The actual functionality can betraffic less important than PCN. For instance best effortconfigured on the outgoing orassured forwarding traffic. It will be scheduled at lower priority than PCN, and use a separate queueincoming interfaces of PCN-nodes - orqueues. However, a PCN-node should dedicate some capacity to lower priority traffic so that it isn't starved. o There mayone algorithm could be configured on the outgoing interface and the othertraffic withon thesame priority as PCN-traffic. For instance, Expedited Forwarding sessionsincoming interface. The important thing is thatare originated either without capacity admission or with traffic engineering. In [I-D.ietf-tsvwg-admitted-realtime-dscp] the two traffic classes are called EF and EF-ADMIT. A PCN-node could either use separate queues, or separate policers andacommon queue; the draft provides some guidance when eachconsistent choice isbetter, butmade across the PCN- domain to ensure that the PCN mechanisms protect all links. See [I-D.eardley-pcn-marking-behaviour] forinstancefurther discussion. Eardley (Editor) Expires January 15, 2009 [Page 13] Internet-Draft Document July 2008 The objective of thelatterthreshold-marking algorithm ispreferred whento threshold-mark all PCN-packets whenever thetwo traffic classes are carryingrate of PCN-packets is greater than some configured rate, thesame typePCN-threshold-rate. The objective ofapplication withthesame jitter requirements. 5. Detailed Functional architecture This sectionexcess-traffic-marking algorithm isintendedtoprovideexcess-traffic-mark PCN- packets at asystematic summaryrate equal to the difference between the bit rate of PCN-packets and some configured rate, thenew functional architecture inPCN-excess-rate. Note that this description reflects thePCN-domain. First it describes functions neededoverall intent of the algorithm rather than its instantaneous behaviour, since the rate measured at a particular moment depends on thethree specific types of PCN-node; these are data plane functionsdetailed algorithm, its implementation andare in addition to their normal router functions. Then it describes further functionality needed for both flow admission control and flow termination; these are signalling and decision-making functions, and there are various possibilities for wherethefunctions are physically located.traffic's variance as well as its rate (eg marking may well continue after a recent overload even after the instantaneous rate has dropped). Thesection is split into: 1. functions needed at PCN-interior-nodes 2. functions needed at PCN-ingress-nodes 3. functions needed at PCN-egress-nodes 4. other functions needed for flow admission control 5. other functions needed for flow termination control Eardley (Editor) Expires August 11, 2008 [Page 16] Internet-Draft Document February 2008 Note: Probing is coveredalgorithms are specified inSection 7. The section then discusses some other detailed topics: 1. addressing 2. tunnelling 3. fault handling 5.1. PCN-interior-node functions Each interface of the[I-D.eardley-pcn-marking-behaviour]. In a PCN-domainis configured withthefollowing functionality: o Packet classify - decide whether an incoming packetoperator may have two or three encoding states available. In both cases the ECN field isaset to 11 to indicate PCN-packet or not. Another PCN WG document will specify encoding, usingmarking. In the former case, one DSCPand/or ECN fields. o PCN-meter - measureis used. In the'amount of PCN-traffic'. The measurementlatter case a second DSCP ismade as an aggregate of all PCN-packets, and not per flow. o PCN-mark - algorithms determine whether to PCN-mark PCN-packetsused, which allows distinct threshold-marks andwhat packetexcess-traffic-marks. The encoding isused (asspecified inanother PCN WG document). The same general approach of metering and PCN-marking is performed for both flow admission control[I-D.moncaster-pcn-baseline-encoding] andflow termination, however[I-D.moncaster-pcn-3-state-encoding]. All thealgorithmsvarious admission andencoding may be different. These functionstermination approaches areneeded for each interface of the PCN-domain. Theydetailed and compared in [I-D.charny-pcn-comparison] and [Menth08]. The discussion below is just a brief summary. It initially assumes there aretherefore needed on all interfacesthree encoding states available. 6.1. Flow admission The objective ofPCN-interior-nodes, andPCN's flow admission control mechanism is to limit the PCN-traffic on each link in theinterfacesPCN-domain to *roughly* its PCN- threshold-rate, by admitting or blocking prospective new flows, in order to protect the QoS ofPCN-boundary-nodesexisting PCN-flows. The PCN-threshold- rate is a parameter thatare internal tocan be configured by thePCN-domain. There mayoperator and will bemoreset lower thanone PCN-meter and marker installedthe traffic rate ata given interface, eg one for admissionwhich the link becomes congested andone for termination. 5.2. PCN-ingress-node functions Each ingress interface ofthePCN-domain is configured withnode drops packets. Exactly how thefollowing functionality: o Packet classify - decide whether an incoming packetadmission control decision ispartmade will be defined separately in informational documents. At a high level two approaches are proposed: o the PCN-egress-node measures (possibly as a moving average) the fraction of the PCN-traffic that is threshold-marked. The fraction is measured for apreviously admitted microflow, by usingspecific ingress-egress-aggregate. If the fraction is below afilter spec (eg DSCP, sourcethreshold value then the new flow is admitted, anddestination addressesif the fraction is above the threshold value then it is blocked. In [I-D.eardley-pcn-architecture] the fraction is measured as an EWMA (exponentially weighted moving average) andport numbers) o Police - police, by dropping or re-marking with a non-PCN DSCP, any packets received with a DSCP demanding PCN transport that doEardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page17]14] Internet-Draft DocumentFebruaryJuly 2008not belong to an admitted flow. Similarly, police packets that are part of a previously admitted microflow, to check thattermed themicroflow keeps to"congestion level estimate". o theagreed rate or flowspec (eg RFC1633 [RFC1633]PCN-egress-node monitors PCN-traffic andNSIS equivalent). Thereif it receives one (or several) threshold-marked packets, then the new flow is blocked, otherwise it is admitted. One possibility isa needtobe carefulreact toavoid re-ordering traffic. o PCN-colour - settheDSCP field or DSCP and ECN fields tomarking state of an initial flow set-up packet (eg RSVP PATH). Another is that after one (or several) threshold-marks then all flows are blocked until after a specific period of no congestion. Note that theappropriate value(s)admission control decision is made for aPCN-packet. The draft about PCN- encoding will discuss further. o PCN-meter - make "measurementsparticular pair ofPCN-traffic". Some approaches toPCN-boundary-nodes. So it is quite possible for a new flowtermination require the PCN-ingress-nodetomeasure the (aggregate) ratebe admitted between one pair ofPCN-traffic towardsPCN-boundary-nodes, whilst at the same time another admission request is blocked between aparticular PCN-egress- node.different pair of PCN-boundary-nodes. 6.2. Flow termination Thefirst two are policing functions, neededobjective of PCN's flow termination mechanism is tomake sure that PCN- packets admitted intolimit thePCN-domain belongPCN-traffic on each link toa flow that's been admitted and*roughly* its PCN-excess-rate, by terminating some existing PCN-flows, in order toensure thatprotect theflow keeps toQoS of theflowspec agreed (eg doesn't go at a faster rate andremaining PCN-flows. The PCN-excess-rate isinelastic traffic). Installing the filter spec will typicallya parameter that can bedoneconfigured by thesignalling protocol, as will re-installingoperator and may be set lower than thefilter, for example aftertraffic rate at which the link becomes congested and the node drops packets. Exactly how the flow termination decision is made will be defined separately in informational documents. At are-route that changeshigh level several approaches are proposed: o In one approach thePCN-ingress-node (see [I-D.briscoe-tsvwg-cl-architecture] for an example using RSVP). PCN-colouring allowsPCN-egress-node measures therestrate of PCN- traffic that is not excess-traffic-marked, which is thePCN-domain to recognise PCN-packets. 5.3. PCN-egress-node functions Each egress interfaceamount of PCN-traffic that can actually be supported. Also thePCN-domainPCN-ingress- node measures the rate of PCN-traffic that isconfigured withdestined for this specific PCN-egress-node, and hence it can calculate thefollowing functionality: o Packet classify - determine which PCN-ingress-node a PCN-packet has come from. o PCN-meter - "measure PCN-traffic" or "monitor PCN-marks".excess amount that should be terminated. oPCN-colour - for PCN-packets, setAnother approach instead measures theDSCPrate of excess-traffic- marked traffic andECN fields to the appropriate values for use outsideterminates this amount of traffic. This terminates more traffic than thePCN-domain.previous bullet if some nodes are dropping PCN-traffic. o AnotherPCN WG document, about boundary mechanisms, will describe PCN-metering in more detail. As described in Section 4.1approach monitors PCN-packets andSection 4.2, at present there are two alternative proposals: to measure asterminates any PCN-flow with anaggregate (ie not per flow) all PCN-packets from a particular PCN- ingress-node; or to monitorexcess-traffic-marked packet. Compared with thePCN-traffic and react to one (or several) PCN-marks. We refer to theseapproachesas "measuring PCN- traffic" and "monitoring PCN-marks". The PCN-metering functionality also depends on whether the measurement is targetedabove, PCN-marking needs to be done atadmission control ora reduced rate (every "s" bytes of excess traffic) otherwise far too much traffic would be terminated. Since flowtermination. It also depends on what encoding and PCN-marking algorithmstermination is designed for "abnormal" circumstances, it is quite likely that some PCN-nodes arespecified by the PCN WG.congested and hence packets Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page18]15] Internet-Draft DocumentFebruaryJuly 20085.4. Other admission control functions As well asare being dropped and/or significantly queued. The flow termination mechanism must bear this in mind. Note also that thefunctions covered above (Sections 5.1, 5.2, 5.3), other specific admissiontermination controlfunctions candecision is made for a particular pair of PCN-boundary-nodes. So it is quite possible for PCN-flows to beperformedterminated between one pair of PCN-boundary-nodes, whilst at the same time none are terminated between aPCN- boundary-node (PCN-ingress-node or PCN-egress-node) or atdifferent pair of PCN-boundary-nodes. 6.3. Flow admission and flow termination when there are only two PCN encoding states If acentralised node, butPCN-domain has only two encoding states available (PCN-marked and notat normal PCN-interior-nodes. The functions are:PCN-marked), ie it's using the baseline encoding [I-D.moncaster-pcn-baseline-encoding], then an operator has three options: oMake decision aboutadmission- based on the output ofcontrol only: PCN-marking means threshold-marking, ie only thePCN- egress-node's PCN-meter function. Inthreshold-marking algorithm writes PCN-marks. Only PCN admission control is available. o flow termination only: PCN-marking means excess-traffic-marking, ie only thecase where it "measures PCN-traffic",excess-traffic-marking algorithm writes PCN-marks. Only PCN termination control is available. o both admission control and flow termination: only themeasured traffic onexcess- traffic-marking algorithm writes PCN-marks, however theingress-egress-aggregateconfigured rate (PCN-excess-rate) iscompared with some reference level. Inset at thecase where it "monitors PCN-marks", thenrate thedecision is based on whether one (or several) packets is (are) PCN-marked or not. In either case, the admission decision also takes account of policy and application layer requirements. o Communicate decision aboutadmission- signal the decisioncontrol mechanism needs tothe node making thelimit PCN-traffic to. [I-D.charny-pcn-single-marking] describes how both admission controlrequest (which may be outside the PCN-domain),andto the policer (PCN-ingress-node function) for enforcement of the decision. There are various possibilities for how the functionalityflow termination can bedistributed (we assume the operator would configure which is used): o The decision is made at the PCN-egress-nodetriggered in this case andsignalled toalso gives some of thePCN-ingress-node opros and cons of this approach. Thedecisionmain downside ismade at the PCN-ingress-node, which requiresthatthe PCN-egress-node signals PCN-feedback-informationadmission control is less accurate. 6.4. Information transport The transport of pre-congestion information from a PCN-node tothea PCN-ingress-node. For example,egress-node is through PCN-markings inthe case where the PCN-meter functiondata packet headers, ie "in- band": no signalling protocol messaging is needed. Signalling is needed to"measure PCN-traffic" it could signaltransport PCN-feedback-information between the PCN- boundary-nodes, for example to convey the fraction ofPCN-traffic that is PCN-marked. o The decision is made atPCN-marked traffic from acentralised node (see Appendix). The decisionPCN-egress-node to the relevant PCN-ingress-node. Exactly what information needs to bepassed totransported will be described in theapplication layer so that it can takefuture PCN WG document(s) about theappropriate action. 5.5. Other flow termination functions Specific termination control functions canboundary mechanisms. The signalling could beperformed at a PCN- boundary-node (PCN-ingress-node or PCN-egress-node)done by an extension of RSVP orat a centralised node, but not at normal PCN-interior-nodes. There are various possibilitiesNSIS, forhow the functionality can be distributed, similar to those discussed above in the Admission control section; the flow termination decision couldinstance; protocol work will bemade atdone by thePCN-ingress-node,relevant WG, but for example [I-D.lefaucheur-rsvp-ecn] describes thePCN-egress-node or at some centralised node. The functions are:extensions needed for RSVP. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page19]16] Internet-Draft DocumentFebruaryJuly 2008 6.5. PCN-traffic The following are some high-level points about how PCN works: oPCN-meter at PCN-egress-node - similarlyThere needs toflow admission, there are two proposals:be a way for a PCN-node to"measure PCN-traffic" ondistinguish PCN-traffic from other traffic. This is through a combination of theingress-egress- aggregate, andDSCP field and/or ECN field. o The PCN mechanisms may be applied to"monitor PCN-marks"more than one behaviour aggregate which are distinguished by DSCP. However the current PCN encodings, [I-D.moncaster-pcn-baseline-encoding] andreact to[I-D.moncaster-pcn-3-state-encoding], only allow one(or several) PCN-marks.PCN-BA. o(if required) PCN-meter at PCN-ingress-node - make "measurements of PCN-traffic" being sent towardsThere may be traffic that is more important than PCN, perhaps a particularPCN-egress-node; again, this is done forapplication or an operator's control messages. A PCN- node may dedicate capacity to such traffic or priority schedule it over PCN. In theingress-egress-aggregate and not per flow. o (if required) Communicate PCN-feedback-informationlatter case its traffic needs to contribute to thenodePCN meters (ie be metered by the threshold-marking and excess- traffic-marking algorithms). o There may be other traffic thatmakesuses theflow termination decision. For example,same DSCP asin [I-D.briscoe-tsvwg-cl-architecture], communicatePCN-traffic but with thePCN-egress- node's measurementsECN field is 00 (Not ECT), and so not subject tothe PCN-ingress-node. o Make decision aboutPCN- marking, nor PCN's admission control and flow termination-mechanisms.. To quote [I-D.moncaster-pcn-baseline-encoding]: "To conserve DSCPs, DiffServ Codepoints SHOULD be chosen that are already defined for use with admission controlled traffic, such as theinformation fromVoice-Admit codepoint defined in [voice-admit]." Since scheduling behaviour is coupled with thePCN-meter(s) to decide which PCN-flow or PCN-flows to terminate. The decision takes account of policy and application layer requirements. o Communicate decision about flow termination - signalDSCP only, therefore thedecisionsame scheduling and buffer management rules are applied to non- PCN-traffic and PCN-traffic using thenode thatsame PCN-enabled DSCP. There may be no "non-PCN-traffic", but if there isableit needs to contribute toterminatetheflow (which mayPCN meters. o There will beoutside the PCN-domain),traffic less important than PCN. For instance best effort or assured forwarding traffic. It will be scheduled at lower priority than PCN, and use a separate queue or queues. However, a PCN-node should dedicate some capacity to lower priority traffic so that it isn't starved. Such traffic doesn't contribute to thepolicer (PCN-ingress-node function)PCN meters. 6.6. Backwards compatibility PCN specifies semantics forenforcement of the decision. 5.6. Addressing PCN-nodes may need to knowtheaddress of other PCN-nodes. Note: in all cases PCN-interior-nodes don't need to knowECN field that differ from theaddressdefault semantics ofany other PCN-nodes (except as normal their next hop neighbours,[RFC3168]. BCP124 [RFC4774] gives guidelines for specifying alternative semantics forrouting purposes). The PCN-egress-node needs to knowtheaddress ofECN field. These are discussed in thePCN-ingress-node associated with a flow, atbaseline encoding [I-D.moncaster-pcn-baseline-encoding] and extended encoding [I-D.moncaster-pcn-3-state-encoding] documents. In summary, PCN Eardley (Editor) Expires January 15, 2009 [Page 17] Internet-Draft Document July 2008 meets these guidelines by: o using aminimum so thatDSCP (or two DSCPs in thePCN-ingress-node can be informedextended encoding) toenforceallow PCN- nodes to distinguish PCN-traffic that uses theadmission decision (and any flow termination decision) through policing. There are various possibilitiesalternative ECN semantics; o defining these semantics forhowuse within a controlled region, thePCN-egress-nodePCN-domain; o taking appropriate action if ECN capable, non-PCN traffic arrives at a PCN-ingress-node with the DSCP used by PCN. The 'appropriate action' cando this, ie associatediffer in thereceived packet tocase of baseline encoding and extended encoding. In thecorrect ingress-egress-aggregate. Itformer, ECN-capable traffic that uses the same DSCP as PCN isnotblocked from entering theintention of this documentPCN-domain directly. Blocking means it is dropped or downgraded tomandateaparticular mechanism. o The addressing information canlower priority behaviour aggregate, or alternatively such traffic may begathered from signalling. For example, regular processing of an RSVP Path message, astunnelled through thePCN- ingress-nodePCN-domain. The reason that blocking is needed isthe previous RSVP hop (PHOP) ([I-D.lefaucheur-rsvp-ecn]). o Use a probe packetthatincludes as payloadtheaddressPCN-egress-node clears the ECN field to 00. The extended encoding adds support for end-to-end ECN, since the value of thePCN-ingress-node. Eardley (Editor) Expires August 11, 2008 [Page 20] Internet-Draft Document February 2008 o Always tunnel PCN-trafficECN field is preserved across the PCN-domain.ThenHowever, PCN-packets that get PCN-marked emerge from thePCN- ingress-node's address is simplyPCN-domain with thesource address ofECN field set to 11 (CE). It may make sense to expose such marks to a rate adaptive endpoint. However, it could violate [RFC4774] if theouter packet header. The PCN-ingress-nodeendpoint doesn't understand ECN, and therefore the PCN-domain first needs tolearnensure that theaddressend-to-end transport is ECN capable (probably through signalling). 7. Detailed Functional architecture This section is intended to provide a systematic summary of thePCN-egress-node, either by manual configuration or by one of the automated tunnel endpoint discovery mechanisms (such as signalling or probing overnew functional architecture in thedata route, interrogating routing or using a centralised broker). 5.7. Tunnelling Tunnels may originate and/or terminate within aPCN-domain.It is important thatFirst it describes functions needed at thePCN-markingthree specific types ofany packet can potentially influence PCN'sPCN-node; these are data plane functions and are in addition to their normal router functions. Then it describes further functionality needed for both flow admission control andtermination - it shouldn't matter whetherflow termination; these are signalling and decision-making functions, and there are various possibilities for where thepacket happens to be tunnelledfunctions are physically located. The section is split into: 1. functions needed atthe PCN-node that PCN-marks the packet, or indeed whether it's decapsulated or encapsulated by a subsequent PCN-node. This suggests that the "uniform conceptual model" described in [RFC2983] should be re- appliedPCN-interior-nodes 2. functions needed at PCN-ingress-nodes 3. functions needed at PCN-egress-nodes Eardley (Editor) Expires January 15, 2009 [Page 18] Internet-Draft Document July 2008 4. other functions needed for flow admission control 5. other functions needed for flow termination control Note: Probing is covered in Appendix B. The section then discusses some other detailed topics: 1. addressing 2. tunnelling 3. fault handling 7.1. PCN-interior-node functions Each link of thePCN context. In linePCN-domain is configured withthis and the approach of [RFC4303] and [I-D.briscoe-tsvwg-ecn-tunnel],the followingrulefunctionality: o Packet classify - decide whether an incoming packet isapplieda PCN- packet or not. o Packet condition - ifencapsulation is done withinthePCN-domain: o any PCN-marking is copied into the outer header Similarly, in line with the "uniform conceptual model" of [RFC2983] and the "full-functionality option" of [RFC3168], the following rule is appliedlevel ifdecapsulationtraffic isdone within the PCN-domain: o ifsufficiently high to overload theouter header's marking state is more severePCN_BA, ie cause real congestion, thenit is copied onto the inner headerdrop or downgrade PCN-packets. oNote:Meter - measure theorder'amount ofincreasing severity is: unmarked; PCN-marking with first encoding (ie associated with the PCN-lower-rate); PCN- marking with second encoding (ie associated with the PCN-upper- rate) An operator may wish to tunnel PCN-traffic from PCN-ingress-nodes to PCN-egress-nodes.PCN-traffic'. ThePCN-marks shouldn't be visible outside the PCN-domain, which can be achieved by doing the PCN-colour function (Section 5.3) aftermeasurement is made as an aggregate of allthe other (PCNPCN-packets, andtunnelling) functions.not per flow. o Mark - algorithms determine whether to PCN-mark PCN-packets and what packet encoding is used. Thepotential reasons for doing such tunnelling are: the PCN-egress- node then automatically knowsfunctions are specified in [I-D.eardley-pcn-marking-behaviour] and theaddressencodings in [I-D.moncaster-pcn-baseline-encoding] and [I-D.moncaster-pcn-3-state-encoding]. 7.2. PCN-ingress-node functions Each ingress link of therelevant PCN- ingress-node for a flow; even if ECMPPCN-domain isrunning, all PCN-packets on a particular ingress-egress-aggregate follow the same path. But it also has drawbacks, for exampleconfigured with theadditional overhead in termsfollowing functionality: o Packet classify - decide whether an incoming packet is part ofbandwidtha previously admitted flow, by using a filter spec (eg DSCP, source andprocessing,destination addresses andthe cost of setting upport numbers). o Police - police, by dropping or downgrading, any packets received with amesh of tunnels between PCN-boundary-nodes (there isDSCP demanding PCN transport that do not belong to anN^2 scaling issue). Potential issues arise foradmitted flow. Similarly, police packets that are part of a"partially PCN-capable tunnel", ie whereEardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page21]19] Internet-Draft DocumentFebruaryJuly 2008only one tunnel endpoint is inpreviously admitted flow, to check that thePCN domain: 1. The tunnel starts outsideflow keeps to the agreed rate or flowspec (eg RFC1633 [RFC1633] for aPCN-domainmicroflow andfinishes inside it. If the packet arrives at the tunnel ingress withits NSIS equivalent). o Packet colour - set thesame encodingDSCP and ECN fields appropriately, see [I-D.moncaster-pcn-baseline-encoding] or [I-D.moncaster-pcn-3-state-encoding] asused withinappropriate for thePCN-domainPCN- domain. o Meter - some approaches toindicate PCN-marking, then this could leadflow termination require thePCN-egress-nodePCN- ingress-node tofalselymeasurepre- congestion. 2. The tunnel starts insidethe (aggregate) rate of PCN-traffic towards a particular PCN-egress-node. The first two are policing functions, needed to make sure that PCN- packets admitted into the PCN-domain belong to a flow that's been admitted andfinishes outside it. Ifto ensure that thepacket arrivesflow keeps to the flowspec agreed (eg doesn't go at a faster rate and is inelastic traffic). Installing thetunnel ingress already PCN-marked, then itfilter spec willstill havetypically be done by thesame encoding when it's decapsulated which could potentially confuse nodes beyondsignalling protocol, as will re-installing thetunnel egress. In line withfilter, for example after a re-route that changes thesolutionPCN-ingress-node (see [I-D.briscoe-tsvwg-cl-architecture] forpartially capable DiffServ tunnels in [RFC2983],an example using RSVP). Packet colouring allows thefollowing rules are applied: o For case (1),rest of thetunnelPCN-domain to recognise PCN-packets. 7.3. PCN-egress-node functions Each egressnode clears any PCN-marking onlink of theinner header. This rulePCN-domain isapplied beforeconfigured with the'copy on decapsulation' rule above.following functionality: oFor case (2), the tunnel ingress node clears any PCN-marking on the inner header. This rule is applied after the 'copy on encapsulation' rule above. Note that the above implies that onePacket classify - determine which PCN-ingress-node a PCN-packet hasto know,come from. o Meter - "measure PCN-traffic" orfigure out,"monitor PCN-marks". o Packet colour - for PCN-packets, set thecharacteristics ofDSCP and ECN fields to theother end ofappropriate values for use outside thetunnel as partPCN-domain. The metering functionality ofsettingcourse depends on whether itup. 5.8. Fault handling If a PCN-interior-node fails (or one of its links), then lower layer protection mechanismsis targeted at admission control or flow termination. Alternative proposals involve theregular IP routing protocol will eventually re-route round it. If the new route can carryPCN-egress-node "measuring" as an aggregate (ie not per flow) all PCN-packets from a particular PCN-ingress-node, or "monitoring" theadmitted traffic, flows will gracefully continue. If instead this causes early warning of pre-congestion onPCN-traffic and reacting to one (or several) PCN- marked packets. 7.4. Other admission control functions As well as thenew route, thenfunctions covered above, other specific admission controlbased on pre-congestion notification will ensure new flows will notfunctions can beadmitted until enough existing flows have departed. Re-routing may result in heavy (pre-)congestion, when the flow termination mechanism will kick in. Ifperformed at a PCN-boundary-nodefails then we would like the regular QoS signalling protocol to take care of things. As an example [I-D.briscoe-tsvwg-cl-architecture] considers what happens if RSVP is the QoS signalling protocol.(PCN- ingress-node or PCN-egress-node) or at a centralised node, but not at Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page22]20] Internet-Draft DocumentFebruaryJuly 20086. Design goals and challenges Prior worknormal PCN-interior-nodes. The functions are: o Make decision about admission - based onPCN and similar mechanisms has thrown up a numberthe output ofconsiderations about PCN's design goals (thingsthe PCN- egress-node's PCNshould be good at) andmeter function. In the case where it "measures PCN-traffic", the measured traffic on the ingress-egress-aggregate is compared with someissues that have been hard to solve in a fully satisfactory manner. Taken as a wholereference level. In the case where itrepresents a list"monitors PCN-marks", then the decision is based on whether one (or several) packets is (are) PCN-marked or not. In either case, the admission decision also takes account oftrade- offs (it's unlikely that they can allpolicy and application layer requirements. o Communicate decision about admission - signal the decision to the node making the admission control request (which may be100% achieved)outside the PCN-domain), andperhaps as evaluation criteriatohelp an operator (ortheIETF) decide between options. The followingpolicer (PCN-ingress-node function) for enforcement of the decision. There arekey design goalsvarious possibilities forPCN (based on [I-D.chan-pcn-problem-statement]):how the functionality can be distributed (we assume the operator would configure which is used): o ThePCN-enabled packet forwarding network should be simple, scalabledecision is made at the PCN-egress-node androbust o Compatibility with other traffic (ie a proposed solution should work well when non-PCN trafficthe decision (admit or block) isalso present insignalled to thenetwork) o Support of different types of real-time traffic (eg should work well with CBR and VBR voice and video sources treated together)PCN-ingress-node. This seems most natural. oReaction time ofThe decision is made at themechanisms should be commensurate withPCN-ingress-node, which requires that thedesired application-level requirements (eg a termination mechanism needsPCN-egress-node signals PCN-feedback-information toterminate flows before significant QoS issues are experienced by real-time traffic, and before most users hang up). o Compatibility with different precedence levels of real-time applications (e.g. preferential treatmentthe PCN- ingress-node. For example, it could signal the current fraction ofhigher precedence calls over lower precedence calls, [ITU-MLPP]. The following are open issues. They are mainly taken from [I-D.briscoe-tsvwg-cl-architecture] which also describes some possible solutions. NotePCN-traffic thatsome mayis PCN-marked. o The decision is made at a centralised node (see Appendix A). 7.5. Other flow termination functions Specific termination control functions can beconsidered unimportant in generalperformed at a PCN- boundary-node (PCN-ingress-node orin specific deployment scenariosPCN-egress-node) orby some operators. NOTE: Potential solutionsat a centralised node, but not at normal PCN-interior-nodes. There areout of scopevarious possibilities forthis document. o ECMP (Equal Cost Multi-Path) Routing: The level of pre-congestion is measured on a specific ingress-egress-aggregate. However, ifhow thePCN-domain runs ECMP, then traffic on this ingress-egress- aggregate may follow several different paths - some offunctionality can be distributed, similar to those discussed above in thepathsAdmission control section; the flow termination decision could bepre-congested whilst others are not. There are three potential problems: 1. over-admission: a new flow is admitted (becausemade at thepre- congestion level measured byPCN-ingress-node, the PCN-egress-node or at some centralised node. The functions are: o PCN-meter at PCN-egress-node - similarly to flow admission, there are two types of proposals: to "measure PCN-traffic" on the ingress-egress-aggregate, and to "monitor PCN-marks" and react to one (or several) PCN-marks. o (if required) PCN-meter at PCN-ingress-node - make "measurements of PCN-traffic" being sent towards a particular PCN-egress-node; again, this issufficiently diluted by unmarked packets from non-congesteddone for the ingress-egress-aggregate and not per Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page23]21] Internet-Draft DocumentFebruaryJuly 2008paths that a new flow is admitted), but its packets travel through a pre-congested PCN-node 2. under-admission: a new flow is blocked (because the pre- congestion level measured byflow. o (if required) Communicate PCN-feedback-information to thePCN-egress-node is sufficiently increased by PCN-marked packets from pre- congested pathsnode thata new flow is blocked), but its packets travel along an uncongested path 3. ineffective termination: flows are terminated, however their path doesn't travel throughmakes the(pre-)congested router(s). Sinceflow terminationis a 'last resort' that protectsdecision. For example, as in [I-D.briscoe-tsvwg-cl-architecture], communicate thenetwork should over-admission occur, this problem is probably more importantPCN-egress- node's measurements tosolve thantheother two.PCN-ingress-node. oECMP and signalling: It is possible that, in a PCN-domain running ECMP,Make decision about flow termination - use thesignalling packets (eg RSVP, NSIS) follow a different path thaninformation from thedata packets,PCN-meter(s) to decide whichcould matter if the signalling packets are used as probes. Whether this is an issue depends on which fields the ECMP algorithm uses; if the ECMP algorithm is restrictedPCN-flow or PCN-flows tothe sourceterminate. The decision takes account of policy anddestination IP addresses, then it won't be.application layer requirements. oTunnelling: There are scenarios where tunnelling makes it hardCommunicate decision about flow termination - signal the decision todeterminethepath innode that is able to terminate thePCN-domain. The problem, its impact andflow (which may be outside thepotential solutions are similarPCN-domain), and tothose for ECMP. o Scenarios with only one tunnel endpoint inthePCN domain may make it harderpolicer (PCN-ingress-node function) for enforcement of thePCN-egress-nodedecision. 7.6. Addressing PCN-nodes may need togather from the signalling messages (eg RSVP, NSIS)know theidentityaddress of other PCN-nodes. Note: in all cases PCN-interior-nodes don't need to know thePCN-ingress-node. o Bi-Directional Sessions: Many applications have bi-directional sessions - hence there are two flows that should be admitted (or terminated)address of any other PCN-nodes (except asa pair -normal their next hop neighbours, forinstance a bi-directional voice call only makes sense if flows in both directions are admitted. However, PCN's mechanisms concern admission and terminationrouting purposes). The PCN-egress-node needs to know the address of the PCN-ingress-node associated with asingleflow,and coordination ofat a minimum so that the PCN-ingress-node can be informed to enforce the admission decision (and any flow termination decision) through policing. There are various possibilities forboth flowshow the PCN-egress-node can do this, ie associate the received packet to the correct ingress-egress-aggregate. It isa matter fornot thesignalling protocol and out of scopeintention ofPCN. One possible example would use SIP pre-conditions; there are others. o Global Coordination: PCN makes its admission decision based on PCN-markings onthis document to mandate a particularingress-egress-aggregate. Decisions about flows through a different ingress-egress-aggregate are made independently. However, onemechanism. o The addressing information canimagine network topologies and traffic matrices where, from a global perspective, it wouldbebettergathered from signalling. For example, regular processing of an RSVP Path message, as the PCN- ingress-node is the previous RSVP hop (PHOP) ([I-D.lefaucheur-rsvp-ecn]). Or the PCN-ingress-node could signal its address tomake a coordinated decision across alltheingress- egress-aggregates forPCN-egress-node. o Always tunnel PCN-traffic across thewholePCN-domain.For example,Then the PCN- ingress-node's address is simply the source address of the outer packet header. The PCN-ingress-node needs toblock (or even terminate) flows onlearn the address of the PCN-egress-node, either by manual configuration or by oneingress-egress-aggregate so thatof the automated tunnel endpoint discovery mechanisms (such as signalling or probing over the data route, interrogating routing or using a centralised broker). Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page24]22] Internet-Draft DocumentFebruaryJuly 2008more important flows through a different ingress-egress-aggregate could be admitted. The problem7.7. Tunnelling Tunnels maywell be second order. o Aggregate Traffic Characteristics: Even whenoriginate and/or terminate within a PCN-domain. It is important that thenumberPCN-marking offlows is stable,any packet can potentially influence PCN's flow admission control and termination - it shouldn't matter whether thetraffic level throughpacket happens to be tunnelled at thePCN-domain will vary becausePCN-node that PCN-marks thesources vary their traffic rates. PCN works best when there's not too much variability in the total traffic level at a PCN-node's interface (ie in the aggregate traffic from all sources). Too much variation means that a node may (at one moment) not be doing any PCN-marking and then (at another moment) drop packets becausepacket, or indeed whether it'soverloaded.decapsulated or encapsulated by a subsequent PCN-node. Thismakes it hard to tune the admission control scheme to stop admitting new flows atsuggests that theright time. Therefore"uniform conceptual model" described in [RFC2983] should be re- applied in theproblem is more likelyPCN context. In line withfewer, burstier flows. o Flash crowdsthis andSpeedthe approach ofReaction: PCN is a measurement-based mechanism[RFC4303] andso there[I-D.briscoe-tsvwg-ecn-tunnel], the following rule isan inherent delay between packet marking by PCN-interior-nodes and any admission control reaction at PCN- boundary-nodes. For example, potentiallyapplied ifa big burst of admission requests occurs in a very short space of time (eg prompted by a televote), they could all get admitted before enough PCN-marks are seen to block new flows. In other words, any additional load offeredencapsulation is done within thereaction time of the mechanism mustn't movePCN-domain: o any PCN-marking is copied into thePCN-domain directly from no congestion to overload. This 'vulnerability period' may impact atouter header Similarly, in line with thesignalling level, for instance QoS requests should be rate limited to bound"uniform conceptual model" of [RFC2983] and thenumber"full-functionality option" ofrequests able to arrive[RFC3168], the following rule is applied if decapsulation is done within thevulnerability period.PCN-domain: oSilent at start: after a successful admission request the source may wait some time before sending data (eg waiting for the called party to answer). Thenif theriskouter header's marking state isthat, in some circumstances, PCN's measurements underestimate what the pre-congestion level will be whenmore severe then it is copied onto thesource does start sending data.inner header oCompatibility of PCN-encoding with ECN-encoding. This issue will be considered further inNote: thePCN WG Milestone 'Surveyorder ofencoding choices'. 7. Probing 7.1. Introduction Probing is an optional mechanismincreasing severity is: not PCN-marked; threshold-marking; excess-traffic-marking. An operator may wish toassist admission control. PCN's admission control, as described so far, is essentially a reactive mechanism wheretunnel PCN-traffic from PCN-ingress-nodes to PCN-egress-nodes. The PCN-marks shouldn't be visible outside the PCN-domain, which can be achieved by the PCN-egress-nodemonitorsdoing thepre- Eardley (Editor) Expires August 11, 2008 [Page 25] Internet-Draft Document February 2008 congestion level for traffic from each PCN-ingress-node; ifpacket colouring function (Section 7.3) after all thelevel rises then it blocks new flows on that ingress-egress-aggregate. However, it's possible that an ingress-egress-aggregate carries no traffic,other (PCN andsotunnelling) functions. The potential reasons for doing such tunnelling are: the PCN-egress-nodecan't make an admission decision usingthen automatically knows theusual method described earlier. One approach is to be "optimistic" and simply admitaddress of thenew flow. However it's possible to envisagerelevant PCN-ingress-node for ascenario where the traffic levelsflow; even if ECMP is running, all PCN-packets onother ingress-egress-aggregates are already so high that they're blocking new PCN-flows, and admittinganew flow onto this 'empty'particular ingress-egress-aggregateadds extra traffic onto the link that's already pre-congested - which may 'tip the balance' so that PCN's flow termination mechanism is activated or some packets are dropped. This risk could be lessened by configuring on each link sufficient 'safety margin' above the PCN-lower-rate. An alternative approach is to make PCN a more proactive mechanism. The PCN-ingress-node explicitly determines, before admittingfollow theprospective new flow, whethersame path. But it also has drawbacks, for example theingress-egress-aggregate can support it. This can be seen as a "pessimistic" approach,additional overhead incontrast to the "optimism"terms ofthe approach above. It involves probing: a PCN-ingress-node generatesbandwidth and processing, andsends probe packets in order to test the pre-congestion level thattheflow would experience. One possibility is thatcost of setting up aprobe packetmesh of tunnels between PCN-boundary-nodes (there isjustan N^2 scaling issue). Potential issues arise for adummy data packet, generated by"partially PCN-capable tunnel", ie where only one tunnel endpoint is in thePCN-ingress-nodePCN domain: 1. The tunnel starts outside a PCN-domain andaddressed tofinishes inside it. If thePCN-egress- node. Another possibility is that a probe packet is a signallingpacketthat is anyway travelling fromarrives at thePCN-ingress-node totunnel ingress with thePCN-egress-node (eg an RSVP PATH message travelling from sourcesame encoding as used within the PCN-domain todestination). 7.2. Probing functions The probing functions are: o Make decision that probing is needed. As described above,indicate PCN-marking, then thisis when the ingress-egress-aggregate (orcould lead theECMP path - Section 6) carries no PCN-traffic. An alternative is alwaysPCN-egress-node toprobe, ie probe before admitting every PCN-flow. o (if required) Communicate the request that probing is needed - the PCN-egress-node signals to the PCN-ingress-node that probing is needed o (if required) Generate probe traffic - the PCN-ingress-node generates the probe traffic. The appropriate number (or rate) of probe packets will depend on the PCN-marking algorithm; forfalsely measure pre- congestion. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page26]23] Internet-Draft DocumentFebruaryJuly 2008example an excess-rate-marking algorithm generates fewer PCN-marks than2. The tunnel starts inside athreshold-marking algorithm,PCN-domain andsofinishes outside it. If the packet arrives at the tunnel ingress already PCN-marked, then it willneed more probe packets. o Forward probe packets - as far as PCN-interior-nodes are concerned, probe packets must be handledstill have the sameas (ordinary data) PCN-packets, in terms of routing, scheduling and PCN- marking. o Consume probe packets - the PCN-egress-node consumes probe packets to ensure that they don't travelencoding when it's decapsulated which could potentially confuse nodes beyond thePCN-domain. 7.3. Discussion of rationaletunnel egress. In line with the solution forprobing, its downsides and open issues It is an unresolved question whether probing is really needed, but three viewpoints have been put forward as to why it is useful. The first is perhapspartially capable DiffServ tunnels in [RFC2983], themost obvious: there is no PCN-trafficfollowing rules are applied: o For case (1), the tunnel egress node clears any PCN-marking on theingress-egress-aggregate. The second assumes that multipath routing ECMPinner header. This rule isrunning inapplied before thePCN-domain. The third viewpoint is that admission control is always done by probing. We now consider each in turn. The first viewpoint assumes the following:'copy on decapsulation' rule above. oThere is no PCN-trafficFor case (2), the tunnel ingress node clears any PCN-marking on theingress-egress-aggregate (so a normal admission decision cannot be made). o Simply admittinginner header. This rule is applied after thenew flow'copy on encapsulation' rule above. Note that the above implies that one hasa significant risk of leadingtooverload: packets droppedknow, orflows terminated. Onfigure out, theformer bullet, [PCN-email-traffic-empty-aggregates] suggests that, duringcharacteristics of thefuture busy hourother end ofa national network with about 100 PCN-boundary-nodes, there are likely to be significant numbersthe tunnel as part ofaggregates with very few flows under nearly all circumstances. The latter bullet could occur ifsetting it up. Tunnelling constraints were anew flow starts on many ofmajor factor in theempty ingress-egress-aggregates and causes overload on a linkchoice of encoding, as explained in [I-D.moncaster-pcn-baseline-encoding] and [I-D.moncaster-pcn-3-state-encoding]. A lengthy discussion of all thePCN-domain. To be a problem this would probably have to happenissues associated with layered encapsulation of congestion notification (for ECN as well as PCN) is in [I-D.briscoe-tsvwg-ecn-tunnel]. 7.8. Fault handling If ashort time period (flash crowd) because, after the reaction timePCN-interior-node fails (or one of its links), then lower layer protection mechanisms or thesystem, other (non-empty) ingress-egress-aggregates that pass through the linkregular IP routing protocol willmeasure pre-congestion and so blockeventually re-route round it. If the newflows, and alsoroute can carry all the admitted traffic, flowsnaturally end anyway. The downsides of probing forwill gracefully continue. If instead thisviewpoint are: o Probing adds delay tocauses early warning of pre-congestion on the new route, then admission controlprocess.based on pre-congestion notification will ensure new flows will not be admitted until enough existing flows have departed. Re-routing may result in heavy (pre-)congestion, when the flow termination mechanism will kick in. If a PCN-boundary-node fails then we would like the regular QoS signalling protocol to take care of things. As an example [I-D.briscoe-tsvwg-cl-architecture] considers what happens if RSVP is the QoS signalling protocol. 8. Design goals and challenges Prior work on PCN and similar mechanisms has thrown up a number of Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page27]24] Internet-Draft DocumentFebruaryJuly 2008o Sufficient probing traffic has toconsiderations about PCN's design goals (things PCN should begeneratedgood at) and some issues that have been hard totest the pre- congestion levelsolve in a fully satisfactory manner. Taken as a whole it represents a list ofthe ingress-egress-aggregate. But the probing traffic itself may cause pre-congestion, causing other PCN-flows totrade- offs (it's unlikely that they can all beblocked or even terminated -100% achieved) andinperhaps as evaluation criteria to help an operator (or theflash crowd scenario there will be probingIETF) decide between options. The following are key design goals for PCN (based onmany ingress-egress-aggregates.[I-D.chan-pcn-problem-statement]): o Theopen issues associatedPCN-enabled packet forwarding network should be simple, scalable and robust o Compatibility withthis viewpoint include:other traffic (ie a proposed solution should work well when non-PCN traffic is also present in the network) oWhat rate and patternSupport ofprobe packets does the PCN-ingress-node need to generate, so that there's enoughdifferent types of real-time trafficto make the admission decision?(eg should work well with CBR and VBR voice and video sources treated together) oWhat difficulty doesReaction time of thedelay (whilst probing is done) cause applications, eg packets mightmechanisms should bedropped? o Are there other ways of dealingcommensurate with theflash crowd scenario? For instance limit the rate at which new flows are admitted; or perhaps fordesired application-level requirements (eg aPCN-egress-nodetermination mechanism needs toblock newterminate flowson its empty ingress-egress-aggregates when its non-empty onesbefore significant QoS issues arepre- congested.experienced by real-time traffic, and before most users hang up). o Compatibility with different precedence levels of real-time applications (eg preferential treatment of higher precedence calls over lower precedence calls, [ITU-MLPP]). Thesecond viewpoint applies in the case where there is multipath routing (ECMP) in the PCN-domain.following are open issues. They are mainly taken from [I-D.briscoe-tsvwg-cl-architecture] which also describes some possible solutions. Note that some may be considered unimportant in general or in specific deployment scenarios or by some operators. NOTE: Potential solutions are out of scope for this document. o ECMP (Equal Cost Multi-Path) Routing: The level of pre-congestion isoften usedmeasured oncore networks.a specific ingress-egress-aggregate. However, if the PCN-domain runs ECMP, then traffic on this ingress-egress- aggregate may follow several different paths - some of the paths could be pre-congested whilst others are not. There aretwo possibilities: (1) If admission controlthree potential problems: 1. over-admission: a new flow isbased on measurements ofadmitted (because theingress- egress-aggregate, thenpre- congestion level measured by theviewpoint that probingPCN-egress-node isuseful assumes: o there's a significant chancesufficiently diluted by unmarked packets from non-congested paths thatthe traffica new flow isunevenly balanced across the ECMP paths, and hence there'sadmitted), but its packets travel through asignificant risk of admittingpre-congested PCN-node Eardley (Editor) Expires January 15, 2009 [Page 25] Internet-Draft Document July 2008 2. under-admission: a new flowthat should beis blocked (becauseit follows an ECMP path thatthe pre- congestion level measured by the PCN-egress-node ispre-congested) or blockingsufficiently increased by PCN-marked packets from pre- congested paths that a new flowthat should be admitted. o Note: [PCN-email-ECMP] suggests unbalanced trafficisquite possible, even with quite a large number ofblocked), but its packets travel along an uncongested path 3. ineffective termination: flowsonare terminated, however their path doesn't travel through the (pre-)congested router(s). Since flow termination is aPCN-link (eg 1000) when Assumption 3 (aggregation)'last resort' that protects the network should over-admission occur, this problem islikelyprobably more important tobe satisfied. (2) If admission control is based on measurements of pre-congestion on specific ECMP paths, thensolve than theviewpoint that probing is useful assumes:other two. oThereECMP and signalling: It isno PCN-traffic onpossible that, in a PCN-domain running ECMP, theECMPsignalling packets (eg RSVP, NSIS) follow a different pathonthan the data packets, whichto basecould matter if the signalling packets are used as probes. Whether this is anadmission decision. o Simply admittingissue depends on which fields thenew flow has a significant risk of leading to overload. Eardley (Editor) Expires August 11, 2008 [Page 28] Internet-Draft Document February 2008 o The PCN-egress-node can match a packet to an ECMP path. o Note: This is similarECMP algorithm uses; if the ECMP algorithm is restricted to thefirst viewpointsource andso similarly could occur in a flash crowd if a new flow starts more-or-less simultaneously on many of the emptydestination IP addresses, then it won't be. ECMPpaths. Because thereand signalling interactions areseveral (sometimes many) ECMP paths between each pair of PCN- boundary-nodes, it's presumably more likely that an ECMP path is 'empty' than an ingress-egress-aggregate. To constrain the number of ECMP paths,afew tunnels could be set-up between each pair of PCN-boundary-nodes. Tunnelling also solves the third bullet (which is otherwise hard because an ECMP routing decision is made independently on each node). The downsidesspecific instance ofprobinga general issue forthis viewpoint are: o Probing adds delay to the admission control process.non-traditional routing combined with resource management along a path [Hancock]. oSufficient probing traffic has to be generatedTunnelling: There are scenarios where tunnelling makes it hard totest the pre- congestion level ofdetermine theECMP path. But there'spath in therisk thatPCN-domain. The problem, its impact and theprobing traffic itself may cause pre-congestion, causing other PCN-flowspotential solutions are similar tobe blocked or even terminated.those for ECMP. oThe PCN-egress-node needs to consumeScenarios with only one tunnel endpoint in theprobe packetsPCN domain may make it harder for the PCN-egress-node toensure they don't travel beyondgather from thePCN-domainsignalling messages (egthey might confuseRSVP, NSIS) thedestination end node). Hence somehowidentity of thePCN-egress-node has to be able to disambiguate a probe packet from a data packet, via the characteristic setting of particular bit(s) in the packet's header or bodyPCN-ingress-node. o Bi-Directional Sessions: Many applications have bi-directional sessions -but these bit(s) mustn't be used by any PCN-interior- node's ECMP algorithm. In the general case this isn't possible, but ithence there are two flows that should beOKadmitted (or terminated) as a pair - for instance atypical ECMP algorithm which examines: the sourcebi-directional voice call only makes sense if flows in both directions are admitted. However, PCN's mechanisms concern admission anddestination IP addressestermination of a single flow, andport numbers,coordination of the decision for both flows is a matter for the signalling protocolIDandthe DSCP. The third viewpoint assumes the following:out of scope of PCN. One possible example would use SIP pre-conditions; there are others. oEveryGlobal Coordination: PCN makes its admissioncontroldecisioninvolves probing, using the signalling set-up message as the probe packet (eg RSVP PATH). o The PCN-marking behaviour is such that every packet is PCN-marked if the flow should be blocked, hence onlybased on PCN-markings on asingle probing packet is needed. This viewpoint [I-D.draft-babiarz-pcn-3sm] has inparticularbeen suggested for the scenario where the PCN-domain reaches out towards the end terminals (note that it's assumed the trustingress-egress-aggregate. Decisions about flows through a different ingress-egress-aggregate are made independently. However, one can imagine network topologies andaggregation assumptions still hold), althoughtraffic matrices where, from a global perspective, ithas also been suggested for other scenarios. Eardley (Editor) Expires August 11, 2008would be better to make a coordinated decision across all the ingress- egress-aggregates for the whole PCN-domain. For example, to block (or even terminate) flows on one ingress-egress-aggregate so that more important flows through a different ingress-egress-aggregate Eardley (Editor) Expires January 15, 2009 [Page29]26] Internet-Draft DocumentFebruaryJuly 20088. Operations and Management This Section considers operations and management issues, undercould be admitted. The problem may well be second order. o Aggregate Traffic Characteristics: Even when theFCAPS headings: OAMnumber ofFaults, Configuration, Accounting, Performance and Security. Provisioningflows isdiscussed with performance. 8.1. Configuration OAM This architecture document predatesstable, thedetailed standards actions oftraffic level through thePCN WG. Here we assume that only interoperable PCN-marking behavioursPCN-domain willbe standardised, otherwise we would have to consider how to avoid interactions between non-interoperable marking behaviours. However, more diversity in PCN-boundary-node behaviours is expected,vary because the sources vary their traffic rates. PCN works best when there's not too much variability inorder tothe total traffic level at a PCN-node's interfacewith diverse industry architectures. It(ie in the aggregate traffic from all sources). Too much variation means that a node may (at one moment) not bepossibledoing any PCN-marking and then (at another moment) drop packets because it's overloaded. This makes it hard tohave different PCN-boundary- node behaviours for different ingress-egress-aggregates withintune thesame PCN-domain. PCN functionality is configured on eitheradmission control scheme to stop admitting new flows at theegress orright time. Therefore theingress interfacesproblem is more likely with fewer, burstier flows. o Flash crowds and Speed ofPCN-nodes. A consistent choice must be made across the PCN-domain to ensure that the PCN mechanisms protect all links.Reaction: PCNconfiguration control variables fall into the following categories: o system options (enabling or disabling behaviours) o parameters (setting levels, addresses etc) One possibilityisthat all configurable variables sit within an SNMP management framework [RFC3411], being structured withinadefined management information base (MIB) on each node,measurement-based mechanism andbeing remotely readableso there is an inherent delay between packet marking by PCN-interior-nodes andsettable viaany admission control reaction at PCN- boundary-nodes. For example, potentially if asuitably secure management protocol (SNMPv3). Some configuration options and parameters have to be set oncebig burst of admission requests occurs in a very short space of time (eg prompted by a televote), they could all get admitted before enough PCN-marks are seen to'globally' controlblock new flows. In other words, any additional load offered within thewhole PCN-domain. Where possible, these are identified below.reaction time of the mechanism mustn't move the PCN-domain directly from no congestion to overload. This 'vulnerability period' mayaffect operational complexity andimpact at thechancessignalling level, for instance QoS requests should be rate limited to bound the number ofinteroperability problems between kit from different vendors. Itrequests able to arrive within the vulnerability period. o Silent at start: after a successful admission request the source maybe possiblewait some time before sending data (eg waiting foran operatorthe called party toconfigureanswer). Then the risk is that, in somePCN-interior- nodes so they don't runcircumstances, PCN's measurements underestimate what thePCN mechanisms, if it knows that these linkspre-congestion level willnever become (pre-)congested.be when the source does start sending data. 9. Operations and Management This Section considers operations and management issues, under the FCAPS headings: OAM of Faults, Configuration, Accounting, Performance and Security. Provisioning is discussed with performance. 9.1. Configuration OAM This architecture document predates the detailed standards actions of the PCN WG. Here we assume that only inter-operable PCN-marking behaviours will be standardised, otherwise we would have to consider how to avoid interactions between non inter-operable marking behaviours. However, more diversity in PCN-boundary-node behaviours Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page30]27] Internet-Draft DocumentFebruaryJuly 20088.1.1. System options On PCN-interior-nodes there willis expected, in order to interface with diverse industry architectures. It may bevery few system options: o Whether two PCN-markings (basedpossible to have different PCN-boundary- node behaviours for different ingress-egress-aggregates within the same PCN-domain. PCN functionality is configured on either thePCN-lower-rate and PCN- upper-rate) are enabledegress oronly one (see Section 4.3). Typically all nodes throughout a PCN-domain will be configuredthesame in this respect. However, exceptions could be made. For example, if most PCN-nodes used both markings, but some legacy hardware was incapableingress interfaces ofrunning two algorithms, an operator mightPCN-nodes. A consistent choice must bewilling to configure these legacy nodes solely for PCN-marking based onmade across thePCN-upper-rate to enable flow termination as a back-stop. It would be sensiblePCN-domain toplace such nodes where they could be provisioned with a greater leeway over expected traffic levels.ensure that the PCN mechanisms protect all links. PCN configuration control variables fall into the following categories: owhich marking algorithm tosystem options (enabling or disabling behaviours) o parameters (setting levels, addresses etc) One possibility is that all configurable variables sit within an SNMP management framework [RFC3411], being structured within a defined management information base (MIB) on each node, and being remotely readable and settable via a suitably secure management protocol (SNMPv3). Some configuration options and parameters have to be set once to 'globally' control the whole PCN-domain. Where possible, these are identified below. This may affect operational complexity and the chances of interoperability problems between kit from different vendors. It may be possible for an operator to configure some PCN-interior- nodes so they don't run the PCN mechanisms, if it knows that these links will never become (pre-)congested. 9.1.1. System options On PCN-interior-nodes there will be very few system options: o Whether two PCN-markings (threshold-marked and excess-traffic- marked) are enabled or only one. Typically all nodes throughout a PCN-domain will be configured the same in this respect. However, exceptions could be made. For example, if most PCN-nodes used both markings, but some legacy hardware was incapable of running two algorithms, an operator might be willing to configure these legacy nodes solely for excess-traffic-marking to enable flow termination as a back-stop. It would be sensible to place such nodes where they could be provisioned with a greater leeway over expected traffic levels. Eardley (Editor) Expires January 15, 2009 [Page 28] Internet-Draft Document July 2008 o what marking algorithm to use, if an equipment vendor provides achoicechoice. PCN-boundary-nodes (ingress and egress) will have more system options: o Which of admission and flow termination are enabled. If any PCN- interior-node is configured to generate a marking, all PCN- boundary-nodes must be able to handle that marking. Therefore all PCN-boundary-nodes must be configured the same in this respect. o Where flow admission and termination decisions are made: at the PCN-ingress-node, PCN-egress-node or at a centralised node (seeSections 5.4 and 5.5).Section 7). Theoretically, this configuration choice could be negotiated for each pair of PCN-boundary-nodes, but we cannot imagine why such complexity would be required, except perhaps in future inter-domain scenarios. PCN-egress-nodes will have further system options: o How the mapping should be established between each packet and its aggregate, eg by MPLS label, by IP packet filterspec; and how to take account of ECMP. o If an equipment vendor provides a choice, there may be options to select which smoothing algorithm to use for measurements.8.1.2.9.1.2. Parameters Like any DiffServ domain, every node within a PCN-domain will need to be configured with the DSCP(s) used to identify PCN-packets. On each interior link the main configuration parameters are thePCN-lower- ratePCN- threshold-rate andPCN-upper-rate.PCN-excess-rate. A largerPCN-lower-ratePCN-threshold-rate enables morePCN- Eardley (Editor) Expires August 11, 2008 [Page 31] Internet-Draft Document February 2008 trafficPCN-traffic to be admitted on a link, hence improving capacity utilisation. APCN-upper-ratePCN-excess-rate set further above thePCN-lower-ratePCN- threshold-rate allows greater increases in traffic (whether due to natural fluctuations or some unexpected event) before any flows are terminated, ie minimises the chances of unnecessarily triggering the termination mechanism. For instance an operator may want to design their network so that it can cope with a failure of any single PCN- node without terminating any flows. Setting these rates on first deployment of PCN will be very similar to the traditional process for sizing an admission controlled network, depending on: the operator's requirements for minimising flow blocking (grade of service), the expected PCN traffic load on each link and its statistical characteristics (the traffic matrix), contingency for re-routing the PCN traffic matrix in the event ofsingle or multiple failures andEardley (Editor) Expires January 15, 2009 [Page 29] Internet-Draft Document July 2008 single or multiple failures and the expected load from other classes relative to link capacities [Menth]. But once a domain is up and running, a PCN design goal is to be able to determine growth in these configured rates much more simply, by monitoring PCN-marking rates from actual rather than expected traffic (see Section8.29.2 on Performance & Provisioning). Operators may also wish to configure a rate greater than the PCN-upper-rateexcess-rate that is the absolute maximum rate that a link allows for PCN-traffic. This may simply be the physical link rate, but some operators may wish to configure a logical limit to prevent starvation of other traffic classes during any brief period after PCN-traffic exceeds thePCN-upper-ratePCN-excess-rate but before flow termination brings it back below this rate. Specific marking algorithms will also depend on further configuration parameters. For instance, threshold-marking will require a threshold queue depth andexcess-rate-markingexcess-traffic-marking may require a scaling parameter. It will be preferable for each marking algorithm to have rules to set defaults for these parameters relative to the reference marking rate, but then allow operators to change them, for instance if average traffic characteristics change over time. ThePCN-egress-nodePCN-egress- node may allow configuration of the following: o how itsmoothessmooths metering of PCN-markings (eg EWMA parameters) Whichever node makes admission and flow termination decisions will contain algorithms for converting PCN-marking levels into admission or flow termination decisions. These will also require configurable parameters, for instance:Eardley (Editor) Expires August 11, 2008 [Page 32] Internet-Draft Document February 2008oAnyany admission control algorithm will at least require a marking threshold setting above which it denies admission to new flows; o flow termination algorithms will probably require a parameter to delay termination of any flows until it is more certain that an anomalous event is not transient; o a parameter to control the trade-off between how quickly excess flows are terminated and over-termination. One particular proposal, [I-D.charny-pcn-single-marking] would require a global parameter to be defined on all PCN-nodes, but only needsthe PCN-lower-rateone PCN marking rate to be configured on each link. The global parameter is a scaling factor between admission and termination, for example the amount by which thePCN-upper-ratePCN-excess-rate is implicitly assumed to be above thePCN-lower-rate.PCN-threshold-rate. [I-D.charny-pcn-single-marking] discusses in full the impact of this particular proposal on the Eardley (Editor) Expires January 15, 2009 [Page 30] Internet-Draft Document July 2008 operation of PCN.8.2.9.2. Performance & Provisioning OAM Monitoring of performance factors measurable from *outside* the PCN domain will be no different with PCN than with any other packet-based flow admission control system, both at the flow level (blocking probability etc) and the packet level (jitter [RFC3393], [Y.1541], loss rate [RFC4656], mean opinion score [P.800], etc). The difference is that PCN is intentionally designed to indicate *internally* which exact resource(s) are the cause of performance problems and by how much. Even better, PCN indicates which resources will probably cause problems if they are not upgraded soon. This can be achieved by the management system monitoring the total amount (in bytes) of PCN- marking generated by each queue over a period. Given possible long provisioning lead times, pre-congestion volume is the best metric to reveal whether sufficient persistent demand has mounted up to warrant an upgrade. Because, even before utilisation becomes problematic, the statistical variability of traffic will cause occasional bursts of pre-congestion. This 'early warning system' decouples the process of adding customers from the provisioning process. This should cut the time to add a customer when compared against admission control provided over native DiffServ [RFC2998], because it saves having to re-run the capacity planning process before adding each customer. Alternatively, before triggering an upgrade, the long term pre- congestion volume on each link can be used to balance traffic load across the PCN-domain by adjusting the link weights of the routing system. When an upgrade to a link's configured PCN-rates isEardley (Editor) Expires August 11, 2008 [Page 33] Internet-Draft Document February 2008required, it may also be necessary to upgrade the physical capacity available to other classes. But usually there will be sufficient physical capacity for the upgrade to go ahead as a simple configuration change. Alternatively, [Songhurst] has proposed an adaptive rather than preconfigured system, where the configured PCN-lower-ratethreshold-rate is replaced with a high and low water mark and the marking algorithm automatically optimises how physical capacity is shared using the relative loads from PCN and other traffic classes. All the above processes require just three extra counters associated with each PCN queue:PCN-markings associated with the PCN-lower-rate and PCN-upper-rate,threshold-markings, excess-traffic-markings and drop. Every time a PCN packet is marked or dropped its size in bytes should be added to the appropriate counter. Then the management system can read the counters at any time and subtract a previous reading to establish the incremental volume of each type of (pre-)congestion. Readings should be taken frequently, so that anomalous events (eg re-routes) can be separated from regular Eardley (Editor) Expires January 15, 2009 [Page 31] Internet-Draft Document July 2008 fluctuating demand if required.8.3.9.3. Accounting OAM Accounting is only done at trust boundaries so it is out of scope of the initial Charter of the PCN WG which is confined to intra-domain issues. Use of PCN internal to a domain makes no difference to the flow signalling events crossing trust boundaries outside the PCN- domain, which are typically used for accounting.8.4.9.4. Fault OAM Fault OAM is about preventing faults, telling the management system (or manual operator) that the system has recovered (or not) from a failure, and about maintaining information to aid fault diagnosis. Admission blocking and particularly flow termination mechanisms should rarely be needed in practice. It would be unfortunate if they didn't work after an option had been accidentally disabled. Therefore it will be necessary to regularly test that the live system works as intended (devising a meaningful test is left as an exercise for the operator). Section5.97 describes how the PCN architecture has been designed to ensure admitted flows continue gracefully after recovering automatically from link or node failures. The need to record and monitor re-routing events affecting signalling is unchanged by the addition of PCN to a DiffServ domain. Similarly, re-routing events within the PCN-domain will be recorded and monitored just as they would be without PCN.Eardley (Editor) Expires August 11, 2008 [Page 34] Internet-Draft Document February 2008PCN-marking does make it possible to record 'near-misses'. For instance, at the PCN-egress-node a 'reporting threshold' could be set to monitor how often - and for how long - the system comes close to triggering flow blocking without actually doing so. Similarly, bursts of flow termination marking could be recorded even if they are not sufficiently sustained to trigger flow termination. Such statistics could be correlated with per-queue counts of marking volume (Section8.2)9.2) to upgrade resources in danger of causing service degradation, or to trigger manual tracing of intermittent incipient errors that would otherwise have gone unnoticed. Finally, of course, many faults are caused by failings in the management process ('human error'): a wrongly configured address in a node, a wrong address given in a signalling protocol, a wrongly configured parameter in a queueing algorithm, a node set into a different mode from other nodes, and so on. Generally, a clean design with few configurable options ensures this class of faults can Eardley (Editor) Expires January 15, 2009 [Page 32] Internet-Draft Document July 2008 be traced more easily and prevented more often. Sound management practice at run-time also helps. For instance: a management system should be used that constrains configuration changes within system rules (eg preventing an option setting inconsistent with other nodes); configuration options should also be recorded in an offline database; and regular automatic consistency checks between live systems and the database. PCN adds nothing specific to this class of problems. By the time standards are in place, we expect that the PCN WG will have ruthlessly removed gratuitous configuration choices. However, at the time of writing, the WG is yet to choose between multiple competing proposals, so the range of possible options in Section8.19.1 does seem rather wide compared to the original near-zero configuration intent of the architecture.8.5.9.5. Security OAM Security OAM is about using secure operational practices as well as being able to track security breaches or near-misses at run-time. PCN adds few specifics to the general good practice required in this field [RFC4778], other than those below. The correct functions of the system should be monitored (Section8.2)9.2) in multiple independent ways and correlated to detect possible security breaches. Persistent (pre-)congestion marking should raise an alarm (both on the node doing the marking and on the PCN-egress-node metering it). Similarly, persistently poor external QoS metrics such as jitter or MOS should raise an alarm. The following are examples of symptoms that may be the result of innocent faults, rather than attacks, but until diagnosed they should be logged and trigger a security alarm:Eardley (Editor) Expires August 11, 2008 [Page 35] Internet-Draft Document February 2008o Anomalous patterns of non-conforming incoming signals and packets rejected at the PCN-ingress-nodes (eg packets already marked PCN- capable, or traffic persistently starving token bucket policers). o PCN-capable packets arriving at a PCN-egress-node with no associated state for mapping them to a valid ingress-egress- aggregate. o A PCN-ingress-node receiving feedback signals about the pre- congestion level on a non-existent aggregate, or that are inconsistent with other signals (eg unexpected sequence numbers, inconsistent addressing, conflicting reports of the pre-congestion level, etc). o Pre-congestion marking arriving at an PCN-egress-node with (pre-)congestion markings focused on particular flows, rather than randomly distributed throughout the aggregate.9.Eardley (Editor) Expires January 15, 2009 [Page 33] Internet-Draft Document July 2008 10. IANA Considerations This memo includes no request to IANA.10.11. Security considerations Security considerations essentially come from the Trust Assumption (Section3.1),5.1), ie that all PCN-nodes are PCN-enabled and trust each other for truthful PCN-marking and transport. PCN splits functionality between PCN-interior-nodes and PCN-boundary-nodes, and the security considerations are somewhat different for each, mainly because PCN-boundary-nodes are flow-aware and PCN-interior-nodes are not. obecauseBecause the PCN-boundary-nodes are flow-aware, they are trusted to use that awareness correctly. The degree of trust required depends on the kinds of decisions they have to make and the kinds of information they need to make them. For example when the PCN- boundary-node needs to know the contents of the sessions for making the admission and termination decisions, or when the contents are highly classified, then the security requirements for the PCN-boundary-nodes involved will also need to be high. o the PCN-ingress-nodes police packets to ensure a PCN-flow sticks within its agreed limit, and to ensure that only PCN-flows which have been admitted contribute PCN-traffic into the PCN-domain. The policer must drop (or perhapsre-markdowngrade to a different DSCP) any PCN-packets received that are outside this remit. This is similarEardley (Editor) Expires August 11, 2008 [Page 36] Internet-Draft Document February 2008to the existing IntServ behaviour. Between them thePCN-boundary- nodesPCN- boundary-nodes must encircle the PCN-domain, otherwise PCN-packets could enter the PCN-domain without being subject to admission control, which would potentially destroy the QoS of existing flows. o PCN-interior-nodes aren't flow-aware. This prevents some security attacks where an attacker targets specific flows in the data plane - for instance for DoS or eavesdropping. o PCN-marking by the PCN-interior-nodes along the packet forwarding path needs to be trusted, because the PCN-boundary-nodes rely on this information. For instance a rogue PCN-interior-node could PCN-mark all packets so that no flows were admitted. Another possibility is that it doesn't PCN-mark any packets, even when it's pre-congested. More subtly, the rogue PCN-interior-node could perform these attacks selectively on particular flows, or it could PCN-mark the correct fraction overall, but carefully choose which flows it marked. Eardley (Editor) Expires January 15, 2009 [Page 34] Internet-Draft Document July 2008 o the PCN-boundary-nodes should be able to deal with DoS attacks and state exhaustion attacks based on fast changes in per flow signalling. o the signalling between the PCN-boundary-nodes (and possibly a central control node) must be protected from attacks. For example the recipient needs to validate that the message is indeed from the node that claims to have sent it. Possible measures include digest authentication and protection against replay and man-in- the-middle attacks. For the specific protocol RSVP, hop-by-hop authentication is in [RFC2747], and [I-D.behringer-tsvwg-rsvp-security-groupkeying] may also be useful; for a generic signalling protocol the PCN WG document on "Requirements for signalling" will describe the requirements in more detail. Operational security advice is given in Section8.5. 11.9.5. 12. Conclusions The document describes a general architecture for flow admission and termination based on pre-congestion information in order to protect the quality of service of established inelastic flows within a single DiffServ domain. The main topic is the functionalarchitecture (first covered at a high level and then at a greater level of detail).architecture. It also mentions other topics like the assumptions and open issues.Eardley (Editor) Expires August 11, 2008 [Page 37] Internet-Draft Document February 2008 12.13. Acknowledgements This document is a revised version of [I-D.eardley-pcn-architecture]. Its authors were: P. Eardley, J. Babiarz, K. Chan, A. Charny, R. Geib, G. Karagiannis, M. Menth, T. Tsou. They are therefore contributors to this document. Thanks to those who've made comments on [I-D.eardley-pcn-architecture] and on earlier versions of this draft: Lachlan Andrew, Joe Babiarz, Fred Baker, David Black, Steven Blake, Bob Briscoe, Jason Canon, Ken Carlberg, Anna Charny, Joachim Charzinski, Andras Csaszar, Lars Eggert, Ruediger Geib, Wei Gengyu, Robert Hancock, Ingemar Johansson, Georgios Karagiannis, Michael Menth, Toby Moncaster, Ben Strulo, Tom Taylor, Hannes Tschofenig, Tina Tsou, Lars Westberg, Magnus Westerlund, Delei Yu. Thanks to Bob Briscoe who extensively revised the Operations and Management section. This document is the result of discussions in the PCN WG and forerunner activity in the TSVWG. A number of previous drafts were Eardley (Editor) Expires January 15, 2009 [Page 35] Internet-Draft Document July 2008 presented to TSVWG: [I-D.chan-pcn-problem-statement], [I-D.briscoe-tsvwg-cl-architecture], [I-D.briscoe-tsvwg-cl-phb], [I-D.charny-pcn-single-marking], [I-D.babiarz-pcn-sip-cap], [I-D.lefaucheur-rsvp-ecn], [I-D.westberg-pcn-load-control]. The authors of them were: B, Briscoe, P. Eardley, D. Songhurst, F. Le Faucheur, A. Charny, J. Babiarz, K. Chan, S. Dudley, G. Karagiannis, A. Bader, L. Westberg, J. Zhang, V. Liatsos, X-G. Liu, A. Bhargava.13.14. Comments Solicited Comments and questions are encouraged and very welcome. They can be addressed to the IETF PCN working group mailing list <pcn@ietf.org>.14.15. Changes14.1.15.1. Changes from-02 to-03 to -04 oAbstract: Clarified by removingMinor changes throughout to reflect theterm 'aggregated'. Follow-up clarifications laterconsenus call about PCN- marking (as reflected indraft: S1: expanded PCN-egress-nodes bullet[I-D.eardley-pcn-marking-behaviour]). o Minor changes throughout tomention case wherereflect thePCN-feedback-information iscurrent decisions aboutone (or a few) PCN-marks, rather than aggregated information; S3 clarified PCN-meter; S5 minor changes; conclusion.encoding (as reflected in [I-D.moncaster-pcn-baseline-encoding]and [I-D.moncaster-pcn-3-state-encoding]). oS1: added a paragraph about how the PCN-domain looksIntroduction: re-structured tothe outside world (essentially it looks likecreate new sections on Benefits, Deployment scenarios and Assumptions. o Introduction: Added pointers to other PCN documents. o Terminology: changed PCN-lower-rate to PCN-threshold-rate and PCN- upper-rate to PCN-excess-rate; excess-rate-marking to excess- traffic-marking. o Benefits: added bullet about SRLGs. o Deployment scenarios: new section combining material from various places within the document. o S6 (high level functional architecture): re-structured and edited to improve clarity, and reflect the latest PCN-marking and encoding drafts. o S6.4: added claim that the most natural place to make an admission decision is aDiffServ domain).PCN-egress-node. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page38]36] Internet-Draft DocumentFebruaryJuly 2008 o S6.5: updated the bullet about non-PCN-traffic that uses the same DSCP as PCN-traffic. o S6.6: added a section about backwards compatibility with respect to [RFC4774]. o Appendix A: added bullet about end-to-end PCN. o Probing: moved to Appendix B. o Other minor clarifications, typos etc. 15.2. Changes from -02 to -03 o Abstract: Clarified by removing the term 'aggregated'. Follow-up clarifications later in draft: S1: expanded PCN-egress-nodes bullet to mention case where the PCN-feedback-information is about one (or a few) PCN-marks, rather than aggregated information; S3 clarified PCN-meter; S5 minor changes; conclusion. o S1: added a paragraph about how the PCN-domain looks to the outside world (essentially it looks like a DiffServ domain). o S2: tweaked the PCN-traffic terminology bullet: changed PCN traffic classes to PCN behaviour aggregates, to be more in line with traditional DiffServ jargon (-> follow-up changes later in draft); included a definition of PCN-flows (and corrected a couple of 'PCN microflows' to 'PCN-flows' later in draft) o S3.5: added possibility of downgrading to best effort, where PCN- packets arrive at PCN-ingress-node already ECN marked (CE or ECN nonce) o S4: added note about whether talk about PCN operating on an interface or ona link. In S8.1 (OAM) mentioneda link. In S8.1 (OAM) mentioned that PCN functionality needs to be configured consistently on either the ingress or the egress interface of PCN-nodes in a PCN-domain. o S5.2: clarified that signalling protocol installs flow filter spec at PCN-ingress-node (& updates after possible re-route) o S5.6: addressing: clarified o S5.7: added tunnelling issue of N^2 scaling if you set up a mesh of tunnels between PCN-boundary-nodes o S7.3: Clarified the "third viewpoint" of probing (always probe). Eardley (Editor) Expires January 15, 2009 [Page 37] Internet-Draft Document July 2008 o S8.1: clarified that SNMP is only an example; added note that an operator may be able to not run PCN on some PCN-interior-nodes, if it knows that these links will never become (pre-)congested; added note that it may be possible to have different PCN-boundary-node behaviours for different ingress-egress-aggregates within the same PCN-domain. o Appendix: Created an Appendix about "Possible work items beyond the scope of the current PCN WG Charter". Material moved from near start of S3 and elsewhere throughout draft. Moved text about centralised decision node to Appendix. o Other minor clarifications. 15.3. Changes from -01 to -02 o S1: Benefits: provisioning bullet extended to stress that PCN does not use RFC2475-style traffic conditioning. o S1: Deployment models: mentioned, as variant of PCN-domain extending to end nodes, that may extend to LAN edge switch. o S3.1: Trust Assumption: added note about not needing PCN-marking capability if known that an interface cannot become pre-congested. o S4: now divided into sub-sections o S4.1: Admission control: added second proposed method for how to decide to block new flows (PCN-egress-node receives one (or several) PCN-marked packets). o S5: Probing sub-section removed. Material now in new S7. o S5.6: Addressing: clarified how PCN-ingress-node can discover address of PCN-egress-node o S5.6: Addressing: centralised node case, added that PCN-ingress- node may need to know address of PCN-egress-node o S5.8: Tunnelling: added case of "partially PCN-capable tunnel" and degraded bullet on this in S6 (Open Issues) o S7: Probing: new section. Much more comprehensive than old S5.5. o S8: Operations and Management: substantially revised. o other minor changes not affecting semantics Eardley (Editor) Expires January 15, 2009 [Page 38] Internet-Draft Document July 2008 15.4. Changes from -00 to -01 In addition to clarifications and nit squashing, the main changes are: o S1: Benefits: added one about provisioning (and contrast with DiffServ SLAs) o S1: Benefits: clarified that the objective is also to stop PCN- packets being significantly delayed (previously only mentioned not dropping packets) o S1: Deployment models: added one where policing is done at ingress of access network and not at ingress of PCN-domain (assume trust between networks) o S1: Deployment models: corrected MPLS-TE to MPLS o S2: Terminology: adjusted definition of PCN-domain o S3.5: Other assumptions: corrected, so that two assumptions (PCN- nodes not performing ECN and PCN-ingress-node discarding arriving CE packet) only apply if the PCN WG decides to encode PCN-marking in the ECN-field. o S4 & S5: changed PCN-marking algorithm to marking behaviour o S4: clarified that PCN-interior-node functionality applies for each outgoing interface, and added clarification: "The functionality is also done by PCN-ingress-nodes for their outgoing interfaces (ie those 'inside' the PCN-domain)." o S4 (near end): altered to say that a PCN-node "should" dedicate some capacity to lower priority traffic so that it isn't starved (was "may") o S5: clarified to say that PCN functionality is done on an 'interface' (rather than on a 'link') o S5.2: deleted erroneous mention of service level agreement o S5.5: Probing: re-written, especially to distinguish probing to test the ingress-egress-aggregate from probing to test a particular ECMP path. o S5.7: Addressing: added mention of probing; added that in the case where traffic is always tunnelled across the PCN-domain, add a note that he PCN-ingress-node needs to know the address of the Eardley (Editor) Expires January 15, 2009 [Page 39] Internet-Draft Document July 2008 PCN-egress-node. o S5.8: Tunnelling: re-written, especially to provide a clearer description of copying on tunnel entry/exit, by adding explanation (keeping tunnel encaps/decaps and PCN-marking orthogonal), deleting one bullet ("if the inner header's marking state is more sever then it is preserved" - shouldn't happen), and better referencing of other IETF documents. o S6: Open issues: stressed that "NOTE: Potential solutions are out of scope for this document" and edited a couple of sentences that were close to solution space. o S6: Open issues: added one about scenarios with only one tunnel endpoint in the PCN domain . o S6: Open issues: ECMP: added under-admission as another potential risk o S6: Open issues: added one about "Silent at start" o S10: Conclusions: a small conclusions section added 16. Appendix A: Possible work items beyond the scope of the current PCN WG Charter This section mentions some topics that are outside the PCN WG's current Charter, but which have been mentioned as areas of interest. They might be work items for: the PCN WG after a future re- chartering; some other IETF WG; another standards body; an operator- specific usage that's not standardised. NOTE: it should be crystal clear that this section discusses possibilities only. The first set of possibilities relate to the restrictions on scope imposed by the PCN WG Charter (see Section 3): o a single PCN-domain encompasses several autonomous systems that don't trust each other (perhaps by using a mechanism like re-ECN, [I-D.briscoe-re-pcn-border-cheat]. o not all the nodes run PCN. For example, the PCN-domain is a multi-site enterprise network. The sites are connected by a VPN tunnel; although PCN doesn't operate inside the tunnel, the PCN mechanisms still work properly because the of the good QoS on the virtual link (the tunnel). Another example is that PCNfunctionality needs to be configured consistentlyis Eardley (Editor) Expires January 15, 2009 [Page 40] Internet-Draft Document July 2008 deployed oneithertheingress orgeneral Internet (ie widely but not universally deployed). o applying theegress interfacePCN mechanisms to other types ofPCN-nodes in a PCN-domain. o S5.2: clarifiedtraffic, ie beyond inelastic traffic. For instance, applying the PCN mechanisms to traffic scheduled with the Assured Forwarding per-hop behaviour. One example could be flow-rate adaptation by elastic applications, thatsignalling protocol installs flow filter spec at PCN-ingress-node (& updates after possible re-route) o S5.6: addressing: clarifiedadapts according to the pre-congestion information. oS5.7: added tunnelling issue of N^2 scaling if you set up a mesh of tunnels between PCN-boundary-nodesthe aggregation assumption doesn't hold, because the link capacity is too low. Measurement-based admission control is then risky. oS7.3: Clarifiedthe"third viewpoint"applicability ofprobing (always probe).PCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc.) Other possibilities include: oS8.1: clarified that SNMPThe PCN-domain extends to the end users. The scenario isonly an example; added note that an operator may be abledescribed in [I-D.babiarz-pcn-sip-cap]. The end users need tonot run PCN on some PCN-interior-nodes, if it knows that these links will never become (pre-)congested; added note that it maybepossibletrusted tohave different PCN-boundary-node behaviours for different ingress-egress-aggregates within the same PCN-domain. o Appendix: Created an Appendix about "Possible work items beyonddo their own policing. This scenario is in the scope of thecurrentPCN WGCharter". Material moved from near startcharter if there is sufficient traffic for the aggregation assumption to hold. A variant is that the PCN-domain extends out as far as the LAN edge switch. o indicating pre-congestion through signalling messages rather than in-band (in the form ofS3PCN-marked packets) o the decision-making functionality is at a centralised node rather than at the PCN-boundary-nodes. This requires that the PCN- egress-node signals PCN-feedback-information to the centralised node, andelsewhere throughout draft. Moved text aboutthat the centralised node signals to the PCN-ingress- node about the decision about admission (or termination). It may also need the centralised node and the PCN-boundary-nodes toAppendix. o Other minor clarifications. 14.2. Changes from -01know each other's addresses. It would be possible for the centralised node to-02 o S1: Benefits: provisioning bullet extendedbe one of the PCN-boundary-nodes, when clearly the signalling would sometimes be replaced by a message internal tostress that PCN does not use RFC2475-style traffic conditioning.the node. oS1: Deployment models: mentioned, as variantSignalling extensions for specific protocols (eg RSVP, NSIS). For example: the details of how the signalling protocol installs the flowspec at the PCN-ingress-node for an admitted PCN-flow; and how the signalling protocol carries the PCN-feedback-information. Perhaps also for other functions such as: coping with failure of a PCN-boundary-node ([I-D.briscoe-tsvwg-cl-architecture] considers what happens if RSVP is the QoS signalling protocol); establishing a tunnel across the PCN-domainextending to end nodes, that may extendif it is necessary toLAN edge switch.carry ECN marks transparently. Note: There is a PCN WG Milestone on "Requirements for signalling", which is potential input for the Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page39]41] Internet-Draft DocumentFebruaryJuly 2008 appropriate WGs. oS3.1: Trust Assumption: added note aboutPolicing by the PCN-ingress-node may notneeding PCN-marking capabilitybe needed ifknownthe PCN- domain can trust thatan interface cannot become pre-congested.the upstream network has already policed the traffic on its behalf. oS4: now divided into sub-sectionsPCN for Pseudowire: PCN may be used as a congestion avoidance mechanism for edge to edge pseudowire emulations [I-D.ietf-pwe3-congestion-frmwk]. oS4.1: Admission control: added second proposed methodPCN for MPLS: [RFC3270] defines how todecide to block new flows (PCN-egress-node receives one (or several) PCN-marked packets). o S5: Probing sub-section removed. Material nowsupport the DiffServ architecture innew S7. o S5.6: Addressing: clarifiedMPLS networks. [RFC5129] describes howPCN-ingress-node can discover address of PCN-egress-node o S5.6: Addressing: centralised node case, added that PCN-ingress- node may needtoknow addressadd PCN for admission control ofPCN-egress-node o S5.8: Tunnelling: added casemicroflows into a set of"partially PCN-capable tunnel" and degraded bullet on thisMPLS aggregates (Multi-protocol label switching). PCN-marking is done inS6 (Open Issues) o S7: Probing: new section. Much more comprehensive than old S5.5. o S8: Operations and Management: substantially revised.MPLS's EXP field (which [I-D.andersson-mpls-expbits-def] proposes to re- name to the Class of Service (CoS) bits). oother minor changes not affecting semantics 14.3. Changes from -00PCN for Ethernet: Similarly, it may be possible to-01 In additionextend PCN into Ethernet networks, where PCN-marking is done in the Ethernet header. NOTE: Specific consideration of this extension is outside the IETF's remit. . 17. Appendix B: Probing 17.1. Introduction Probing is an optional mechanism toclarifications and nit squashing,assist admission control. PCN's admission control, as described so far, is essentially a reactive mechanism where themain changes are: o S1: Benefits: added one about provisioning (and contrast with DiffServ SLAs) o S1: Benefits: clarifiedPCN-egress-node monitors the pre- congestion level for traffic from each PCN-ingress-node; if the level rises then it blocks new flows on that ingress-egress-aggregate. However, it's possible that an ingress-egress-aggregate carries no traffic, and so theobjectivePCN-egress-node can't make an admission decision using the usual method described earlier. One approach isalsotostop PCN- packets being significantly delayed (previously only mentioned not dropping packets) o S1: Deployment models: added one where policing is done at ingress of access networkbe "optimistic" andnot at ingress of PCN-domain (assume trust between networks) o S1: Deployment models: corrected MPLS-TEsimply admit the new flow. However it's possible toMPLS o S2: Terminology: adjusted definition of PCN-domain o S3.5: Other assumptions: corrected,envisage a scenario where the traffic levels on other ingress-egress-aggregates are already so high thattwo assumptions (PCN- nodes not performing ECNthey're blocking new PCN-flows, andPCN-ingress-node discarding arrivingadmitting a new flow onto this 'empty' ingress-egress-aggregate adds extra traffic onto the link that's already pre-congested - which may 'tip the balance' so that PCN's flow termination mechanism is activated or some packets are dropped. This risk could be lessened by configuring on each link sufficient 'safety margin' above the PCN-threshold-rate. Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page40]42] Internet-Draft DocumentFebruaryJuly 2008CE packet) only apply ifAn alternative approach is to make PCN a more proactive mechanism. The PCN-ingress-node explicitly determines, before admitting thePCN WG decides to encode PCN-markingprospective new flow, whether the ingress-egress-aggregate can support it. This can be seen as a "pessimistic" approach, in contrast to theECN-field. o S4 & S5: changed PCN-marking algorithm"optimism" of the approach above. It involves probing: a PCN-ingress-node generates and sends probe packets in order tomarking behaviour o S4: clarifiedtest the pre-congestion level thatPCN-interior-node functionality applies for each outgoing interface, and added clarification: "The functionalitythe flow would experience. One possibility isalso donethat a probe packet is just a dummy data packet, generated byPCN-ingress-nodes for their outgoing interfaces (ie those 'inside'thePCN-domain)." o S4 (near end): alteredPCN-ingress-node and addressed tosaythe PCN-egress- node. Another possibility is that aPCN-node "should" dedicate some capacity to lower priority traffic so that it isn't starved (was "may") o S5: clarified to say that PCN functionalityprobe packet isdone on an 'interface' (rather than ona'link') o S5.2: deleted erroneous mention of service level agreement o S5.5: Probing: re-written, especially to distinguish probingsignalling packet that is anyway travelling from the PCN-ingress-node totesttheingress-egress-aggregatePCN-egress-node (eg an RSVP PATH message travelling fromprobingsource totest a particular ECMP path.destination). 17.2. Probing functions The probing functions are: oS5.7: Addressing: added mention of probing; addedMake decision thatinprobing is needed. As described above, this is when thecase where trafficingress-egress-aggregate (or the ECMP path - Section 8) carries no PCN-traffic. An alternative is alwaystunnelled acrossto probe, ie probe before admitting every PCN-flow. o (if required) Communicate the request that probing is needed - thePCN-domain, add a notePCN-egress-node signals to the PCN-ingress-node thatheprobing is needed o (if required) Generate probe traffic - the PCN-ingress-nodeneeds to knowgenerates theaddressprobe traffic. The appropriate number (or rate) of probe packets will depend on thePCN-egress-node. o S5.8: Tunnelling: re-written, especially to providePCN-marking algorithm; for example an excess-traffic-marking algorithm generates fewer PCN- marks than aclearer description of copying on tunnel entry/exit, by adding explanation (keeping tunnel encaps/decapsthreshold-marking algorithm, andPCN-marking orthogonal), deleting one bullet ("if the inner header's marking state isso will need moresever then it is preserved" - shouldn't happen), and better referencing of other IETF documents.probe packets. oS6: Open issues: stressed that "NOTE: Potential solutionsForward probe packets - as far as PCN-interior-nodes areoutconcerned, probe packets are handled the same as (ordinary data) PCN-packets, in terms ofscope for this document"routing, scheduling andedited a couple of sentences that were close to solution space.PCN-marking. oS6: Open issues: added one about scenarios with only one tunnel endpoint inConsume probe packets - thePCN domain . o S6: Open issues: ECMP: added under-admission as another potential risk o S6: Open issues: added one about "Silent at start" Eardley (Editor) Expires August 11, 2008 [Page 41] Internet-Draft Document February 2008 o S10: Conclusions: a small conclusions section added 15. Appendix A: Possible work itemsPCN-egress-node consumes probe packets to ensure that they don't travel beyond thescopePCN-domain. 17.3. Discussion ofthe current PCN WG Charter This section mentions some topics that are outside the PCN WG's current Charter,rationale for probing, its downsides and open issues It is an unresolved question whether probing is really needed, butwhichthree viewpoints have beenmentionedput forward asareas of interest. They might be work items for: the PCN WG after a future re- chartering; some other IETF WG; another standards body; an operator- specific usage that's not standardised. NOTE:to why itshould be crystal clear that this section discusses possibilities only.is useful. The Eardley (Editor) Expires January 15, 2009 [Page 43] Internet-Draft Document July 2008 firstset of possibilities relate tois perhaps therestrictionsmost obvious: there is no PCN-traffic onscope imposed bythePCN WG Charter (see Section 3): o a single PCN-domain encompasses several autonomous systemsingress-egress-aggregate. The second assumes thatdon't trust each other (perhapsmultipath routing ECMP is running in the PCN-domain. The third viewpoint is that admission control is always done byusingprobing. We now consider each in turn. The first viewpoint assumes the following: o There is no PCN-traffic on the ingress-egress-aggregate (so amechanism like re-ECN, [I-D.briscoe-re-pcn-border-cheat].normal admission decision cannot be made). onot allSimply admitting thenodes run PCN. For example,new flow has a significant risk of leading to overload: packets dropped or flows terminated. On thePCN-domain isformer bullet, [PCN-email-traffic-empty-aggregates] suggests that, during the future busy hour of amulti-site enterprise network. The sitesnational network with about 100 PCN-boundary-nodes, there areconnected bylikely to be significant numbers of aggregates with very few flows under nearly all circumstances. The latter bullet could occur if aVPN tunnel; although PCN doesn't operate inside the tunnel, the PCN mechanisms still work properly because thenew flow starts on many of thegood QoSempty ingress-egress-aggregates and causes overload onthe virtuala link(the tunnel). Another example is that PCN is deployed on the general Internet (ie widely but not universally deployed). o applyingin thePCN mechanismsPCN-domain. To be a problem this would probably have toother types of traffic, ie beyond inelastic traffic. For instance, applyinghappen in a short time period (flash crowd) because, after thePCN mechanisms to traffic scheduled withreaction time of theAssured Forwarding per-hop behaviour. One example could be flow-rate adaptation by elastic applications,system, other (non-empty) ingress-egress-aggregates thatadapts according topass through the link will measure pre-congestioninformation.and so block new flows, and also flows naturally end anyway. The downsides of probing for this viewpoint are: o Probing adds delay to theaggregation assumption doesn't hold, because the link capacity is too low. Measurement-basedadmission controlis then risky.process. o Sufficient probing traffic has to be generated to test theapplicabilitypre- congestion level ofPCN mechanisms for emergency use (911, GETS, WPS, MLPP, etc.) Other possibilitiesthe ingress-egress-aggregate. But the probing traffic itself may cause pre-congestion, causing other PCN-flows to be blocked or even terminated - and in the flash crowd scenario there will be probing on many ingress-egress-aggregates. The open issues associated with this viewpoint include: oindicating pre-congestion through signalling messages rather than in-band (inWhat rate and pattern of probe packets does theformPCN-ingress-node need to generate, so that there's enough traffic to make the admission decision? o What difficulty does the delay (whilst probing is done) cause applications, eg packets might be dropped? o Are there other ways ofPCN-marked packets)dealing with the flash crowd scenario? For instance limit the rate at which new flows are admitted; or Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page42]44] Internet-Draft DocumentFebruaryJuly 2008operhaps for a PCN-egress-node to block new flows on its empty ingress-egress-aggregates when its non-empty ones are pre- congested. The second viewpoint applies in thedecision-making functionalitycase where there isat a centralised node rather than atmultipath routing (ECMP) in thePCN-boundary-nodes. This requiresPCN-domain. Note that ECMP is often used on core networks. There are two possibilities: (1) If admission control is based on measurements of thePCN- egress-node signals PCN-feedback-information toingress- egress-aggregate, then thecentralised node, andviewpoint that probing is useful assumes: o there's a significant chance that thecentralised node signals to the PCN-ingress- node about the decision about admission (or termination). It may also needtraffic is unevenly balanced across thecentralised nodeECMP paths, andthe PCN-boundary-nodes to know each others addresses. It wouldhence there's a significant risk of admitting a flow that should bepossible for the centralised node toblocked (because it follows an ECMP path that is pre-congested) or blocking a flow that should beoneadmitted. o Note: [PCN-email-ECMP] suggests unbalanced traffic is quite possible, even with quite a large number ofthe PCN-boundary-nodes, when clearly the signalling would sometimes be replaced byflows on amessage internalPCN-link (eg 1000) when Assumption 3 (aggregation) is likely to be satisfied. (2) If admission control is based on measurements of pre-congestion on specific ECMP paths, then the viewpoint that probing is useful assumes: o There is no PCN-traffic on thenode.ECMP path on which to base an admission decision. oIt would be possible forSimply admitting thecentralised node to be onenew flow has a significant risk ofthe PCN-boundary-nodes, when clearly the signalling would sometimes be replaced byleading to overload. o The PCN-egress-node can match amessage internalpacket tothe node.an ECMP path. osignalling extensions for specific protocols (eg RSVP, NSIS). For example: the details of how the signalling protocol installs the flowspec atNote: This is similar to thePCN-ingress-node for an admitted PCN-flow;first viewpoint andhow the signalling protocol carries the PCN-feedback-information. Perhaps also for other functions such as: coping with failure ofso similarly could occur in aPCN-boundary-node ([I-D.briscoe-tsvwg-cl-architecture] considers what happensflash crowd ifRSVPa new flow starts more-or-less simultaneously on many of the empty ECMP paths. Because there are several (sometimes many) ECMP paths between each pair of PCN- boundary-nodes, it's presumably more likely that an ECMP path is 'empty' than an ingress-egress-aggregate. To constrain theQoS signalling protocol); establishingnumber of ECMP paths, atunnel acrossfew tunnels could be set-up between each pair of PCN-boundary-nodes. Tunnelling also solves thePCN-domain if itthird bullet (which isnecessary to carry ECN marks transparently. Note: Thereotherwise hard because an ECMP routing decision isa PCN WG Milestonemade independently on"Requirements for signalling", which is potential inputeach node). The downsides of probing forthe appropriate WGs.this viewpoint are: Eardley (Editor) Expires January 15, 2009 [Page 45] Internet-Draft Document July 2008 opolicing byProbing adds delay to thePCN-ingress-node may notadmission control process. o Sufficient probing traffic has to beneeded ifgenerated to test thePCN- domain can trust thatpre- congestion level of theupstream network has already policedECMP path. But there's the risk that the probing trafficon its behalf. o PCN for Pseudowire: PCNitself maybe used as a congestion avoidance mechanism for edgecause pre-congestion, causing other PCN-flows toedge pseudowire emulations [I-D.ietf-pwe3-congestion-frmwk].be blocked or even terminated. oPCN for MPLS: [RFC3270] defines howThe PCN-egress-node needs tosupportconsume theDiffServ architecture in MPLS networks. [RFC5129] describes howprobe packets toadd PCN for admission control of microflows intoensure they don't travel beyond the PCN-domain (eg they might confuse the destination end node). Hence somehow the PCN-egress-node has to be able to disambiguate asetprobe packet from a data packet, via the characteristic setting ofMPLS aggregates (Multi-protocol label switching). PCN-marking is doneparticular bit(s) inMPLS's EXP field. o PCN for Ethernet: Similarly,the packet's header or body - but these bit(s) mustn't be used by any PCN-interior- node's ECMP algorithm. In the general case this isn't possible, but itmayshould bepossible to extend PCN into Ethernet networks, whereOK for a typical ECMP algorithm which examines: the source and destination IP addresses and port numbers, the protocol ID and the DSCP. The third viewpoint assumes the following: o Every admission control decision involves probing, using the signalling set-up message as the probe packet (eg RSVP PATH). o The PCN-marking behaviour isdonesuch that every packet is PCN-marked if the flow should be blocked, hence only a single probing packet is needed. This viewpoint [I-D.draft-babiarz-pcn-3sm] has in particular been suggested for theEthernet header. . Eardley (Editor) Expires August 11, 2008 [Page 43] Internet-Draft Document February 2008 16.scenario where the PCN-domain reaches out towards the end terminals (note that it's assumed the trust and aggregation assumptions still hold), although it has also been suggested for other scenarios. 18. Informative References [I-D.briscoe-tsvwg-cl-architecture] Briscoe, B., "An edge-to-edge Deployment Model for Pre- Congestion Notification: Admission Control over a DiffServ Region", draft-briscoe-tsvwg-cl-architecture-04 (work in progress), October 2006. [I-D.briscoe-tsvwg-cl-phb] Briscoe, B., "Pre-Congestion Notification marking", draft-briscoe-tsvwg-cl-phb-03 (work in progress), October 2006. [I-D.babiarz-pcn-sip-cap] Eardley (Editor) Expires January 15, 2009 [Page 46] Internet-Draft Document July 2008 Babiarz, J., "SIP Controlled Admission and Preemption", draft-babiarz-pcn-sip-cap-00 (work in progress), October 2006. [I-D.lefaucheur-rsvp-ecn] Faucheur, F., "RSVP Extensions for Admission Control over Diffserv using Pre-congestion Notification (PCN)", draft-lefaucheur-rsvp-ecn-01 (work in progress), June 2006. [I-D.chan-pcn-problem-statement] Chan, K., "Pre-Congestion Notification Problem Statement", draft-chan-pcn-problem-statement-01 (work in progress), October 2006. [I-D.ietf-pwe3-congestion-frmwk]Bryant, S.,"Pseudowire Congestion Control Framework",draft-ietf-pwe3-congestion-frmwk-00 (work in progress), February 2007. [I-D.ietf-tsvwg-admitted-realtime-dscp] "DSCPs for Capacity-Admitted Traffic", November 2006, <htt p://www.ietf.org/internet-drafts/ ietf-tsvwg-admitted-realtime-dscp-02.txt>.May 2008, <http ://www.ietf.org/internet-drafts/ draft-ietf-pwe3-congestion-frmwk-01.txt>. [I-D.briscoe-tsvwg-ecn-tunnel] "Layered Encapsulation of Congestion Notification",June 2007,July 2008, <http://www.ietf.org/internet-drafts/briscoe-tsvwg-ecn-tunnel-00.txt>.briscoe-tsvwg-ecn-tunnel-01.txt>. [I-D.charny-pcn-single-marking] "Pre-Congestion Notification Using Single Marking for Admission and Termination", November 2007, <http:// www.ietf.org/internet-drafts/Eardley (Editor) Expires August 11, 2008 [Page 44] Internet-Draft Document February 2008draft-charny-pcn-single-marking-03.txt>. [I-D.eardley-pcn-architecture] "Pre-Congestion Notification Architecture", June 2007, <ht tp://www.ietf.org/internet-drafts/ draft-eardley-pcn-architecture-00.txt>. [I-D.westberg-pcn-load-control] "LC-PCN: The Load Control PCN Solution",November 2007,February 2008, <h ttp://www.ietf.org/internet-drafts/draft-westberg-pcn-load-control-02.txt>.draft-westberg-pcn-load-control-03.txt>. [I-D.behringer-tsvwg-rsvp-security-groupkeying] "Applicability of Keying Methods for RSVP Security", November 2007, <http://www.watersprings.org/pub/id/ draft-behringer-tsvwg-rsvp-security-groupkeying-01.txt>. [I-D.briscoe-re-pcn-border-cheat] "Emulating Border Flow Policing using Re-ECN on Bulk Eardley (Editor) Expires January 15, 2009 [Page 47] Internet-Draft Document July 2008 Data",June 2006, <http://www.watersprings.org/pub/id/ briscoe-re-pcn-border-cheat-01.txt>.February 2008, <http://tools.ietf.org/id/ draft-briscoe-re-pcn-border-cheat-01.txt>. [I-D.draft-babiarz-pcn-3sm] "Three State PCN Marking", November 2007, <http:// www.watersprings.org/pub/id/draft-babiarz-pcn-3sm-01.txt>. [RFC5129] "Explicit Congestion Marking in MPLS", RFC 5129, January 2008. [RFC4303] Kent, S., "IP Encapsulating Security Payload (ESP)", RFC 4303, December 2005. [RFC2475] Blake, S., Black, D., Carlson, M., Davies, E., Wang, Z., and W. Weiss, "An Architecture for Differentiated Services", RFC 2475, December 1998. [RFC3246] Davie, B., Charny, A., Bennet, J., Benson, K., Le Boudec, J., Courtney, W., Davari, S., Firoiu, V., and D. Stiliadis, "An Expedited Forwarding PHB (Per-Hop Behavior)", RFC 3246, March 2002. [RFC4594] Babiarz, J., Chan, K., and F. Baker, "Configuration Guidelines for DiffServ Service Classes", RFC 4594, August 2006. [RFC3168] Ramakrishnan, K., Floyd, S., and D. Black, "The Addition of Explicit Congestion Notification (ECN) to IP", RFC 3168, September 2001.Eardley (Editor) Expires August 11, 2008 [Page 45] Internet-Draft Document February 2008[RFC2211] Wroclawski, J., "Specification of the Controlled-Load Network Element Service", RFC 2211, September 1997. [RFC2998] Bernet, Y., Ford, P., Yavatkar, R., Baker, F., Zhang, L., Speer, M., Braden, R., Davie, B., Wroclawski, J., and E. Felstaine, "A Framework for Integrated Services Operation over Diffserv Networks", RFC 2998, November 2000. [RFC3270] Le Faucheur, F., Wu, L., Davie, B., Davari, S., Vaananen, P., Krishnan, R., Cheval, P., and J. Heinanen, "Multi- Protocol Label Switching (MPLS) Support of Differentiated Services", RFC 3270, May 2002. [RFC1633] Braden, B., Clark, D., and S. Shenker, "Integrated Services in the Internet Architecture: an Overview", RFC 1633, June 1994. [RFC2983] Black, D., "Differentiated Services and Tunnels", Eardley (Editor) Expires January 15, 2009 [Page 48] Internet-Draft Document July 2008 RFC 2983, October 2000. [RFC2747] Baker, F., Lindell, B., and M. Talwar, "RSVP Cryptographic Authentication", RFC 2747, January 2000. [RFC3411] Harrington, D., Presuhn, R., and B. Wijnen, "An Architecture for Describing Simple Network Management Protocol (SNMP) Management Frameworks", STD 62, RFC 3411, December 2002. [RFC3393] Demichelis, C. and P. Chimento, "IP Packet Delay Variation Metric for IP Performance Metrics (IPPM)", RFC 3393, November 2002. [RFC4216] Zhang, R. and J. Vasseur, "MPLS Inter-Autonomous System (AS) Traffic Engineering (TE) Requirements", RFC 4216, November 2005. [RFC4656] Shalunov, S., Teitelbaum, B., Karp, A., Boote, J., and M. Zekauskas, "A One-way Active Measurement Protocol (OWAMP)", RFC 4656, September 2006. [RFC4774] Floyd, S., "Specifying Alternate Semantics for the Explicit Congestion Notification (ECN) Field", BCP 124, RFC 4774, November 2006. [RFC4778] Kaeo, M., "Operational Security Current Practices in Internet Service Provider Environments", RFC 4778, January 2007. [ITU-MLPP] "Multilevel Precedence and Pre-emption Service (MLPP)", ITU-T Recommendation I.255.3, 1990. [Iyer] "An approach to alleviate link overload as observed on an IP backbone", IEEE INFOCOM , 2003, <http://www.ieee-infocom.org/2003/papers/10_04.pdf>.Eardley (Editor) Expires August 11, 2008 [Page 46] Internet-Draft Document February 2008 [Shenker] "Fundamental design issues for the future Internet", IEEE Journal on selected areas in communications pp 1176 - 1188, Vol 13 (7), 1995.[Y.1541] "Network Performance Objectives for IP-based Services", ITU-T Recommendation Y.1541, February 2006. [P.800] "Methods for subjective determination of transmission quality", ITU-T Recommendation P.800, August 1996. [Songhurst] "Guaranteed QoS Synthesis for Admission Control with Shared Capacity", BT Technical Report TR-CXR9-2006-001, Feburary 2006, <http://www.cs.ucl.ac.uk/staff/B.Briscoe/ Eardley (Editor) Expires January 15, 2009 [Page 49] Internet-Draft Document July 2008 projects/ipe2eqos/gqs/papers/GQS_shared_tr.pdf>. [Menth] "PCN-Based Resilient Network Admission Control: The Impact of a Single Bit"", Technical Report , 2007, <http:// www3.informatik.uni-wuerzburg.de/staff/menth/Publications/ Menth07-PCN-Config.pdf>. [PCN-email-ECMP] "Email to PCN WG mailing list", November 2007, <http:// www1.ietf.org/mail-archive/web/pcn/current/msg00871.html>. [PCN-email-traffic-empty-aggregates] "Email to PCN WG mailing list", October 2007, <http:// www1.ietf.org/mail-archive/web/pcn/current/msg00831.html>. [PCN-email-SRLG] "Email to PCN WG mailing list", March 2008, <http:// www1.ietf.org/mail-archive/web/pcn/current/msg01359.html>. [I-D.eardley-pcn-marking-behaviour] "Marking behaviour of PCN-nodes", June 2008, <http:// www.ietf.org/internet-drafts/ draft-eardley-pcn-marking-behaviour-01.txt>. [I-D.moncaster-pcn-baseline-encoding] "Baseline Encoding and Transport of Pre-Congestion Information", July 2008, <http://www.ietf.org/ internet-drafts/ draft-moncaster-pcn-baseline-encoding-02.txt>. [I-D.moncaster-pcn-3-state-encoding] "A three state extended PCN encoding scheme", June 2008, < http://www.ietf.org/internet-drafts/ draft-moncaster-pcn-3-state-encoding-00.txt>. [I-D.charny-pcn-comparison] "Pre-Congestion Notification Using Single Marking for Admission and Termination", November 2007, <http:// www.watersprings.org/pub/id/ draft-charny-pcn-comparison-00.txt>. [I-D.tsou-pcn-racf-applic] "Applicability Statement for the Use of Pre-Congestion Notification in a Resource-Controlled Network", February 2008, <http://tools.ietf.org/id/ draft-tsou-pcn-racf-applic-00.txt>. [I-D.sarker-pcn-ecn-pcn-usecases] Eardley (Editor) Expires January 15, 2009 [Page 50] Internet-Draft Document July 2008 "Usecases and Benefits of end to end ECN support in PCN Domains", May 2008, <http://tools.ietf.org/id/ draft-sarker-pcn-ecn-pcn-usecases-01.txt>. [I-D.andersson-mpls-expbits-def] "MPLS EXP-bits definition", March 2008, <http:// tools.ietf.org/id/ draft-andersson-mpls-expbits-def-00.txt>. [Menth08] "PCN-Based Admission Control and Flow Termination", 2008, <http://www3.informatik.uni-wuerzburg.de/staff/menth/ Publications/Menth08-PCN-Comparison.pdf>. [Hancock] "Slide 14 of 'NSIS: An Outline Framework for QoS Signalling'", May 2002, <http://www-nrc.nokia.com/sua/ nsis/interim/nsis-framework-outline.ppt>. Author's Address Philip Eardley BT B54/77, Sirius House Adastral Park Martlesham Heath Ipswich, Suffolk IP5 3RE United Kingdom Email: philip.eardley@bt.com Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page47]51] Internet-Draft DocumentFebruaryJuly 2008 Full Copyright Statement Copyright (C) The IETF Trust (2008). This document is subject to the rights, licenses and restrictions contained in BCP 78, and except as set forth therein, the authors retain all their rights. This document and the information contained herein are provided on an "AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY, THE IETF TRUST AND THE INTERNET ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Intellectual Property The IETF takes no position regarding the validity or scope of any Intellectual Property Rights or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; nor does it represent that it has made any independent effort to identify any such rights. Information on the procedures with respect to rights in RFC documents can be found in BCP 78 and BCP 79. Copies of IPR disclosures made to the IETF Secretariat and any assurances of licenses to be made available, or the result of an attempt made to obtain a general license or permission for the use of such proprietary rights by implementers or users of this specification can be obtained from the IETF on-line IPR repository at http://www.ietf.org/ipr. The IETF invites any interested party to bring to its attention any copyrights, patents or patent applications, or other proprietary rights that may cover technology that may be required to implement this standard. Please address the information to the IETF at ietf-ipr@ietf.org. Acknowledgment Funding for the RFC Editor function is provided by the IETF Administrative Support Activity (IASA). Eardley (Editor) ExpiresAugust 11, 2008January 15, 2009 [Page48]52] ----