view Side-By-Side changes
LDAP Duplication/Replication/Update Tivoli Systems Protocols WG Russel F. Weiser Intended Category: InformationalDraftDigital Signature TrustCo. Expires 21 AprilExpires: March 2001 Ryan D. Moats Coreon, Inc. Richard V. Huber AT&T Laboratories September 2000Ellen Stokes IBM 21 October 1999 LDAP V3LDAPv3 Replication Requirements<draft-ietf-ldup-replica-req-02.txt>draft-ietf-ldup-replica-req-04.txt Status ofthisThis Memo This document isaman Internet-Draft and is in full conformance with all provisions of Section 10 of RFC2026. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF), its areas, and its working groups. Note that other groups may also distribute working documents asInternet- Drafts.Internet-Drafts. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as``work"work inprogress.''progress." The list of current Internet-Drafts can be accessed athttp://www.ietf.org/ietf/lid-abstracts.txthttp://www.ietf.org/ietf/lid-abstracts.txt. The list of Internet-Drafts Shadow Directories can be accessed at http://www.ietf.org/shadow.html. Copyright Notice Copyright (C) The Internet Society (2000). All Rights Reserved. Abstract This document discusses the fundamental requirements for replication of data accessible via the LDAPv3 [RFC2251] protocol. It is intended to be a gathering place for general replication requirements needed to provide interoperability between informational directories. Stokes, et al Expires February 2001 [Page 1] Internet-Draft LDAPv3 Replication Requirements August 2000 The key wordsMUST, MUST"MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in [RFC2119].Weiser & Stokes 21 April 2000 [PAGE 1] INTERNET-DRAFT LDAPStokes, et al Expires February 2001 [Page 2] Internet-Draft LDAPv3 Replication Requirements21 October 1999August 2000 Table of Contents1.Introduction.....................................................3 2. Terminology.....................................................3 3. Objective.......................................................5 4. Applicability Statement.........................................5 5. Replication Model..............................................10 6. Replication Protocol...........................................12 7. Schema.........................................................13 8.1 Introduction.......................................................4 2 Terminology........................................................4 3 The Possible Models................................................7 4 Requirements.......................................................8 4.1 General.........................................................8 4.2 Model...........................................................8 4.3 Protocol.......................................................10 4.4 Schema.........................................................10 4.5 Single Master..................................................11 4.6 Multi-Master...................................................11 4.7 Administration andManagement Considerations...................13 9. Acknowledgement................................................14 10. References....................................................15 11. Author's Address..............................................15 Weiser & Stokes 21 April 2000Management..................................12 4.8 Security.......................................................12 5 Security Considerations...........................................13 6 Acknowledgements..................................................13 7 References........................................................13 A.APPENDIX A - Usage Scenarios......................................14 A.1.Extranet Example...............................................14 A.2.Consolidation Example..........................................14 A.3.Replication Heterogeneous Deployment Example...................14 A.4.Shared Name Space Example......................................15 A.5.Supplier Initiated Replication.................................15 A.6.Consumer Initiated Replication.................................15 A.7.Prioritized attribute replication..............................16 A.8.Bandwidth issues...............................................16 A.9.Interoperable Administration and Management....................16 A.10.Enterprise Directory Replication Mesh.........................17 A.11.Failure of the Master in a Master-Slave Replicated Directory..17 A.12.Failure of a Directory Holding Critical Service Information...18 B.APPENDIX B - Rationale............................................18 B.1.Meta-Data Implications.........................................18 B.2.Order of Transfer for Replicating Data.........................18 B.3.Schema Mismatches and Replication..............................19 B.4.Detecting and Repairing Inconsistencies Among Replicas.........20 B.5.Some Test Cases for Conflict Resolution in Multi-Master Replication........................................................21 B.6.Data Privacy During Replication................................24 B.7.Failover in Single-Master Systems..............................25 B.8.Including Operational Attributes in Atomic Operations..........26 Authors' Addresses...................................................26 Full Copyright Statement.............................................27 Stokes, et al Expires February 2001 [Page2] INTERNET-DRAFT LDAP3] Internet-Draft LDAPv3 Replication Requirements21 October 1999 1.August 2000 1 Introduction The ability to distribute directory information throughout the network provides atwo foldtwo-fold benefit to the network: (1) increasing the reliability of the directory through fault tolerance, and (2) brings the directory content closer to the clients using the data.LDAPÆsLDAP's acceptance as an access protocol for directory information is driving the need to distribute LDAP directory content among servers within enterprise and Internet. Currently LDAP does not define a replication mechanism and only generally mentions LDAP shadow servers (see[RFC2251] and [Changelog])[RFC2251]) in passing.The requirementsA standard mechanism for replicationarethat operates in a multi-vendor directory environment is critical to the successful deployment and acceptance of LDAP in the market place.2. Terminology ForThis document sets out the requirements for replication between multiple LDAP servers. While RFC 2251 and RFC 2252 [RFC2252] set forth the standards for communication between LDAP clients and servers there are additional requirements for server-to-server communication. Some of these are covered here. This document first introduces the terminology to be used, then presents the different replication models being considered. The actual requirements follow, along with security considerations. The reasoning that leads to the requirements is presented in thepurposesAppendix. This was done to provide a clean separation ofthis document,the requirements from their justification. 2 Terminology The followingterminology definitionsterms areused:used in this document: Area of replication - A whole or portion of adirectory tree(DIT) makingDirectory Information Tree (DIT) that makes up a distinct unit of data to be replicated. This may also be known as "unit of replication". Atomic operation -The ability to treat and contain several updates or attributeA set of changesas a single operation for replication purposestoguarantee thatdirectory data which theseveral updates or attribute changes are propagated to a replicaLDAP standards guarantee will be treated as asingle unit. Authoritative Master Replicaunit; all changes will be made or all the changes will fail. Atomicity Information -The Primary updateable replicaInformation about atomic operations passed as part ofthe replicated information.replication. Conflictresolution-Deterministic procedures withinA situation that arises when changes are made to the same directory data on different directory servers before replicationprotocols, utilizedcan Stokes, et al Expires February 2001 [Page 4] Internet-Draft LDAPv3 Replication Requirements August 2000 synchronize the data on the servers. When the servers do synchronize, they have inconsistent data - a conflict. Conflict resolution - Deterministic procedures used to resolve change information conflicts that may arisedueduring replication. Critical OID - Attributes or object classes defined in the replication agreement as being critical toconflicting changesthe operation of the system. Changes affecting critical OIDs cause immediate initiation of adirectory entry.replica cycle. An example of a critical OID might be a password or certificate. Fractional replication -TheThis is the capability to replicate a subset (as opposed to the full set) of attributes ofany given entry.those entries being replicated. Incremental Update -The process of updating a replica, or copy, of a naming context, by updatingA replica update that contains only thosefieldsattributes or objectswhichthat have changed. Master Replica - In a Master-Slave Replication system, the Master Replica is the only updateable replica in the replica ring. It is the supplier in all replication sessions. Master Slave, or Single Master Replication -ReplicationA replication model that assumes only one server, the master, allows write access to the replicated data. Note that Master-Slave replication can be considered a proper subset of multi-master replication.Weiser & Stokes 21 April 2000 [Page 3] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999Meta-Data - Data collected by the replication system that describes the status/state of replication. Multi-Master Replication - A replication model where entries can be written and updated on any of several updateable replica copies without requiring communication with other updateable replicas before the write or update is performed. Naming Context - Suffix of aSub-tree. Asub-tree of entries held in a single server [X.500]. One-way Replication - The process of synchronization in a single direction where the authoritative source information is provided to a replica. Partial Replication -The capability to replicate some subset of entries in a naming context.Partial Replication is Fractional Replication, Sparse Replication, or both. Stokes, et al Expires February 2001 [Page 5] Internet-Draft LDAPv3 Replication Requirements August 2000 Propagation behavior - The general behavior of the actual synchronization process between a consumer and a provider of replication information. Read-only Replica - A read-only copy of a replicated directory. Aread-onlyread- only replica is assumed to be a slave replicaof master slave orin the single master replication definition. Replica - A single instance of a whole or portion of theDirectory tree (DIT)DIT as defined by the area of replication. Replica Ring - A set of servers, which hold in common the same DIT information as, defined byôArea"Area ofreplicationö.replication". These servers may be managed under a single replication agreement that handles all members of the set of servers as a group. Replica (or Replication) Cycle -WhenA replica cycle is the communication of a change or groups of changes that need to be propagated totheothermembermembers of a replica ring. The process of contacting a replica memberwould beis considered the beginning of a replicationcycle;cycle while the termination of communications with a replica is the end of thecycle whether itscycle. Termination can occur either due to an error or successful exchange of update records. Replication - The process of copying portions of naming context information and content between multiple LDAP servers, such that certain predefined portions of the information are available from different servers.Replication can occur between either homogeneous implementations across heterogeneous platforms (operating systems) or heterogeneous implementations supporting identicalThe replicationacross heterogeneous platforms (operating systems). Sparse Replicaprocess is neither implementation nor platform specific. Replication Agreement - Aincomplete copycollection of information describing the parameters ofa sub-tree which maybe inclusive with updateable, or Read-only. See Partialreplicationand Weiser & Stokes 21 April 2000 [Page 4] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 Fractional replication. Topologybetween two or more servers in a replica ring. Replication Initiation Conflict -RefersIn multi-master replication, a Replication Initiation Conflict is a situation where two masters want to update the same replica at the same time. Replication Session - A session set up between two servers in a replica ring to pass update information as part of a Replica Cycle. Slave (or Read-Only) Replica - A replica that cannot be directly updated. Changes may only be made via replication from a master replica. Sparse Replication - The capability to replicate some subset of entries (other than a complete naming context) of a naming context. Stokes, et al Expires February 2001 [Page 6] Internet-Draft LDAPv3 Replication Requirements August 2000 Topology - The shape of the directed graph describing the relationships betweenreplicas, as in the replicated directory topology.replicas. Two-way Replication - The process of synchronization where change informationmay flowflows bi-directionally between tworeplica.replicas. Update Propagation - Protocol-based process by which directory replicas are reconciled. Updateable Replica - ANon-authoritativeread-writeable copy of the replicated information.Such that during conflict resolution a authoritative master takes precedents in resolving conflicts. 3. Objective3 The Possible Models The major objective is to provide an interoperable LDAP V3 directory synchronization protocolwhichthat is simple, highly efficient and flexible enough to support both multi-master and master-slave replicationoperations tooperations. Such a protocol would meet the needs of both theinternetInternet and enterprise environments.4. Applicability Statement GenerallyGenerally, replication can be characterized by looking at data consistency models across existing technologies. Thismay provideprovides insight to LDAP v3 replication requirements. The following is a brief examination ofthe followingdata consistency models. Model 1:TightTransactional Consistency --Includes environments whereEnvironments that exhibit allreplicas must always contain exactlyfour of thesame directory content. Two phase commit transaction models may be used to preserve transaction consistency.ACID properties (Atomicity, Concurrency, Independence, Durability) [ACID]. Model 2: Eventual Consistency or Transient Consistency --Includes X.500 Directories, Bayou [XEROX], and NDS (Novell Directory Services) names serviceEnvironments where definite knowledge of the global replica topology is provided through predetermined replication agreements.Such thatExamples include X.500 Directories, Bayou [XEROX], and NDS (Novell Directory Services) [NDS]. In this model, every update propagates to every replica that it can reach via a path of stepwise eventual connectivity.Transaction consistency is preserved for transactions directed at the master server in X.500 implementations. NDS additionally provides deterministic consistency over time to all replicas due to its inherent replication policies. Weiser & Stokes 21 April 2000 [Page 5] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999Model 3: Limited Effort Eventual Consistency --Includes Xerox Clearinghouse [XEROX]Environments thatprovidesprovide a statistical probability of convergence with global knowledge of replica topology.SimilarAn example is the Xerox Clearinghouse [XEROX]. This model is similar to "Eventual Consistency", except where replicas may purgeupdates therefore droppingupdates. Purging drops propagation changes when some replica time boundary is exceeded, thus leaving some changes replicated to only a portion of the replica topology. Transactional consistency is not preserved, though some weaker constraints on consistency are available. Model 4: Loosest Consistency --Includes opportunistic or simple cacheEnvironments where information is provided fromthean opportunistic or simple cache until stale. Stokes, et al Expires February 2001 [Page 7] Internet-Draft LDAPv3 Replication Requirements August 2000 Model 5: Ad hoc -- A copy of adatedata store where no follow up checks are made for the accuracy/freshness of the data. Consistency models2,2 and 3 involve the use of prearranged replication agreementsor "Predefined Replication Agreements"between cooperating servers. The added complexity ofModel 1's use of 2- phase2-phase commitadds additional overheadrequired for Model 1 is significant enough thatshouldmodel 1 will not be considered at this time. Models 4 and 5 involve unregistered replicaswhichthat "pull" updates from another directory server without that server's knowledge. These models can be considered to violate a directory's security policies.Therefore models 1, 4, and 5 are declared to be out of scope of this working group. So through furtherFurther review ofthese consistencymodels 2 and 3 reveal two example application areascan thenthat LDAP replication must bederived with even further characterizations of the data types usages. Eventual Consistency or Transient Consistency (Model 2) - This model providesable to handle. These are policy configuration through security managementparameters; the data is more dynamicparameters (model 2) andutilizes dynamic address information. Limited Effort Eventual Consistency (Model 3) - This model matches awhite-pagesenvironment which containsenvironments that contain fairly static data and addressinformation. This model mainly replicates message attributes. Therefore it is believed an LDAPinformation (model 3). Therefore, replicationshould be flexible enough to coverrequirements are presented for models 2 and 3. 4 Requirements 4.1 General G1. LDAP Replication MUST support models 2 (Eventual Consistency) and 3 (Limited Effort Eventual Consistency) above. G2. LDAP Replication SHOULD NOT preclude support for model 1 (Transactional Consistency) in theabove range of capabilities.future. G3. Thegeneralized useact ofLDUPreplicationenvironment is to provide forSHOULD have minimal impact on both thedistribution of LDAP directory information in order to improve accessibilitysystem andconsistencynetwork performance. G4. An LDAP Replication Standard SHOULD NOT limit the transaction rate of a replication session. G5. The replication standard SHOULD NOT limit theinformation heldsize of a replica. G6. Any meta-data collected by thedirectory. 4.1 Replication Scenarios Weiser & Stokes 21 April 2000 [Page 6] INTERNET-DRAFTLDAP replication mechanism MUST NOT grow without bound. G7. All policy and state data pertaining to replication MUST be accessible via LDAP. 4.2 Model Stokes, et al Expires February 2001 [Page 8] Internet-Draft LDAPv3 Replication Requirements21 October 1999August 2000 M1. The model MUST support the followingdirectory deployment examples are intended to substantiate and validate our replication requirements. It is assumed in all cases that directory implementations from different vendors are involved. 4.1.1 Extranet Example A company hastriggers for initiation of atrading partner to whomreplica cycle: a) A configurable set of scheduled times b) Periodically, with a configurable period between replica cycles c) A configurable maximum amount of time between replica cycles d) A configurable number of accumulated changes e) Change in the value of a critical OID f) As the result of an automatic rescheduling after a replication initiation conflict g) Administrative request for replication With the exception of administrative request, the specific trigger(s) and related parameters in effect for a given server MUST be identified in a well known place, e.g. the Replication Agreement(s). M2. The replication model MUST support both master-slave and multi- master relationships. M3. All replicated information between the master database and its replica databases MUST be identical including all non-user modify operational attributes such as time stamps. Note this does not imply that the entire database is identical from replica to replica, but that the subset of data, chosen to replicate is identical from replica to replica. Some operational attributes may be dynamically evaluated; these attributes will not necessarily appear to be identical. M4. LDAP replication MUST encompass schema objects, attributes, access control, and name space information. M5. LDAP replication MUST NOT require all copies of the replicated information to be complete copies of the replicated object. The model MUST support Fractional, Partial, and Sparse Replicas. M6. Sub-tree Replication MUST be defined to allow for greater flexibility in replication topologies of the DIT as defined by partial replication. M7. The determination of which OIDs are critical MUST be configurable in the replication agreement. M8. Replication activities MUST occur within the context of a predefined replication agreement that addresses proper knowledge of access requirements and credentials between the synchronizing directories. M9. The replication agreements SHOULD accommodate multiple servers receiving the same replica under a single predefined agreement. Stokes, et al Expires February 2001 [Page 9] Internet-Draft LDAPv3 Replication Requirements August 2000 M10. LDAP replication MUST provide scalability to both enterprise and Internet environments, e.g. an LDAP server must be able to provide replication services to replicas within an enterprise as well as across the Internet. M11. While different directory implementations can support different/extended schema, schema mismatches between two replicating servers MUST be handled. One way of handling such mismatches might be to raise an error condition. M12. The LDAP replication model MUST allow for full update to facilitate replica initialization and reset loading utilizing a standardized format such as LDIF [RFC2849] format. 4.3 Protocol P1. The replication protocol MUST provide for recovery and rescheduling of a replication session due to replication initiation conflicts (e.g. consumer busy replicating with other servers) and or loss of connection (e.g. supplier cannot reach a replica). P2. The replication protocol MUST allow a restart at the last acknowledged update prior to interruption rather than re-sending updates it had already sent to a consuming replica. P3. The LDAP replication protocol MUST allow for full update to facilitate replica initialization and reset loading utilizing a standardized format such as LDIF [RFC2849] format. P4. Incremental replication MUST be allowed. P5. The replication protocol MUST allow either a master or slave replica to initiate the replication process. P6. The protocol MUST support propagation of atomicity information. P7. The protocol SHOULD NOT preclude future support of Transactional Consistency (model 1). P8. The protocol MUST support a mechanism to report schema mismatches between replicas discovered during a replication session. 4.4 Schema SC1. A standard way to determine what replicas are held on a server MUST be defined. Stokes, et al Expires February 2001 [Page 10] Internet-Draft LDAPv3 Replication Requirements August 2000 SC2. A standard schema for representing replication agreements MUST be defined. SC3. The semantics associated with modifying the attributes of replication agreements MUST be defined. SC4. A standard method for determining the location of replication agreements MUST be defined. SC5. A standard schema for publishing state information about a given replica MUST be defined. SC6. A standard method for determining the location of replica state information MUST be defined. SC7. It MUST be possible for authorized administrators, regardless of their network location, to access replication agreements in the DIT. SC8. Replication agreements of all servers containing replicated information MUST be accessible via LDAP. SC9. All objects MUST be uniquely identifiable throughout the object lifetime. 4.5 Single Master SM1. A Single Master system SHOULD provide a fast method of promoting a slave replica to become the master replica. SM2. The master replica in a Single Master system SHOULD send all changes to read-only replicas in the order in which they were applied on the master. 4.6 Multi-Master MM1. Replica synchronization SHOULD be handled in such a manner as to not saturate the network with repetitive entry replication from supplier replicas. MM2. The initiator MUST be allowed to determine whether it will become a consumer or supplier during the synchronization startup process. MM3. During a replication session, it MUST be possible for the two servers to switch between the consumer and supplier roles. Stokes, et al Expires February 2001 [Page 11] Internet-Draft LDAPv3 Replication Requirements August 2000 MM4. When multiple master replicas want to begin a replication session with the same replica at the same time, the model MUST have a deterministic mechanism for resolving the resulting replication initiation conflict with no operator intervention. MM5. Multi-master replication MUST NOT lose information during replication. If conflict resolution would result in the loss of directory information, the replication process MUST store that information, notify the administrator of the nature of the conflict and the information that was lost, and provide a mechanism for possible override by the administrator. MM6. Multi-master replication MUST support convergence of the values of attributes and objects. Convergence may result in an event as described in MM5. 4.7 Administration and Management AM1. Replication agreements MUST allow the initiation of a replica cycle to be administratively postponed to a more convenient period. AM2. Each copy of a replica MUST maintain audit history information of which servers it has replicated with and which servers have replicated with it. AM3. Access to replication agreements, topologies, and policies attributes MUST be provided through LDAP access. AM4. The capability to check the differences between two replicas for the same information SHOULD be provided. AM5. A mechanism to fix differences between replicas without triggering new replica cycles SHOULD be provided. AM6. The deletion of sensitive data MUST be handled in an orderly manner so that at no time will that data be available without proper access control. That is, access control information (ACI) associated with sensitive data must be deleted after or simultaneously with the delete of the sensitive data. Likewise, when adding sensitive data, ACI MUST be added first or simultaneously with the addition of that data. 4.8 Security S1. During initiation of a replication session, authentication and verification of authorization of both the replica and the source directory MUST be allowed before any data is transferred. Stokes, et al Expires February 2001 [Page 12] Internet-Draft LDAPv3 Replication Requirements August 2000 S2. The transport for LDAP synchronization MUST permit assurance of the integrity and privacy of all data transferred. S3. To promote interoperability, there MUST be a mandatory-to- implement data privacy mechanism. S4. The transport for administrative access MUST permit assurance of the integrity and privacy of all data transferred. 5 Security Considerations This document includes security requirements (listed in section 4.8 above) for the replication model and protocol. 6 Acknowledgements This document is based on input from IETF members interested in LDUP Replication. 7 References [ACID] T. Haerder, A. Reuter, "Principles of Transaction-Oriented Database Recovery", Computing Surveys, Vol. 15, No. 4 (December 1983), pp. 287-317. [NDS] Novell, "NDS Technical Overview", 104-000223-001, http://developer.novell.com/ndk/doc/docui/index.htm#../ndslib/dsov_enu/ data/h6tvg4z7.htm, September, 2000. [RFC2119] S. Bradner, "Key Words for Use in RFCs to Indicate Requirement Levels", RFC 2119, March 1997. [RFC2251] M. Wahl, T. Howes, S. Kille "Lightweight Directory Access Protocol", RFC 2251, December 1997. [RFC2252] M. Wahl, A. Coulbeck, T. Howes, S. Kille, "Lightweight Directory Access Protocol (v3): Attribute Syntax Definitions", RFC 2252, December 1997. [RFC2849] Gordon Good, "The LDAP Data Interchange Format (LDIF)", RFC 2849, June 2000. [X.501] ITU-T Recommendation X.501 (1993), | ISO/IEC 9594-2: 1993, Information Technology - Open Systems Interconnection - The Directory: Models. Stokes, et al Expires February 2001 [Page 13] Internet-Draft LDAPv3 Replication Requirements August 2000 [XEROX] Hauser, C. "Managing update conflicts in Bayou, a weakly connected replicated storage system". Palo Alto, CA: Xerox PARC, Computer Science Laboratory; 1995 August; CSL-95-4. [CSL-95-04] A. APPENDIX A - Usage Scenarios The following directory deployment examples are intended to substantiate and validate our replication requirements. It is assumed in all cases that directory implementations from different vendors are involved. This material is intended as background; no requirements are presented in this Appendix. A.1. Extranet Example A company has a trading partner to whom it wishes to provide directory information. This information may be as simple as a corporate telephone directory, or as complex as an extranet workflow application. For performance reasons the company may wish to have a replica of its directory within the Partner Company, rather than simply exposed beyond its firewall. The requirements that follow from this scenario are: . One-way replication, single mastered. . Authentication of clients. . Common access control and access control identification. . Secure transmission of updates. . Selective attribute replication (Fractional Replication), so that only partial entries can be replicated. A.2. Consolidation Example Company A acquires company B. In the transition period, whilst the organizations are merged, both directory services must coexist. Company A may wish to attach company B's directory to its own. The requirements that follow from this scenario are: . Multi-Master replication. . Common access control model. Access control model identification. . Secure transmission of updates. . Replication between DITs with potentially differing schema. A.3. Replication Heterogeneous Deployment Example Stokes, et al Expires February 2001 [Page 14] Internet-Draft LDAPv3 Replication Requirements August 2000 An organization may deliberately deploy multiple directory services within their enterprise to employ the differing benefits of each service. In this case multi-master replication will be required to ensure that the multiple updateable replicas of the DIT are synchronized. Some vendors may provide directory clients, which are tied to their own directory service. The requirements that follow from this scenario are: . Multi-Master replication . Common access control model and Access control model identification. . Secure transmission of updates. . Replication among DITs with potentially differing schemas. A.4. Shared Name Space Example Two organizations may choose to cooperate on some venture and need a shared name space to manage their operation. Both organizations will require administrative rights over the shared name space. The requirements that follow from this scenario are: . Multi-Master replication. . Common access control model and Access control model identification. . Secure transmission of updates. A.5. Supplier Initiated Replication This is a single master environment that maintains a number of replicas of the DIT by pushing changes based on a defined schedule. The requirements that follow from this scenario are: . Single-master environment. . Supplier-initiated replication. . Secure transmission of updates. A.6. Consumer Initiated Replication Again a single mastered replication topology, but the replica initiates the replication exchange rather than the master. An example of this is a replica that resides on a laptop computer that may run disconnected for a period of time. The requirements that follow from this scenario are: . Single-master environment. Stokes, et al Expires February 2001 [Page 15] Internet-Draft LDAPv3 Replication Requirements August 2000 . Consumer initiated replication. . Open scheduling (anytime). A.7. Prioritized attribute replication The password attribute can provide an example of the requirement for prioritized attribute replication. A user is working in Utah and the administrator resides in California. The user has forgotten his password. So the user calls or emails the administrator to request a new password. The administrator provides the updated password (a change). Under normal conditions, the directory replicates to a number of different locations overnight. But corporate security policy states that passwords are critical and the new value must be available immediately (e.g. shortly) after any change. Replication needs to occur immediately for critical attributes/objects. The requirements that follow from this scenario are: . Incremental replication of changes. . Immediate replication on change of certain attributes. . Replicate based on time/attribute semantics. A.8. Bandwidth issues The replication of Server (A) R/W replica (a) in Kathmandu is handled via a dial up phone link to Paris where server (B) R/W replica of (a) resides. Server (C) R/W replica of (a) is connected by a T1 connection to server (B). Each connection has a different performance characteristic. The requirements that follow from this scenario are: . Minimize repetitive updates when replicating from multiple replication paths. . Incremental replication of changes. . Provide replication cycles to delay and/or retry when connections cannot be reached. . Allowances for consumer initiated or supplier initiated replication. A.9. Interoperable Administration and Management The administrator with administrative authority of the corporate directory which is replicated by numerous geographically dispersed LDAP servers from different vendors notices that the replication process is Stokes, et al Expires February 2001 [Page 16] Internet-Draft LDAPv3 Replication Requirements August 2000 not completing correctly as the change log is continuing to grow and/or error message informs him. The administrator uses his $19.95 RepCo LDAP directory replication diagnostics tools to look at Root DSE replica knowledge on server 17 and determines that server 42 made by LDAP'RUS Inc. is not replicating properly due to an Object conflict. Using his Repco Remote repair tools he connects to server 42 and resolves the conflict on the remote server. The requirements that follow from this scenario are: . Provides replication audit history. . Provisions for managing conflict resolution. . Provide LDAP access to predetermined agreements, topology and policy attributes. . Provide operations for comparing replica's content for validity. . Provide LDAP access to status and audit information. A.10. Enterprise Directory Replication Mesh A Corporation builds a mesh of directory servers within the enterprise utilizing LDAP servers from various vendors. Five servers are holding the same area of replication. The predetermined replication agreement(s) for the enterprise mesh are under a single management, and the security domain allows a single predetermined replication agreement to manage the 5 servers replication. The requirements that follow from this scenario are: . Predefined replication agreements that manage more than a single area of replication that is held on numerous servers. . Common support of replication management knowledge across vendor implementation. . Rescheduling and continuation of a replication cycle when one server in a replica ring is busy and/or unavailable. A.11. Failure of the Master in a Master-Slave Replicated Directory A company has a corporate directory that is used by the corporate email system. The directory is held on a mesh of servers from several vendors. A corporate relocation results in the closing of the location where the master copy of the directory is located. Employee information (such as mailbox locations and employee certificate information) must be kept up to date or mail cannot be delivered. The requirements that follow from this scenario are: . An existing slave replica must be "promote-able" to become the new master. Stokes, et al Expires February 2001 [Page 17] Internet-Draft LDAPv3 Replication Requirements August 2000 . The "promotion" must be done without significant downtime, since updates to the directory will continue. A.12. Failure of a Directory Holding Critical Service Information An ISP uses a policy management system that uses a directory as the policy data repository. The directory is replicated in several different sites on different vendors' products to avoid single points of failure. It is imperative that the directory be available and be updateable even if one site is disconnected from the network. Changes to the data must be traceable, and it must be possible to determine how changes made from different sites interacted. The requirements that follow from this scenario are: . Multi-master replication . Ability to reschedule replication sessions . Support for manual review and override of replication conflict resolution B. APPENDIX B - Rationale This Appendix gives some of the background behind the requirements. It is included to help the protocol designers understand the thinking behind some of the requirements and to present some of the issues that should be considered during design. With the exception of section B.8, which contains a suggested requirement for the update to RFC 2251, this Appendix does not state any formal requirements. B.1. Meta-Data Implications Requirement G4 states that meta-data must not grow without bound. This implies that meta-data must, at some point, be purged from the system. This, in turn, raises concerns about stability. Purging meta-data before all replicas have been updated may lead to incomplete replication of change information and inconsistencies among replicas. Therefore, care must be taken setting up the rules for purging meta- data from the system while still ensuring that meta-data will not grow forever. B.2. Order of Transfer for Replicating Data Situations may arise where itwisheswould be beneficial to replicate data out-of-order (e.g. send data to consumer replicas in a different order than it was processed at the supplier replica). One such case might occur if a large bulk load was done on the master server in a single- Stokes, et al Expires February 2001 [Page 18] Internet-Draft LDAPv3 Replication Requirements August 2000 master environment and then a single change to a critical OID (a password change, for example) was then made. Rather than wait for all the bulk data to be sent to the replicas, the password change might be moved to the head of the queue and be sent before all the bulk data was transferred. Other cases where this might be considered are schema changes or changes to critical policy data stored in the directory. While there are practical benefits to allowing out-of-order transfer, there are some negative consequences as well. Once out-of-order transfers are permitted, all receiving replicas must be prepared to deal with data and schema conflicts that might arise. As an example, assume that schema changes are critical and must be moved to the front of the replication queue. Now assume that a schema change deletes an attribute for some object class. It is possible that some of the operations ahead of the schema change in the queue are operations to delete values of the soon-to-be-deleted attribute so that the schema change can be done with no problems. If the schema change moves toprovidethe head of the queue, the consumer servers might have to delete an attribute that still has values, and then receive requests to delete the values of an attribute which is no longer defined. In the multi-master case, similar situations can arise when simultaneous changes are made to different replicas. Thus, multi- master systems must have conflict resolution algorithms in place to handle such situations. But in the single-master case conflict resolution is not needed unless the master is allowed to send data out- of-order. This is the reasoning behind requirement SM2, which recommends that data always be sent in order in single-master replication. Note that even with this restriction, the concept of a critical OID is still useful in single-master replication. An example of its utility can be found in section A.7. B.3. Schema Mismatches and Replication Multi-vendor environments are the primary area of interest for LDAP replication standards. Some attention must thus be paid to the issue of schema mismatches, since they can easily arise when vendors deliver slightly different base schema with their directoryinformation.products. Even when both products meet the requirements of the standards [RFC2252], the vendors may have included additional attributes or object classes with their products. When two different vendor's products attempt to replicate, these additions can cause schema mismatches. Another potential cause of schema mismatches is discussed in section A.3. There are only a few possible responses when a mismatch is discovered. Stokes, et al Expires February 2001 [Page 19] Internet-Draft LDAPv3 Replication Requirements August 2000 . Raise an error condition and ignore the data. Thisinformationshould always be allowed and is the basis for requirement P8 and the comment on M11. . Map/convert the data to the form required by the consuming replica. A system may choose this course; requirement M11 is intended to allow this option. The extent of the conversion is up to the implementation; in the extreme it could support use of the replication protocol in meta-directories. . Quietly ignore (do not store on the consumer replica and do not raise an error condition) any data that does not conform to the schema at the consumer. Requirement M11 is intended to exclude the last option. Normal IETF practice in protocol implementation suggests that one beas simple asstrict in what one sends and be flexible in what one receives. The parallel in this case is that acorporate telephone directory, or as complex assupplier should be prepared to receive anextranet work flow application. For performance reasons the companyerror notification for any schema mismatch, but a consumer maywishchoose tohavedo areplica of its directory within the Partner Company, rather than simply exposed beyond its firewall.conversion instead. Therequirements, which follow fromother option that can be considered in thisscenario, are: - One-way replication, single mastered. - Authentication of clients. - Common access control and access control identification. - Secure transmissionsituation is the use ofupdates. - Selective attributefractional replication. If replication(Fractional Replication),is set up sothatonlypartial entriesthe common attributes are replicated, mismatches can be avoided. One additional consideration here is replication of the schema itself. M4 requires that it be possible to replicate schema. If a consumer replica is doing conversion, extreme care should be taken if schema elements are replicated since some attributes are intended to have different definitions on different replicas. For fractional replication, the protocol designers and implementors should give careful consideration to the way they handle schema replication. Some options for schema replication include: . All schema elements are replicated.4.1.2 Consolidation Example Company. Schema elements are replicated only if they are used by attributes that are being replicated. . Schema are manually configured on the servers involved in fractional replication; schema elements are not replicated via the protocol. B.4. Detecting and Repairing Inconsistencies Among Replicas Despite the best efforts of designers, implementors, and operators, inconsistencies will occasionally crop up among replicas in production directories. Tools will be needed to detect and to correct these inconsistencies. Stokes, et al Expires February 2001 [Page 20] Internet-Draft LDAPv3 Replication Requirements August 2000 Aacquires company B.special client may accomplish detection through periodic comparisons of replicas. This client would typically read two replicas of the same naming context and compare the answers, possibly by BINDing to each of the two replicas to be compared and reading them both. In cases where thetransition period, whilst the organizations are merged, both directory services must coexist. Company A may wish to attach company B'sdirectory automatically reroutes some requests (e.g. chaining), mechanisms toits own. The requirements, which follow from this scenario, are: - Multi-Master replication. - Commonforce accesscontrol model. Access control model identification. - Secure transmission of updates. - Replication between DITs with potentially differing schema. 4.1.3 Replication Heterogeneous Deployment Example An organization may deliberately deploy multiple directory services within their enterprisetoemploya particular replica should be supplied. Alternatively, thediffering benefits of each service. Inserver could support a special request to handle thiscase multi-mastersituation. A client would invoke an operation at some server. It would cause that server to extract the contents from some other server it has a replicationwill be requiredagreement with and report the differences back toensure thatthemultiple updateable replicas ofclient as theDIT are synchronized. Some vendors may provide directory clients, which are tiedresult If an inconsistency is found, it needs totheir own directory service. The requirements, which follow from this scenario, are: - Multi-Master replication Weiser & Stokes 21 April 2000 [Page 7] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 - Commonbe repaired. To determine the appropriate repair, the administrator will need accesscontrol model and Access control model identification. - Secure transmission of updates. - Replication between DITs with potentially differing schemas. 4.1.4 Shared Name Space Example Two organizations may choosetocooperate on some venturethe replication history to figure out how the inconsistency occurred andneedwhat the correct repair should be. When ashared name spacerepair is made, it should be restricted tomanage their operation. Both organizations willthe replica that needs to be fixed; the repair should not cause new replication events to be started. This may requireadministrative rights overspecial tools to change theshared name space. The requirements, which follow from this scenario, are: - Multi-Masterlocal data store without triggering replication.- Common access control modelRequirements AM2, AM4, andAccess control model identification. - Secure transmission of updates. 4.1.5 Supplier InitiatedAM5 address these needs. B.5. Some Test Cases for Conflict Resolution in Multi-Master ReplicationA single master environment, which maintains a number of replicasUse of multi-master replication inevitably leads theDIT by pushing changes, basedpossibility that incompatible changes will be made simultaneously on different servers. In such cases, conflict resolution algorithms must be applied. As adefined schedule. The requirements, which follow fromguiding principle, conflict resolution should avoid surprising the user. One way to do thisscenario, are: - Single-master environment. - Supplier-initiated replication. - Secure transmission of updates. 4.1.6 Consumer Initiated Replication Again a single mastered replication topology, butis to adopt thereplica initiatesprinciple that, to thereplication exchange rather thanextent possible, conflict resolution should mimic themaster. An example of this is a replicasituation thatresides onwould happen if there were alaptop computer that may run disconnected forsingle server where all the requests were handled. While this is aperioduseful guideline, there are some situations where it is impossible to implement. Some oftime. The requirements, which follow fromthese cases are examined in thisscenario, are: - Single-master environment. - Consumer initiated replication. - Open scheduling (anytime). 4.1.7 Prioritized attributesection. In particular, there are some cases where data will be "lost" in multi-master replicationThe password attribute can provide an example ofthat would not be lost in a single-server configuration. In therequirement for prioritized attribute replication.examples below, assume that there are three replicas, A, B, and C. All three replicas are updateable. Changes are made to replicas Auser is working in Utahand B before replication allows either replica to see theadministrator resides in California. The user has forgotten his password. So the user calls or emailschange made on theadministrator to request a new password. The administrator providesother. In discussion of theupdated password (a change). Policy statesmulti-master cases, we assume thatthis attribute is critical and must be Weiser & Stokes 21 April 2000Stokes, et al Expires February 2001 [Page8] INTERNET-DRAFT LDAP21] Internet-Draft LDAPv3 Replication Requirements21 October 1999 available to the user for login immediately (e.g. shortly) afterAugust 2000 theadministrator changed it. Replication needschange tooccur immediatelyA takes precedence using whatever rules are in force forcritical attributes/objects. The requirements, which follow from this scenario, are: - Incremental replicationconflict resolution. B.5.1. Create-Create A user creates a new instance ofchanges. - Automatic replicationan object with distinguished name DN to A. At the same time, a different user adds an object with the same distinguished name onchangeB. In the single-server case, one ofcertain attributes. - Replicate basedthe create operations would have occurred before the other, and the second request would have failed. In the multi-master case, each create was successful ontime/attribute semantics. 4.1.8 Bandwidth issuesits originating server. Thereplication of Server (A) R/W replica (a) in Katmanduproblem ishandled vianot detected until replication takes place. When adial up phone linkreplication request toParis where server (B) R/W replicacreate a DN that already exists arrives at one of(a) resides. Server (C) R/W replica of(a)the servers, conflict resolution isconnected by a T1 connection to server (B). Each connectioninvoked. (Note that the two requests can be distinguished even though they have the same DN because every object hasa different performance characteristic. The requirements, which followsome sort of unique identifier per requirement SC9.) As noted above, in these discussions we assume that the change fromthis scenario, are: - Minimize repetitive updates when replicatingreplica A has priority based on the conflict resolution algorithm. Whichever change arrives first, requirement MM6 says that the values frommultiple replication paths. - Incremental replication of changes. - Provide replication cycles to delay and/or retry when connections can notreplica A must be those in place on all replicas at the end of the replication cycle. Requirement MM5 states that the system cannot quietly ignore the values from replica B. The values from replica B might bereached. - Allowances for consumer initiatedlogged with some notice to the administrators, orsupplier initiated replication. 4.1.9 Interoperable Administration and Management The administratorthey might be added to the DIT withadministrative authority ofa machine generated DN (again with notice to thecorporate directory which is replicated by numerous geographically dispersed LDAPadministrators). If they are stored with a machine generated DN, the same DN must be used on all serversfrom different vendors noticesin the replica ring (otherwise requirement M3 would be violated). Note that in thereplication process is not completing correctly ascase where thechange logobject in question iscontinuinga container object, storage with a machine generated DN provides a place where descendent objects may be stored if any descendents were generated before the replication cycle was completed. In any case, some mechanism must be provided togrow and/or error message informs him. Theallow the administratoruses his $19.95 RepCo LDAP directory replication diagnostics toolstolook at Root DSE replica knowledge on server 17reverse the conflict resolution algorithm anddetermines that server 42 made by LDAPÆRUS Inc.force the values originally created on B into place on all replicas if desired. B.5.2. Rename-Rename On replica A, an object with distinguished name DN1 isnot replicating properly duerenamed to DN. At the same time on replica B, anObject conflict. Using his Repco Remote repair tools he connectsobject with distinguished name DN2 is renamed toserver 42DN. Stokes, et al Expires February 2001 [Page 22] Internet-Draft LDAPv3 Replication Requirements August 2000 In the single-server case, one rename operation would occur before the other andresolvestheconflict onsecond would fail since theremotetarget name already exists. In the multi-master case, each rename was successful on its originating server.The requirements, which follow from this scenario, are: - Provides replication audit history. - Provisions for managingAssuming that the change on A has priority in the conflictresolution. - Provide LDAP access to predetermined agreements, topologyresolution sense, DN will be left with the values from DN1 in all replicas andpolicy attributes. - Provide operations for comparing replicaÆs content for validity. - Provide LDAP accessDN1 will no longer exist in any replica. The question is what happens tostatusDN2 andaudit information. Weiser & Stokes 21 April 2000 [Page 9] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 4.1.10 Enterprise Directory Replication Mesh A Corporation builds a meshits original values. Requirement MM5 states that these values must be stored somewhere. They might be logged, they might be left in the DIT as the values ofdirectory servers withinDN2, or they might be left in theenterprise utilizing LDAP servers from various vendors. Five servers are holdingDIT as thesame areavalues ofreplication. The predetermined replication agreement(s) forsome machine generated DN. Leaving them as theenterprise mesh are under a single management, andvalues of DN2 is attractive since it is thesecurity domain allowssame as the single-server case, but if asingle predetermined replication agreementnew DN2 has already been created before the replica cycle finishes, there are some very complex cases tomanageresolve. Any of the5 servers replication. The requirements, which follow fromsolutions described in thisscenario, are: - Predefined replication agreements that manage more than a single area of replication that is heldparagraph would be consistent with requirement MM5. B.5.3. Locking Based onnumerous servers. - Common supportAtomicity ofreplication management knowledge across vendor implementation. - ReschedulingModifyRequest There is an object with distinguished name DN which contains attributes X, Y, andcontinuationZ. The value ofa replication cycle when one server in aX is 1. On replicaringA, a ModifyRequest isbusy and/or unavailable. 5. Replication Model 5.1 LDAP Replication MUST be allowedprocessed which includes modifications tospan different vendors directory services in orderchange that value of X from 1 toprovide interoperability. 5.2 All replicas MUST eventually be updated with0 and to set thechanged information, if specified byvalue of Y to "USER1". At thereplication policy. 5.3 Replication schedules MUST be configurablesame time, replica B process a ModifyRequest which includes modifications toallow for periodic replication, withchange thereplication period determined by administratorvalue of X from 1 to 0 and to set thereplicated system. 5.4 Replication Model MUST enable replication cyclevalue of Y tobe initiated on change or based on"USER2" and thenumbervalue ofpending changes. 5.5Z to 42. Thereplication model MUST allow for administrative initiationapplication in this case is using X as a lock and is depending on the atomic nature ofreplication cycleModifyRequests to provide mutual exclusion forany replica that maylock access. In the single-server case, the two operations would havejust come back online or was unavailable during previous replication cycles. 5.6occurred sequentially. Since a ModifyRequest is atomic, the entire first operation would succeed. Thereplication model MUST support both master-slave and authoritative multi-updateable replica relationships. 5.7 All replicated information betweensecond ModifyRequest would fail, since themaster database and its replica databases MUSTvalue of X would beidentical including all non-user modify operational attributes such as time stamps. Note this does not imply that0 when it was attempted, and theentire database is identicalmodification changing X fromreplica1 toreplica, but that0 would thus fail. The atomicity rule would cause all other modifications in thesubset of data, chosen to replicate is identical from replica to replica. Some operational attributes may be dynamically evaluated; these attributes will not necessarily appearModifyRequest tobe identical. Weiser & Stokes 21 April 2000 [Page 10] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 5.8fail as well. Indistributed multi-vendor environment, LDAP replication MUST NOT require all copiesthe multi-master case, it is inevitable that at least some of thereplicated informationchanges will becomplete copiesreversed despite the use of thereplicated object. 5.9 LDAP replication MUST encompass common schema objects and attributes, access control, and name space information. 5.10 Sub-tree Replication MUSTlock. Assuming the changes from A have priority per the conflict resolution algorithm, the value of X should bedefined to allow for greater flexibility in replication topologies0 and the value of Y should be "USER1" The interesting question is theDIT as defined byvalue of Z at theareaend of the replicationcalled partial replication. 5.11 Replication of critical values MUSTcycle. If it is 42, the atomicity constraint on the change from B has been violated. But for it to revert to its previous value, grouping information must besynchronizedretained andhave priority over non-critical values. An example of a critical value mightit is not clear when that information can be safely discarded. Thus, requirement G6 may be violated. Stokes, et al Expires February 2001 [Page 23] Internet-Draft LDAPv3 Replication Requirements August 2000 B.5.4. General Principles With multi-master replication there are apasswordnumber of cases where a user orcertificate value. 5.12 Replication activities MUST occur within the contextapplication will complete a sequence of operations with apredefined replication agreement that addresses proper knowledgeserver but those actions are later "undone" because someone else completed a conflicting set ofaccess requirements and credentials between the synchronizing directories. Currently X.525 DISP [X.525] discussesoperations at another server. To some extent, thisascan happen in any multi-user system. If ashadowing agreement including such information as unituser changes the value ofreplication, update mode,an attribute andaccess point defining many oflater reads it back, intervening operations by another user may have changed thepolicies betweenvalue. In the multi- masterand a replica. 5.13 The acceptance and usage ofcase, theInternet requires that LDAP replication be available across disparate vendor directory services. 5.14 LDAP replication MUST provide scalability to both enterprise and Internet environments, e.g. an LDAP server may provide replication servicesproblem is worsened, since techniques used toreplicas within an enterprise as wellresolve the problem in the single-server case won't work asacrossshown in theInternet. 5.15examples above. Thereplication model MUST define deterministic policy such that replication cycle startup time conflicts between two or more competing master replicas may be resolved programmatically. An example might be automatic submission and rescheduling bymajor question here is one ofthe masters.intended use. Insuch a case, these replication "conflicts" MUST be resolved by the replication policy. 5.16 Any replication capableLDAPserver MUST allowstandards work, it has long been said that replication provides "loose consistency" among replicas. At several IETF meetings and on the mailing list, usage examples from finance where locking is required have been declared poor uses for LDAP. Requirement G1 is consistent with this history. But if loose consistency is the2 replicating servers agreegoal, the locking example above is an inappropriate use of LDAP, at least in a replicated environment. B.5.5. Avoiding the Problem The examples above discuss some of the most difficult problems that can arise in multi-master replication. While they canreplicate. This maybeaccomplished through administrative agreements assuming compatible access control modeldealt with, dealing with them is difficult andcommon schemacan lead to situations that areprovided. 5.17 The replication model MUST be ablequite confusing tohandle convergence and resurrection of attributes and objects. This is a consequence of deletethe application andmove with respectto users. The common characteristics of thereplication process. Weiser & Stokes 21 April 2000 [Page 11] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 5.18 It is not realisticexamples are: . Several directory users/applications are changing the same data . They are changing the data at the same time . They are using different directory servers toassume that all vendors have cooperating schemas, butmake these changes . They are changing data thatreplication may be allowed between diverse schema. The Model MAY allow for replication between divergent schema of objects. 6. Replication Protocol 6.1 The actare parts ofreplication SHOULD have minimal impact ona distinguished name or they are using ModifyRequest to boththe systemread andnetwork performance. 6.2 The replica synchronization SHOULD be handledwrite a given attribute value insuchamanner as to not saturate network with repetitive entry replication from multiple synchronization providers points. 6.3 Replication MUST only be allowed aftersingle atomic request If any one of these conditions is reversed, theauthentication and verificationtypes of problems described above will not occur. There are many useful applications of multi-master directories where at least one ofauthorizationthe above conditions does not occur. For cases where all four do occur, application designers should be aware ofboththereplicapossible consequences. B.6. Data Privacy During Replication Stokes, et al Expires February 2001 [Page 24] Internet-Draft LDAPv3 Replication Requirements August 2000 Directories will frequently hold proprietary information. Policy information, name andthe source directory. 6.4 The transport for LDAP synchronization MUST allow for the integrityaddress information, andconfidentiality of each replicated server. 6.5 Replicated data MUSTcustomer lists can be quite proprietary and are likely to betransferablestored in directories. Such data must be protected during replication. In some cases, the network environment (e.g. asecure manner. 6.6 Replication protocol MUSTprivate network) may provide sufficient privacy forrecovery and rescheduling of a replication cycle due to a replication initiation conflicts (e.g. consumer busy replicating withthe application. In otherservers) and or loss of connection(e.g. supplier cannot reach a replica). The replication protocol MUST include restarting atcases, thelast acknowledged update prior to interruption rather than re-sending updates it had already sent to a consuming replica. 6.7 LDAP replication MUST allow for full update to facilitate replica initializationdata in the directory may be public andreset loading utilizingnot require protection. For these reasons data privacy was not made astandardized format such as LDIF [LDIF] format. 6.8 Therequirement for all replicationstandard SHOULD NOT limit the size ofsessions. But there are areplica. The areasubstantial number ofreplicationapplications that will need data privacy, so there isdefined to be a whole or portion of a DIT, also allowing a portion ofanaming context to be replicated. Incremental replication SHOULD be allowed. 6.9 The replication agreements MUST accommodate multiple servers receivingrequirement (S2) that thesame replica under a single predefined agreement. 6.10 The replicationprotocolMUSTalloweither a master or replica to initiate the replication process. 6.11 Additionallyfor data privacy in those cases where it is needed. This leaves theinitiator MUST be allowedquestion of what privacy mechanism(s) todetermine whether it will becomeuse. While this is ultimately aconsumer or supplier duringdesign/implementation decision, replication across different vendors' directory products is an important goal of thesynchronization startup process. This would allow a replica to Weiser & Stokes 21 April 2000 [Page 12] INTERNET-DRAFTLDAPReplication Requirements 21 October 1999 be periodically connected and synchronized from remote sitesreplication work at thelocal administrator's discretion. 6.12 Multiple LDAP changes to a single server:IETF. Iftransactional consistency is propagated during replication, then multiple LDAP changes submitteddifferent vendors choose toa single server SHOULD BE treated as a single 'atomic unit of work'. 6.13 An LDAP Replication Standard SHOULD NOT limitsupport different data privacy mechanisms, thetransaction rateadvantages of a standard replicationsession. 6.14 Entry change information MUSTprotocol would bepurged or discardedlost. Thus there is a requirement (S3) for a mandatory-to-implement data privacy mechanism. B.7. Failover in Single-Master Systems In atimely manner when change information becomes outdated due to propagated tosingle-master system, allreplica members. 7. Schema 7.1 Replica knowledge MUST be provided as DSE attributes. 7.2 The Replication Protocol documents MUST define standard schema for representing replication agreements, and MUST define the semantics associated with modifyingmodifications must originate at theattributes of replication agreements.master. Thedocuments MUST also definemaster is therefore astandard method for determining the locationsingle point ofthese agreements accessible utilizing LDAP. 7.3 The Replication Protocol documents MUST define standard schemafailure forpublishing state information about a given replica, and MUST definemodifications. This can cause concern when high availability is astandard methodrequirement fordeterminingthelocation of this information. 7.4 A location independent management point MUST be defineddirectory system. One way to reduce the problem is to provideauthorized administrators with well known accessa failover process that converts a slave replica to master when thereplication policies, regardless of network location. 7.5 Replication agreementsoriginal master fails. The time required to execute the failover process then becomes a major factor in availability ofall servers containing replicated information MUST be accessible via LDAP. 7.6 All objects MUST be uniquely identifiable throughouttheobject lifetime . 8. Administrationsystem as a whole. Factors that designers andManagement Considerations 8.1 Replication policies MUST allow replicationimplementors should consider when working on failover include: . If the master replica contains control information or meta-data that is not part ofchangedthe slave replica(s), this information will have to beadministratively postponedinserted into the slave which is being "promoted" toa more Weiser & Stokes 21 April 2000 [Page 13] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 convenient period. 8.2 Allowance for non-scheduled replicationmaster as part ofa replica MUSTthe failover process. Since the old master is presumably unavailable at this point, it may beprovided upon request such thatdifficult to obtain this data. For example, if thereplica server has been down or unconnected for a period of time. 8.3 Each copymaster holds the status information ofaall replicas, but each slave replicaMUST maintain audit history informationonly holds its own status information, failover would require that the new master get the status ofwhich servers it has replicated with and which serversall existing replicas, presumably from those replicas. Similar issues could arise for replication agreements if the master is the only system that holds a complete set. Stokes, et al Expires February 2001 [Page 25] Internet-Draft LDAPv3 Replication Requirements August 2000 . If data privacy mechanisms (e.g. encryption) are in use during replication, the new master would need to havereplicated with it. 8.4 A replica MUST store conflicted versionsthe necessary key information to talk to all of thereplicated objectslave replicas. . It is not only the new master that needs toallow optional human review and intervention. 8.5 Accessbe reconfigured. The slaves also need toreplication predetermined agreements, topologies,have their configurations updated so they know where updates should come from andpolicies attributes MUSTwhere they should refer modifications. . The failover mechanism should beprovided through LDAP access. 8.6able to handle a situation where the old master is "broken" but not "dead". The slave replicas should ignore updates from the old master after failover is initiated. . Thecapabilityold master will eventually be repaired and returned tocheckthedifferences between two replicas forreplica ring. It might join thesame information SHOULD be provided for. This should entailring as aclient invoking an operation at some server, which causes that server to extractslave and pick up thecontents from some other serverchanges it hasa replication agreement with and report"missed" from thedifferences backnew master, or there might be some mechanism to bring it into sync with theclientnew master and then let it take over as master. Some resynchronization mechanism will be needed. . Availability would be maximized if theresult. 8.7 Authenticated access SHOULDwhole failover process could beprovided soautomated (e.g. failover is initiated by an external system when it determines thatAdministrative LDAP clients may query a server forthecurrent state and replication history for each replicaoriginal master is not functioning properly). B.8. Including Operational Attributes in Atomic Operations LDAPv3 [RFC2251] declares thatthe server maintains replication agreements with. 8.8 The ability to view replication conflicts, and override the resolution derived by the replication policy MUST be provided. 8.9 The deletionsome operations are atomic (e.g. all ofsensitive data MUST be handledthe modifications inan orderly manner so that at no time willa single ModifyRequest). It also defines several operational attributes thatdata be available without proper access control. That is, access controlstore information(ACI) associated with sensitive data must be deleted after or simultaneously with the delete of the sensitive data. Likewise,about whenadding sensitive data, ACI MUST be added first or simultaneously withchanges are made to theaddition of that data. 9. Acknowledgement This document is based on input from IETF members interested in LDUP Replication. Weiser & Stokes 21 April 2000 [Page 14] INTERNET-DRAFT LDAP Replication Requirements 21 October 1999 10. References [RFC2251] M. Wahl, T. Howes, S. Kille "Lightweight Directory Access Protocal", RFC 2251. [RFC2119] S.Bradner, " Key wordsdirectory (createTimestamp, etc.) and which ID was responsible forusea given change (modifiersName, etc.). Currently, there is no statement inRFCsRFC2251 requiring that changes toindicate Requirement Levels", RFC 2119. [LDIF] Gordon Good, "The LDAP Data Interchange Format (LDIF)", Internet draft, draft-ietf-asid-ldif-00.txt, November 1996. [Changelog] Gordon Good, "Definitions of an Object Classthese operational attributes be atomic with the changes toHold LDAP Change records", Internet Draft, draft-ietf-asid-changelog- 00.txt, November 1996. [X.501] ITU-T Recommendation X.501 (1993), | ISO/IEC 9594-2: 1993, Information Technology - Open Systems Interconnection - The Directory: Models [XEROX] Hauser, C. "Managing update conflicts in Bayou,the data. It is RECOMMENDED that this requirement be added during the revision of RFC2251. In the interim, replication SHOULD treat these operations as though such aweakly connected replicated storage system". Palo Alto, CA: Xerox PARC, Computer Science Laboratory; 1995 August; CSL-95-4. [CSL-95-04] 11. Author's Addressrequirement were in place. Authors' Addresses Russel F. Weiser Digital Signature Trust Co.One1095 East 2100 SouthMain StreetSuite #201 Salt Lake City, Utah8411184106 Stokes, et al Expires February 2001 [Page 26] Internet-Draft LDAPv3 Replication Requirements August 2000 USA E-mail: rweiser@digsigtrust.com Telephone:+1-801-983-4415 Fax +1-801-983-4408+1 801 246 4323 Fax: +1 801 246 4361 Ellen J. StokesIBM 11400 Burnet Rd.Tivoli Systems 6300 Bridgepoint Parkway Austin, Texas7875878731 USA E-mail:stokes@austin.ibm.comestokes@tivoli.com Telephone:+1-512-838-3725+1 512 436 9098 Fax:+1-512-838-0156 Weiser & Stokes 21 April 2000+1 512 436 1199 Ryan D. Moats Coreon, Inc. 15621 Drexel Circle Omaha, NE 68135 USA E-Mail: rmoats@coreon.com Telephone: +1 402 894 9456 Richard V. Huber Room C3-3B30 AT&T Laboratories 200 Laurel Avenue South Middletown, NJ 07748 USA E-Mail: rvh@att.com Telephone: +1 732 420 2632 Fax: +1 732 368 1690 Full Copyright Statement Copyright (C) The Internet Society (2000). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. However, this document itself may not be modified in any way, such as by removing the copyright notice or references to the Internet Society or other Internet organizations, except as needed for the purpose of developing Internet standards in which case the procedures for copyrights defined Stokes, et al Expires February 2001 [Page15]27] Internet-Draft LDAPv3 Replication Requirements August 2000 in the Internet Standards process must be followed, or as required to translate it into languages other than English. The limited permissions granted above are perpetual and will not be revoked by the Internet Society or its successors or assigns. This document and the information contained herein is provided on an "AS IS" basis and THE INTERNET SOCIETY AND THE INTERNET ENGINEERING TASK FORCE DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Acknowledgement Funding for the RFC Editor function is currently provided by the Internet Society. ----