Provisioning
From Wikipedia, the free encyclopedia
For other uses, see Provisioning (disambiguation).
In voice telecommunication, provisioning means to provide telecommunications services to a user or customer, including transmission, wiring, and equipment. In NS/EP telecommunications services, "provisioning" equates to "initiation" and includes altering the state of an existing priority service or capability. Source: US Federal Standard 1037C
In a modern signal infrastructure employing information technology at all levels, there is no distinction possible between telecommunications services and "higher level" infrastructure. Accordingly provisioning configures any required systems, provides users with access to data and technology resources, and refers to all enterprise-level information resource management involved.
From a management perspective, it is typically managed by a CIO, and necessarily involves human resources and IT departments cooperating to:
give users access to data repositories or grant authorization to systems, networks applications and databases based on a unique user identity, and
appropriate for their use hardware resources, such as computers, mobile phones and pagers.
As its most central responsibility, the provisioning process monitors access rights and privileges to ensure the security of an enterprise's resources and user privacy. As a secondary responsibility, it ensures compliance and minimizes the vulnerability of systems to penetration and abuse. As a tertiary responsibliity, it tries to reduce the amount of custom configuration using boot image control and other methods that radically reduce the number of different configurations involved.
"Provisioning" often appears in the context of virtualization, orchestration, utility computing and open configuration concepts and projects. For instance, the OASIS Provisioning Services Technical Committee (PSTC) defines an XML-based framework for exchanging user, resource, and service provisioning information, e.g. SPML (Service Provisioning Markup Language) for "managing the provisioning and allocation of identity information and system resources within and between organizations".
Once provisioned, the process of SysOpping ensures that services are maintained to the expected standards. Provisioning thus refers only to the setup or startup part of the service operation, and SysOpping to the ongoing responsibility.
Contents[hide]
1 Server provisioning
2 User provisioning
3 Mobile subscriber provisioning
4 Mobile content provisioning
5 External links
//
[edit] Server provisioning
Selecting a server from a pool of available servers; loading the appropriate software (operating system, device drivers, middleware, and applications); appropriately customizing and configuring the system, software to create or change a boot image for this server, and change its parameters, e.g. IP address, IP gateway, to find associated network and storage resources - sometimes separated as resource provisioning - audit the system, i.e. ensuring OVAL compliance to limit vulnerability or ensure compliance or install patches, then finally starting the server and its newly-loaded software. This makes the system ready for operation. Typically an internet service provider (ISP) or Network Operations Center will perform these tasks to a well-defined set of parameters, e.g. a boot image that the organization has approved and which uses software it has license to. Many instances of such a boot image create a virtual dedicated host.
There are many software products available to automate the provisioning of servers, from vendors such as BladeLogic, Cassatt, IBM Tivoli IBM Tivoli, HP and OpenQRM.
In short, server provisioning is defining server configuration based on organizational requirements. A hardware/software component (e.g. single/dual processor, RAM, HDD, RAID controller, a number of LAN cards, applications, OS, etc.) will depend purely on utilizations like ISP, virtualization, NOS, or voice processing. Server redundancy depends on the availability of servers in the organization. Critical applications have less downtime when using cluster servers, RAID, or a mirroring system.
Service used by most larger scale centers in part to avoid this. Additional resource provisioning may be done per service.
[edit] User provisioning
User provisioning refers to the creation, maintenance and deactivation of user objects and user attributes, as they exist in one or more systems, directories or applications, in response to automated or interactive business processes. User provisioning software may include one or more of the following processes: change propagation, self service workflow, consolidated user administration, delegated user administration, and federated change control. User objects may represent employees, contractors, vendors, partners, customers or other recipients of a service. Services may include electronic mail, inclusion in a published user directory, access to a database, access to a network or mainframe, etc. User provisioning is a type of identity management software, particularly useful within organizations, where users may be represented by multiple objects on multiple systems.
[edit] Mobile subscriber provisioning
This refers to the setting up of new services, such as GPRS, MMS and Instant Messaging for an existing subscriber of a mobile phone network, and any gateways to standard Internet chat or mail services. The network operator typically sends these settings to the subscriber's handset using SMS or WAP as mobile operating systems accept.
Global Worldwide Office in Orlando Florida - US. Branch Office in Anaheim California - US.
Selasa, 15 Juli 2008
Customer Care and Billing Provider in China
Amdocs Completes Acquisition of Longshine, A Leading Customer Care and Billing Provider in China
August 4, 2005, St. Louis, Missouri - Amdocs (NYSE: DOX), the leading provider of software and services to enable integrated customer management and the intentional customer experience, announced today the completion of the acquisition of Longshine Information Technology Company Ltd., a privately-held, leading vendor of customer care and billing software in China. Amdocs acquired Longshine’s outstanding shares for approximately US $30 million in cash with the possibility of additional cash consideration to be paid later based on the achievement of certain performance metrics. This acquisition expands Amdocs’ global presence and marks its entry into mainland China.“We are pleased with this acquisition and what the combination means for Amdocs. The fast growing China market represents a tremendous potential opportunity,” said Eli Gelman, executive vice president of Amdocs Management Limited. “Amdocs combined offering will enable service providers in China to effectively deal with the rapidly evolving market needs, increasing competition and the associated growing complexity.” The former Longshine will operate as a business unit in China within Amdocs and will be led by the founder and CEO, Mr. Zhangjun XU. Amdocs intends to continue to sell Longshine’s software products and services in China. In parallel, Amdocs will continue offering the Amdocs 6 portfolio of products and accompanying services to the Chinese market. Longshine has been providing billing, customer care, business intelligence and settlement systems, as well as associated integration and implementation services, since 1996, with a primary focus on the telecommunications sector in China, in addition to the utility industry. Today, it counts three out of China’s four largest communications service providers and two power grid companies among its customers. Headquartered in Beijing, Longshine is present in more than 15 provinces across China and serves more than 120 million subscribers. It has been successful in attracting skilled professionals experienced in the delivery of customer care and billing systems, and has close to 800 employees.About AmdocsAmdocs combines innovative software and services with deep business knowledge to accelerate implementation of an integrated customer management strategy by the world’s leading service providers. By delivering a comprehensive portfolio of software and services that spans the customer lifecycle – target, sell, deliver, bill and support – Amdocs enables service companies to deliver an intentional customer experience, which results in stronger, more profitable customer relationships. Service providers also benefit from a rapid return on investment, lower total cost of ownership and improved operational efficiencies. A global company with the revenue of approximately $1.8 billion in fiscal 2004, Amdocs employs over 10,000 IT professionals and serves customers in 40 countries around the world. For more information, visit Amdocs at www.amdocs.com.
August 4, 2005, St. Louis, Missouri - Amdocs (NYSE: DOX), the leading provider of software and services to enable integrated customer management and the intentional customer experience, announced today the completion of the acquisition of Longshine Information Technology Company Ltd., a privately-held, leading vendor of customer care and billing software in China. Amdocs acquired Longshine’s outstanding shares for approximately US $30 million in cash with the possibility of additional cash consideration to be paid later based on the achievement of certain performance metrics. This acquisition expands Amdocs’ global presence and marks its entry into mainland China.“We are pleased with this acquisition and what the combination means for Amdocs. The fast growing China market represents a tremendous potential opportunity,” said Eli Gelman, executive vice president of Amdocs Management Limited. “Amdocs combined offering will enable service providers in China to effectively deal with the rapidly evolving market needs, increasing competition and the associated growing complexity.” The former Longshine will operate as a business unit in China within Amdocs and will be led by the founder and CEO, Mr. Zhangjun XU. Amdocs intends to continue to sell Longshine’s software products and services in China. In parallel, Amdocs will continue offering the Amdocs 6 portfolio of products and accompanying services to the Chinese market. Longshine has been providing billing, customer care, business intelligence and settlement systems, as well as associated integration and implementation services, since 1996, with a primary focus on the telecommunications sector in China, in addition to the utility industry. Today, it counts three out of China’s four largest communications service providers and two power grid companies among its customers. Headquartered in Beijing, Longshine is present in more than 15 provinces across China and serves more than 120 million subscribers. It has been successful in attracting skilled professionals experienced in the delivery of customer care and billing systems, and has close to 800 employees.About AmdocsAmdocs combines innovative software and services with deep business knowledge to accelerate implementation of an integrated customer management strategy by the world’s leading service providers. By delivering a comprehensive portfolio of software and services that spans the customer lifecycle – target, sell, deliver, bill and support – Amdocs enables service companies to deliver an intentional customer experience, which results in stronger, more profitable customer relationships. Service providers also benefit from a rapid return on investment, lower total cost of ownership and improved operational efficiencies. A global company with the revenue of approximately $1.8 billion in fiscal 2004, Amdocs employs over 10,000 IT professionals and serves customers in 40 countries around the world. For more information, visit Amdocs at www.amdocs.com.
Convergent Charging Solution at Telkomsel
Siemens and Convergys Implement Convergent Charging Solution at Telkomsel
September 27, 2005, Cincinnati, Ohio - Indonesia's premier cellular and wireless network operator Telkomsel has gone live with the first phase of Siemens' (NYSE: SI) market-leading, real-time, convergent charging solution, charge@once, that features Infinys [tm] Rating software from Convergys Corporation (NYSE: CVG). Telkomsel obtained the advanced solution to deliver the first-ever, truly convergent pre- and post-paid rating and billing of individual customer segments regardless of payment options. The solution currently supports more than 21 million subscribers.With the initial implementation by Siemens and Convergys now completed, Telkomsel is using the convergent charging solution to support its geographically complex business that spans over 13,000 islands. The solution satisfied Telkomsel's rigorous IT, engineering, and network requirements. It is now supporting an operation that has more than 54 percent of the mobile market in Indonesia and provides network coverage to more than 90 percent of the country's population, including corporate and private customers.The architecturally advanced solution, featuring Infinys as the embedded rater on Siemens' Charging, enables Telkomsel to explore the full range of convergent pre- and post-paid capabilities. These include real-time checking of credit limits, flexible charge and packages adjustment, as well as the use of bonus schemes and hybrid offers that help enhance customer loyalty and average revenue per user across all subscribers and service types."The success of this project reaffirms our decision to partner with Siemens and Convergys," said Arman Hazairin, Vice President Information and Technology Telkomsel. "We operate in an increasingly competitive market, so it is imperative that we can innovate around products and differentiate our offerings from those of competitors. The charge@once solution enables this, supports our drive to become even more customer-focused, and provides a platform for developing new revenue streams and achieving long-term growth.""Completing the first phase of the implementation, supporting the complete customer base with a comprehensive real-time solution, and providing maximum charging flexibility at Telkomsel are major milestones for the Siemens convergent charging system, charge@once, featuring online rating from Infinys," said Volker Ziegler, President of Applications and Solutions at Siemens COM. "Together with Convergys, we are demonstrating the real-world viability of our solution in a market where similar projects involving other suppliers have not yet been successful. Upon completion, the OPEX-effective solution will place Telkomsel in a unique position, enabling it to respond more quickly to changing market conditions, alter prices, and create discounts or promotions with an ease and alacrity hitherto unattainable.""Telkomsel is already seeing the benefits of a solution that effectively joins the high availability and scalability needed to support a tier-one operation with the real-time functionality and flexibility required to drive a customer-focused business," said Dave Dougherty, President and Chief Operating Officer of Convergys. "This project showcases both the capabilities of the world's first truly commercially operational online charging solution and the benefits of the close working relationship between Convergys and Siemens."Operators' needs for convergent online charging systems are increasing alongside the ever-expanding range of new multimedia data services for the online environment. The ability to handle both pre-paid and post-paid transactions in real time is critical if customers and providers are to quickly check usage limits and status of account balances in real time. This capability, provided by the Siemens and Convergys solution, allows customers to make informed decisions about their usage and expenditures while enabling operators to better manage their risk of revenue exposure. The solution also permits operators to constantly expand the existing charging structures and map new business and billing models in the charging system, which were once restricted to the post-paid offline environment.About TelkomselTelkomsel is the leading operator of cellular telecommunications services in Indonesia by market share. By the end of June 2005, Telkomsel had more than 21 million customers, which represented of around 54 percent market share in the telecommunication industry. Telkomsel provides GSM cellular services in Indonesia, through its own nationwide dual band 900/1800 MHz GSM network, and internationally, has 219 roaming operator partners in 135 countries (June 2005). Telkomsel's operations in Indonesia have grown substantially since the commercial launch of its post-paid services on 26 May 1995. In November 1997, Telkomsel became the first cellular telecommunications operator in Asia to introduce rechargeable GSM pre-paid services, a solution with Siemens. Telkomsel has the largest network coverage of any of the cellular operators in Indonesia, providing network coverage to over 90% of Indonesia's population and is the only operator in Indonesia that covers all of the country's provinces, cities, and regencies ("kabupaten"). The company currently offers GSM Dual Band (900 & 1800), GPRS, Wi-Fi, and EDGE Technology and has a successful 3G trial. For more information, see www.telkomsel.comAbout Siemens CommunicationsSiemens Communications is one of the largest players in the global telecommunications industry. Siemens is the only provider in the market hat offers its customers a full-range portfolio, from end-user equipment to complex network infrastructures for enterprises and carriers as well as related services. Siemens Communications is the world's innovation leader in convergent technologies, products and services for wireless, fixed and enterprise networks. It is the largest Group within Siemens and operates in more than 160 countries around the world. In fiscal 2004 (year-end September 30), its 60,000-strong workforce posted sales of approximately 18 billion Euros. For more information, see http://www.siemens.com/communicationsAbout ConvergysConvergys Corporation (NYSE: CVG) is a global leader in providing customer care, human resources, and billing services. Convergys combines specialized knowledge and expertise with solid execution to deliver outsourced solutions, consulting services, and software support. Clients in more than 60 countries speaking nearly 30 languages depend on Convergys to manage the increasing complexity and cost of caring for customers and employees. Convergys serves the world's leading companies in many industries including communications, financial services, technology, and consumer products. Convergys is a member of the S&P 500 and a Fortune Most Admired Company. Headquartered in Cincinnati, Ohio, Convergys has more than 62,000 employees in 68 customer contact centers, three data centers, and other facilities in the United States, Canada, Latin America, Europe, the Middle East, and Asia. For more information visit www.convergys.com (Infinys is a trademark and Convergys and the Convergys logo are registered trademarks of Convergys Corporation.).
September 27, 2005, Cincinnati, Ohio - Indonesia's premier cellular and wireless network operator Telkomsel has gone live with the first phase of Siemens' (NYSE: SI) market-leading, real-time, convergent charging solution, charge@once, that features Infinys [tm] Rating software from Convergys Corporation (NYSE: CVG). Telkomsel obtained the advanced solution to deliver the first-ever, truly convergent pre- and post-paid rating and billing of individual customer segments regardless of payment options. The solution currently supports more than 21 million subscribers.With the initial implementation by Siemens and Convergys now completed, Telkomsel is using the convergent charging solution to support its geographically complex business that spans over 13,000 islands. The solution satisfied Telkomsel's rigorous IT, engineering, and network requirements. It is now supporting an operation that has more than 54 percent of the mobile market in Indonesia and provides network coverage to more than 90 percent of the country's population, including corporate and private customers.The architecturally advanced solution, featuring Infinys as the embedded rater on Siemens' Charging, enables Telkomsel to explore the full range of convergent pre- and post-paid capabilities. These include real-time checking of credit limits, flexible charge and packages adjustment, as well as the use of bonus schemes and hybrid offers that help enhance customer loyalty and average revenue per user across all subscribers and service types."The success of this project reaffirms our decision to partner with Siemens and Convergys," said Arman Hazairin, Vice President Information and Technology Telkomsel. "We operate in an increasingly competitive market, so it is imperative that we can innovate around products and differentiate our offerings from those of competitors. The charge@once solution enables this, supports our drive to become even more customer-focused, and provides a platform for developing new revenue streams and achieving long-term growth.""Completing the first phase of the implementation, supporting the complete customer base with a comprehensive real-time solution, and providing maximum charging flexibility at Telkomsel are major milestones for the Siemens convergent charging system, charge@once, featuring online rating from Infinys," said Volker Ziegler, President of Applications and Solutions at Siemens COM. "Together with Convergys, we are demonstrating the real-world viability of our solution in a market where similar projects involving other suppliers have not yet been successful. Upon completion, the OPEX-effective solution will place Telkomsel in a unique position, enabling it to respond more quickly to changing market conditions, alter prices, and create discounts or promotions with an ease and alacrity hitherto unattainable.""Telkomsel is already seeing the benefits of a solution that effectively joins the high availability and scalability needed to support a tier-one operation with the real-time functionality and flexibility required to drive a customer-focused business," said Dave Dougherty, President and Chief Operating Officer of Convergys. "This project showcases both the capabilities of the world's first truly commercially operational online charging solution and the benefits of the close working relationship between Convergys and Siemens."Operators' needs for convergent online charging systems are increasing alongside the ever-expanding range of new multimedia data services for the online environment. The ability to handle both pre-paid and post-paid transactions in real time is critical if customers and providers are to quickly check usage limits and status of account balances in real time. This capability, provided by the Siemens and Convergys solution, allows customers to make informed decisions about their usage and expenditures while enabling operators to better manage their risk of revenue exposure. The solution also permits operators to constantly expand the existing charging structures and map new business and billing models in the charging system, which were once restricted to the post-paid offline environment.About TelkomselTelkomsel is the leading operator of cellular telecommunications services in Indonesia by market share. By the end of June 2005, Telkomsel had more than 21 million customers, which represented of around 54 percent market share in the telecommunication industry. Telkomsel provides GSM cellular services in Indonesia, through its own nationwide dual band 900/1800 MHz GSM network, and internationally, has 219 roaming operator partners in 135 countries (June 2005). Telkomsel's operations in Indonesia have grown substantially since the commercial launch of its post-paid services on 26 May 1995. In November 1997, Telkomsel became the first cellular telecommunications operator in Asia to introduce rechargeable GSM pre-paid services, a solution with Siemens. Telkomsel has the largest network coverage of any of the cellular operators in Indonesia, providing network coverage to over 90% of Indonesia's population and is the only operator in Indonesia that covers all of the country's provinces, cities, and regencies ("kabupaten"). The company currently offers GSM Dual Band (900 & 1800), GPRS, Wi-Fi, and EDGE Technology and has a successful 3G trial. For more information, see www.telkomsel.comAbout Siemens CommunicationsSiemens Communications is one of the largest players in the global telecommunications industry. Siemens is the only provider in the market hat offers its customers a full-range portfolio, from end-user equipment to complex network infrastructures for enterprises and carriers as well as related services. Siemens Communications is the world's innovation leader in convergent technologies, products and services for wireless, fixed and enterprise networks. It is the largest Group within Siemens and operates in more than 160 countries around the world. In fiscal 2004 (year-end September 30), its 60,000-strong workforce posted sales of approximately 18 billion Euros. For more information, see http://www.siemens.com/communicationsAbout ConvergysConvergys Corporation (NYSE: CVG) is a global leader in providing customer care, human resources, and billing services. Convergys combines specialized knowledge and expertise with solid execution to deliver outsourced solutions, consulting services, and software support. Clients in more than 60 countries speaking nearly 30 languages depend on Convergys to manage the increasing complexity and cost of caring for customers and employees. Convergys serves the world's leading companies in many industries including communications, financial services, technology, and consumer products. Convergys is a member of the S&P 500 and a Fortune Most Admired Company. Headquartered in Cincinnati, Ohio, Convergys has more than 62,000 employees in 68 customer contact centers, three data centers, and other facilities in the United States, Canada, Latin America, Europe, the Middle East, and Asia. For more information visit www.convergys.com (Infinys is a trademark and Convergys and the Convergys logo are registered trademarks of Convergys Corporation.).
ETL
Extract, transform, load
From Wikipedia, the free encyclopedia
Extract, Transform, and Load (ETL) is a process in data warehousing that involves
extracting data from outside sources,
transforming it to fit business needs (which can include quality levels), and ultimately
loading it into the end target, i.e. the data warehouse.
ETL is important, as it is the way data actually gets loaded into the warehouse. This article assumes that data is always loaded into a data warehouse, whereas the term ETL can in fact refer to a process that loads any database. ETL can also be used for the integration with legacy systems. Usually ETL implementations store an audit trail on positive and negative process runs. In almost all designs, this audit trail is not at the level of granularity which would allow to reproduce the ETL's result if the raw data were not available.
Extract
The first part of an ETL process is to extract the data from the source systems. Most data warehousing projects consolidate data from different source systems. Each separate system may also use a different data organization / format. Common data source formats are relational databases and flat files, but may include non-relational database structures such as IMS or other data structures such as VSAM or ISAM. Extraction converts the data into a format for transformation processing.
An intrinsic part of the extraction is the parsing of extracted data, resulting in a check if the data meets an expected pattern or structure. If not, the data is rejected entirely.
[edit] Transform
The transform stage applies a series of rules or functions to the extracted data from the source to derive the data to be loaded to the end target. Some data sources will require very little or even no manipulation of data. In other cases, one or more of the following transformations types to meet the business and technical needs of the end target may be required:
Selecting only certain columns to load (or selecting null columns not to load)
Translating coded values (e.g., if the source system stores 1 for male and 2 for female, but the warehouse stores M for male and F for female), this is called automated data cleansing; no manual cleansing occurs during ETL
Encoding free-form values (e.g., mapping "Male" to "1" and "Mr" to M)
Deriving a new calculated value (e.g., sale_amount = qty * unit_price)
Joining together data from multiple sources (e.g., lookup, merge, etc.)
Summarizing multiple rows of data (e.g., total sales for each store, and for each region)
Generating surrogate key values
Transposing or pivoting (turning multiple columns into multiple rows or vice versa)
Splitting a column into multiple columns (e.g., putting a comma-separated list specified as a string in one column as individual values in different columns)
Applying any form of simple or complex data validation; if failed, a full, partial or no rejection of the data, and thus no, partial or all the data is handed over to the next step, depending on the rule design and exception handling. Most of the above transformations itself might result in an exception, e.g. when a code-translation parses an unknown code in the extracted data.
[edit] Load
The load phase loads the data into the end target, usually being the data warehouse (DW). Depending on the requirements of the organization, this process ranges widely. Some data warehouses might weekly overwrite existing information with cumulative, updated data, while other DW (or even other parts of the same DW) might add new data in a historized form, e.g. hourly. The timing and scope to replace or append are strategic design choices dependent on the time available and the business needs. More complex systems can maintain a history and audit trail of all changes to the data loaded in the DW.
As the load phase interacts with a database, the constraints defined in the database schema as well as in triggers activated upon data load apply (e.g. uniqueness, referential integrity, mandatory fields), which also contribute to the overall data quality performance of the ETL process.
From Wikipedia, the free encyclopedia
Extract, Transform, and Load (ETL) is a process in data warehousing that involves
extracting data from outside sources,
transforming it to fit business needs (which can include quality levels), and ultimately
loading it into the end target, i.e. the data warehouse.
ETL is important, as it is the way data actually gets loaded into the warehouse. This article assumes that data is always loaded into a data warehouse, whereas the term ETL can in fact refer to a process that loads any database. ETL can also be used for the integration with legacy systems. Usually ETL implementations store an audit trail on positive and negative process runs. In almost all designs, this audit trail is not at the level of granularity which would allow to reproduce the ETL's result if the raw data were not available.
Extract
The first part of an ETL process is to extract the data from the source systems. Most data warehousing projects consolidate data from different source systems. Each separate system may also use a different data organization / format. Common data source formats are relational databases and flat files, but may include non-relational database structures such as IMS or other data structures such as VSAM or ISAM. Extraction converts the data into a format for transformation processing.
An intrinsic part of the extraction is the parsing of extracted data, resulting in a check if the data meets an expected pattern or structure. If not, the data is rejected entirely.
[edit] Transform
The transform stage applies a series of rules or functions to the extracted data from the source to derive the data to be loaded to the end target. Some data sources will require very little or even no manipulation of data. In other cases, one or more of the following transformations types to meet the business and technical needs of the end target may be required:
Selecting only certain columns to load (or selecting null columns not to load)
Translating coded values (e.g., if the source system stores 1 for male and 2 for female, but the warehouse stores M for male and F for female), this is called automated data cleansing; no manual cleansing occurs during ETL
Encoding free-form values (e.g., mapping "Male" to "1" and "Mr" to M)
Deriving a new calculated value (e.g., sale_amount = qty * unit_price)
Joining together data from multiple sources (e.g., lookup, merge, etc.)
Summarizing multiple rows of data (e.g., total sales for each store, and for each region)
Generating surrogate key values
Transposing or pivoting (turning multiple columns into multiple rows or vice versa)
Splitting a column into multiple columns (e.g., putting a comma-separated list specified as a string in one column as individual values in different columns)
Applying any form of simple or complex data validation; if failed, a full, partial or no rejection of the data, and thus no, partial or all the data is handed over to the next step, depending on the rule design and exception handling. Most of the above transformations itself might result in an exception, e.g. when a code-translation parses an unknown code in the extracted data.
[edit] Load
The load phase loads the data into the end target, usually being the data warehouse (DW). Depending on the requirements of the organization, this process ranges widely. Some data warehouses might weekly overwrite existing information with cumulative, updated data, while other DW (or even other parts of the same DW) might add new data in a historized form, e.g. hourly. The timing and scope to replace or append are strategic design choices dependent on the time available and the business needs. More complex systems can maintain a history and audit trail of all changes to the data loaded in the DW.
As the load phase interacts with a database, the constraints defined in the database schema as well as in triggers activated upon data load apply (e.g. uniqueness, referential integrity, mandatory fields), which also contribute to the overall data quality performance of the ETL process.