Develop > Persistence layer > Data assets > Work with the Data load utility
Data load architectural overview
In order to work with the data load utility, first have an understanding of how it works.
The following diagram describes the components of the data load utility:
- Business object builder layer
- The business object builder layer contains the data reader and the business object builder. The data reader is responsible for reading the raw data and passing it to the business object builder for processing and building business objects. The business object builder takes the data as input from the data reader, then populates and instantiates the business objects. Each business object is defined as a common entity throughout the WebSphere Commerce data model. In other words, you only have to understand a single representation of the data through the store front, authoring tools, and the data load infrastructure.
The business object builder layer supports different types of data sources, such as data stored in comma-separated values (CSV) format, XML files, external databases, and enterprise resource planning (ERP) systems. A CSV data reader is provided with the data load utility. It is necessary to create custom data readers in order to support data sources of types other than CSV files.
The following business object builders are provided:
- com.ibm.commerce.foundation.dataload.businessobjectbuilder.BaseBusinessObjectBuilder
- com.ibm.commerce.foundation.dataload.businessobjectbuilder.TableObjectBuilder
- Business object mediator layer
- The business object mediator layer contains the business object mediator. The business object mediator converts the business objects into objects that represent the physical database schema, also referred to as physical objects. Several mediators are available for catalog, inventory, and price components. A TableObjectMediator is also provided to support loading data to any table.
The ID resolver is also a part of the business object mediator layer. It is used to figure out if a physical object, which represents a row in a table, exists in a database. If the object is in the database, it returns the existing primary key of the object. Otherwise it returns a new primary key for this new physical object.
- Persistence layer
- The persistence layer persists the physical objects into the WebSphere Commerce database. Two data writers are provided:
- com.ibm.commerce.foundation.dataload.datawriter.JDBCDataWriter
- com.ibm.commerce.foundation.dataload.datawriter.NativeDBDataWriter
- Business context service
- The business context service manages contextual business information. The information is encapsulated within the different layers of the data load utility, and can be reused when needed to improve efficiency. Business objects uses a business context to represent common configuration information necessary to load data such as for a particular store, member IDs, or language. The context can also store component-specific configuration information such as master catalog identifiers, or invocation-specific configuration information such as the specific persistence mechanism and parameters.
Related concepts
Data load framework process and components
Related tasks
Work with the Data load utility
Customize the data load utility
Related reference