Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

It also names some key things to understand about the design and function of the CSV Importer, which are by design, but important to understand.

Table of Contents

General

Processed records are only stored for one day

The processing step creates CollectionSpace XML records. The transfer step ingests these XML records into the CollectionSpace instance.

The processed XML records expire after one day. If you wait too long between the processing step and transferring, you will transfer errors with the message: “No processed data found. Processed record may have expired from cache, in which case you need to start over with the batch.”

There are two reasons for this:

  • We cannot support storing all untransferred records forever for everyone who uses the the CSV Importer

  • The status or underlying data values of the target records can change after the processing step. More time between processing and transfer means greater likelihood of transferring outdated records, which is dangerous to data integrity.

The CSV Importer works only with the underlying data layer

...