UC Deployment - Large Volume Data Loading Notes

This page will be used for keeping track of the issues, techniques, problems, success and lessons learned from loading large volumes of data (e.g. 500,000+ records) into CollectionSpace 1.0.

Questions to be answered include, but are not limited to:

  • What lessons do we want to learn?
  • What do we want to track?
  •  How long does it take to load?
  •  What data quality issues do we discover? (We will focus on getting lots of data in than in cleaning up all data.)
  • How is search impacted?
  • How is performance in general?