Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3
Info

This page contains information about data migration ETL work for HAVRC's deployment of CollectionSpace

...

  • Additional field to hold legacy source_id to aid migration?
  •  

    HAVRC Table Name

    HAVRC Field Name

    CSpace Information Group

    CSpace Field Name

    Notes

    Source

     

    Citation Autuhority

     

     

     

    source_abbrev

    Citation Information

    Brief Citation

     

     

    source_id

    Citation Information

    Local Source Id (Custom field)

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    source_type

    Citation Information

    Source Type

    b=book, j=journal, v=vendor, d=donor/duplicate, m=electronic media, e=exhibition, o=other.  Note: other suggested source types are more granular but these values will speed the initial data migration.

    www_source_citations

    cite

    Citation Information

    Source Full Citation

    The cite field in this table contains a fully formatted citation for each accession (including page and plate numbers).  SQL code used to populate this field for the website data (format_cdwa_source?) could be edited to populate this field with legacy data (i.e. edit the part of the code that adds page and plate numbers and put that page&plate number data in the source detail field of the media handling record for that accession.  Full citation for new citation records added post-migration will have to be constructed manually for this field or generated and pasted from an external application such as Refworks.

    Book

     

    Citation Authority

     

    For all those source records where source_type=b

     

    source_id

    Citation Information

    Local Source Id (Custom field)

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    author

    Person/Org Authority

    Display Name

    Many HAVRC book records contain multiple authors in the author field.  This data will need to be parsed and imported as separate names and entered into the Person Authority, or separated manually post-migration.

     

    book_title

    Title and Issue Information

    Source Title

    447 HAVRC book titles contain subtitle or section title info.  Data will either need to be parsed and imported separately, or done so manually post-migration.

     

    series_title

    Title and Issue Information

    Source Title

    Create new Citation record for the series title with Source Type="Series". Link as broader context in Hierarchical Relationships to record where series title appears in HAVRC series_title field.

     

    edition

    Title and Issue Information

    Source Edition

     

     

    publish_location

    Publisher Information

    Source Publication Place

     

     

    publisher_name

    Publisher Information

    Source Publisher

     

     

    publish_year

    Title and Issue Information

    Source Publication Year

     

     

    book_call_num

    Resource Identifiers

    Source Other Identifier

    Map with "Call number" in Source Other Identifier Type

     

    book_volume

    Title and Issue Information

    Source Volume

     

     

    book_abbrev

     

     

    From Source table (see above)?

     

    book_comments

    Publisher Information

    Remarks

     

     

    ISBN

    Resource Identifers

    Source Other Identifier

    Map with "ISBN" in Source Other Identifier Type

     

    date_entered

    Citation Information

    Source Data Capture Date

     

    Journal

     

    Citation Authority

     

    For all those source records where source_type=j

     

    source_id

    Citation Information

    Local Source Id (Custom field) 

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    journal_title

    Title and Issue Information

    Source Title

     

     

    journal_volume

    Title and Issue Information

    Source Volume

     

     

    journal_issue

    Title and Issue Information

    Source Issue

     

     

    journal_year

    Title and Issue Information

    Source Publication Year

     

     

    journal_month

    Title and Issue Information

     

    No real place for this in new schema unless added to Source Issue. Example: For Art Bulletin volume LXV issue 3, published in September of 1983:  in Source Issue put "3 (SEP)"

     

    journal_abbrev

    Citation Information

    Brief Citation

     

     

    ISSN

    Resource Identifers

    Source Other Identifier

    Map with "ISSN" in Source Other Identifier Type

     

    journal_call_num

    Resource Identifiers

    Source Other Identifier

    Map with "Local Call Number" in Source Other Identifier Type

     

    journal_comment

    Publisher Information

    Source Remarks

     

     

    date_entered

    Citation Information

    Source Data Capture Date

     

    Vendor Images

     

    Citation Authority

     

    For all those source records where source_type=v. Vendor images purchased both individually and in sets.  Data from Vendor table maps to Org Authority.  Data from vendor_set (or xdb_vendor_set_qv) to Citation Authority

    xdb_vendor_set_qv

    source_id

    Citation Information

    Local Source Id (Custom field)

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    vendor_name

    Publisher Information

    Source Publisher

    Vendor name maps to either Person or Org Authority.  Will need custom map for legacy data

     

    vendor_set_abbrev

    Citation Information

    Brief Citation

    If set_flag is "No" map only vendor_order_abbrev to Brief Citation. 

     

    vendor_item_id

    Title and Issue Information

    Source Title

    If set_flag is "yes" map vendor_item_id to Title and Issue Information - Source Title

     

    set_comments

    Publisher Information

    Source Remarks

     

     

    set_flag

    Citation Information

    Vendor Set (local boolean field?)

    Determines whether the citation refers to an individual image or a set of images.  Use for migration of legacy data only or put in custom local field "Vendor Set"

     

    date_entered

    Citation Information

    Source Data Capture Date

     

    Donors/Duplicates

     

    Citation authority

     

    For all those source records where source_type=d.  Most donor names map to Person Authority, a few to Org Authority.  Need to cull duplicate names entered with different donation types (e.g. same name entered as source for donated slide, duplicate slide, and oral history, etc.)

    donor

    source_id

     

    Citation Information

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    Local Source Id (Custom field) 

     

     

    donor_name

    Person Authority

    Person Display Name; Forename; Surname

    Person and Org names will need to be separated manually.  After dups are culled, map donor_name to Person displayName, parse last name and first name at comma and place in Forename and Surname fields of Person Authority.  For orgs, map donor_name to Organization displayName

     

    date_entered

    Citation Information

    Source Data Capture Date

     

    xdb_donor_qv

    credit_line

    Media Handling

    Copyright Statement

    Any data in credit line maps to media handling records for the accessions that point to this source_id as image source.

     

    copyright_owner

    Media Handling

    Rights Holder

    If copyright_owner=1 ("yes") then map name to Rights Holder field of Media Handling record for each accession linked to this source_id as image source.

     

    donor_comments

    Publisher Information

    Source Remarks

     

    Electronic Resources

     

    Citation Authority

     

    For all those source records where source_type="m"

    xdb_electronic_media_qv

    source_id

    Citation Information

    Local Source Id (Custom field) 

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    electronic_media_abbrev

    Citation Information

    Source Brief Citation

     

     

    electronic_media_title

    Title and Issue Information

    Source Title 

     

     

    publisher_name

    Publisher Information

    Source publisher

     

     

    publish_location

    Publisher Information

    Source Publication Place

     

     

    publish_year

    Title and Issue Information

    Source Publication Year

     

     

    url

    Resource identifiers

    Source Other identifier

     

     

    medium

    Citation Information

    Source type

     

     

    data_format

     

     

    add to comments?

     

    series_title

     

     

    no data

     

    media_count

     

     

    only 1 record contains a value - add to comments

     

    media_call_num

     

     

    no data

     

    system_requirements

     

     

    add to comments?

     

    media_size

     

     

    no data

     

    electronic_media_comments

    Citation Information

    Source Remarks

     

     

    date_entered

    Citation Information

    Source Data Capture Date

     

    Exhibition

     

    Citation Authority

     

    For all those source records where source_type=e.  Most data in this table will map to Exhibition Authority

    www_source_citations

    source_id

    Citation Information

    Local Source Id (Custom field)  

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

    xdb_exhibit_qv

    exhibit_abbrev

    Citation Information

    Source Brief Citation

     

    xdb_exhibit_qv

    exhibit_title

    Citation Information

    Source Title

     

    xdb_exhibit_qv

    exhibit_item_type

    Citation Information

    Source Type

     

     

    date_entered

    Citation Information

    Source Data Capture Date

     

    Other Sources

     

    Citation Authority

     

    For all those source records where source_type=o

    other_sources

    source_id

    Citation Information

    Local Source Id (Custom field)   

    Either create a custom field or map to Other Resources-> Source Other Identifier with a Source Other Identifier type="legacy_source_id"

     

    other_abbrev

    Citation Information

    Source Brief Citation 

     

     

    other_descr

    Citation Information

    Source Remarks

     

    xdb_other_sources_qv

    pre_seurat_order_num

    Resource Identifiers

    Source Other Identifier

     

     

    format_descr

    Resource identifiers

    Source Other Identifier Type

     

     

    date_entered

    Resource Identifier

    Source Identifier Capture Date

     

...