Repo to store CHIT-related work on archival and manuscript metadata reconciliation
utilitiespackage for file processing and http utilities
Metadata schemas and controlled vocabularies for agents and subjects currently in use by YUL special collections and BRBL
ArchivesSpace metadata schemas for agents and subjects:
- abstract_agent
- agent_person
- agent_family
- agent_corporate_entity
- agent_contact
- name_corporate_entity
- name_family
- name_person
- telephone
- [subject]
- [term]
ArchivesSpace documentation
XML-based schemas:
Example of JSON agent and subject records from ArchivesSpace
resource record with linked agents
Examples of collection-level EAD files with linked agents (exported from ArchivesSpace):
Agents
- Personal names, corporate names: Library of Congress Name Authority File (LCNAF)
- Family names: Library of Congress Subject Headings (LCSH)
Subjects
Deliverables:
- Task Force Documentation
- Task Force Final Report
- Task Force Future Recommendations
- Ruby app that parsed MARC fields and downloaded authority files
- ArchivesSpace authority record importer
- Spring 2020 student job description
Preliminary task list:
- Reconcile agents and subjects with existing LCNAF and AAT URIs against Wikidata, SNAC, ULAN, VIAF others?
- Reconcile agents and subjects without existing LCNAF and AAT URIs against Wikidata (pulling LCNAF and other URIs from Wikidata where possible) - includes agents created since last reconciliation and potentially another round on agents which were not found in previous round (using OpenRefine, possibly)
- Edit and upload duplicate detection script to GH repo
- Create reports for use in reconciliation (i.e. will need to have links to finding aids side-by-side with agent records for manual review)
- Create instructions for authority reconciliation in OpenRefine
- Import of authority records into ArchiveSpace following previous processes
- Review of results
- Data audit of agent and subject records in ArchivesSpace (partially Python, partially OpenRefine)
- Cleanup of agent and subject records in ArchivesSpace
- De-duplication - should this happen before or after reconciliation. Or both?
- Planning for storage of additional URIs - no way in ArchivesSpace to store more than one
- Compare and remediate differences between ArchivesSpace and Voyager agent and subject records
- Agents - people, all fields
- Agents - corporate entities, all fields
- Agents - families, all fields
- All agent links
- All subjects, all fields
- All subject links
- All agents with URIs
- All agents without URIs
- All agents created since July 21, 2018 with URIs
- All agents created since July 21, 2018 without URIs
- All subjects created since July 21, 2018 with URIs
- All subjects created ince July 21, 2018 without URIs
- Counts?
- Wikidata
- id.loc.gov
- Getty
- SNAC
- VIAF
- ArchivesSpace
- Questioning Authority
- LD4P Lookup Service
- Metaphactory
- Wikidata Authority Control
- Wikidata Data Access
- Wikibase Data Model
- Extracting Data From Wikidata JSON
- Example Workflow for Python-based SPARQL Queries
- Linking records back to Wikidata
- Wikidata Tools for Programmers
- WikidataIntegrator
- Extracting info from Wikidata responses, 1
- Extracting info from Wikidata responses, 2