The AABC Archivist's Toolkit: Digital Preservation Management

The goal of this page is to present resources and background materials that can help your organization start to plan for, or further your digital preservation management program for electronic and born-digital records. Resources will be updated as new best practices are shared and scholarly publications are made available on this topic. If you know of additional resources or digital preservation links that should be added to this site, please contact the AABC.                                                                                                                                                                                                                                                                                                                            

Planning, frameworks and policy development

Resources:

Digital Preservation Management workshop tutorial: http://dpworkshop.org/

Digital Preservation Coalition Handbook: http://www.dpconline.org/ advice/handbook-2

Reference Model for an Open Archival Information System (OAIS)

Preserving Access to Digital Information (PADI), National Library of Australia

Checklist for Cloud Service Contracts, InterPARES Trust

Example policies:

Simon Fraser University Digital Preservation: https://www.sfu.ca/archives/digital-repository.html

Scholars Portal Trusted Digital Repository planning: https://spotdocs.scholarsportal.info/display/OAIS/Home

Harvey, Ross. Digital Curation, a How-to-do-it manual: http://www.nealschuman.com/nealschuman/companionwebsite/curation/

 

Digital preservation metadata

Metadata should be captured which reflects the digital preservation actions which have taken place as well as technical metadata about the objects being preserved.

Resources:

Preservation Metadata Implementation Standard (PREMIS): http://www.loc.gov/standards/premis/

Metadata Encoding and Transmission Standard (METS): http://www.loc.gov/standards/mets/

 

Digital preservation actions

There are a number of discrete actions that may take place as part of digital preservation workflows. Below, tools and resources are broken down into the type of action taking place. There is an emphasis on free and open-source tools.

General resources:

POWRR (Preserving digital Objects With Restricted Resources): http://digitalpowrr.niu.edu/

COPTR (Community Owned digital Preservation Tool Registry):  http://coptr.digipres.org/ Main_Page

Checksums/fixity

Tools to create checksums:
* md5deep: http://md5deep.sourceforge.net/ 
* md5summer: http://www.md5summer.org/ 
* Built into various preservation systems/tools: Archivematica, Preservica, Bagger, DuraCloud, etc.

Tools to check checksums:
* Fixity: https://github.com/avpreserve/fixity 
* Built into various tools/systems as above

Virus scanning

Tools to scan viruses:

* Clam AV : http://www.clamav.net/

Virus scanning is typically built into preservation systems.

File format identification

Tools to identify file formats:

*Format Identifier for Digital Objects (FIDO): https://github.com/openplanets/fido 
*Siegfried: https://github.com/richardlehane/siegfried 
*File Information Tool Set (FITS): http://projects.iq.harvard.edu/fits 
(Bundles together many other tools and acts as a wrapper)
*DROID: https://github.com/digital-preservation/droid

Resources:

PRONOM, National Archives of the UK: http://www.nationalarchives.gov.uk/PRONOM/Default.aspx

Library of Congress Format Description Documents: http://www.digitalpreservation.gov/formats/fdd/descriptions.shtml

File formats wiki:http://fileformats.archiveteam.org/wiki/Main_Page

Characterization/metadata extraction

Tools for metadata extraction/characterization:

*File Information Tool Set (FITS): http://projects.iq.harvard.edu/fits 
*Metadata extraction tool: http://meta-extractor.sourceforge.net/ 
*ffprobe: https://ffmpeg.org/ffprobe.html 
*Exiftool: http://www.sno.phy.queensu.ca/~phil/exiftool/ 
*MediaInfo: https://mediaarea.net/en/MediaInfo 
*Sleuthkit: http://www.sleuthkit.org/

Validation

Tools for validation:
*JHOVE: https://github.com/openpreserve/jhove

*veraPDF: http://verapdf.org/ 
*MediaConch: http://mediaarea.net/mediaconch 
*DPF Manager: http://dpfmanager.org/ 
*jpylyzer: http://jpylyzer.openpreservation.org/

Normalization/migration

Tools for normalization/migration:
*Imagemagick: http://www.imagemagick.org/script/index.php

*Inkscape: http://www.inkscape.org/ 
*FFMPEG: http://ffmpeg.org/ffmpeg.html 
*Ghostscript: http://www.ghostscript.com/

Preservation systems
There are a number of digital preservation systems that combine all or some of the preservation actions described above:

Open source:
Archivematica: http://archivematica.org/ 
E-Ark: http://eark-project.com/ 

Proprietary:
Preservica: http://preservica.com/ 
Rosetta: http://www.exlibrisgroup.com/category/RosettaOverview

Storage management

iRODS: https://www.irods.org/index.php 
Swift: http://docs.openstack.org/developer/swift/ 
LOCKSS: http://lockss.org

 

Acquisitions and accessioning

Resources:

PAIMAS:   http://www.dcc.ac.uk/resources/standards/diffuse/show?standard_id=154

Paradigm project: http://www.paradigm.ac.uk/

InterPARES Digital Record Acquisitions Policy: http://interpares.org/ip3/ip3_case_studies.cfm?team=1#cs08

A First Look at the Acquisition and Appraisal of the 2010 Olympic and Paralympic Winter Games Fonds: or, SELECT * FROM VANOC _Records AS Archives WHERE Value="true";

Tools:

Exactly: https://www.avpreserve.com/tools/exactly/

SFU MoveIT tool: https://www.sfu.ca/archives/digital-repository/move-it.html

 

Physical preservation of digital carriers

Resources:

Born Digital Photographs: Acquisition and Preservation Strategies Presentation developed by Rosaleen Hill and delivered at the 2006 AABC Annual Conference

Guidelines on the Production and Preservation of Digital Audio Objects International Association of Sound and Audiovisual Archives

 

Trusted Digital Repository Audit and Certification

Resources:

Philip Bantin, ed., Building Trustworthy Digital Repositories, Theory and Implementation: https://rowman.com/ISBN/9781442263796/Building-Trustworthy-Digital-Repositories-Theory-and-Implementation

Trusted Digital Repositories: Attributes and Responsibilities

Trustworthy Digital Repositories Audit & Certification (TDR)

Tools:

Self-assessment tool:   https://www.archivematica.org/en/docs/archivematica-1.6/getting-started/other-resources/trac/#trac

 

Digital Preservation Management: Further Resources

 

Example of wordmark with acknowledgement text in French and English. 

Your browser (Internet Explorer 6) is out of date. It has known security flaws and may not display all features of this and other websites. Learn how to update your browser.