+

N D
S R
Digital Preservation
Landscape

What we will talk about

Underlying
Tools

principles

for digital preservation

Workflow
Digital

systems

preservation leadership

Engaging

with the community

Stages of Automation
Basic

tool: improvement, but only a step away from

manual process

Tool refinement:

take advantage of automation benefits

to develop basic tool

Production tool : develop

phases of development

stable tool with managed

Basic

workflow: defines basic sequence of tool

application and actions

Workflow refinement: string tools

Production workflow : full

together

integration of process

OAIS
Open Archival Information System

OAIS
Open Archival Information System

Planning
Where do you start?

Preservation planning tools

Can

help with planning before

repository development

Can

be used to assess current efforts

Can

be used to identify gaps

Plato Preservation
Planning Tool
http://www.ifs.tuwien.ac.at/dp/plato/intr
o.html

Preservation Planning - plato

plato case study

http://youtu.be/K6NnFcSpAh8

SCAPE Scalable Preservation

Environments

http://www.scape-project.eu

DRAMBORA
Digital

Repository Audit Method Based on

Risk Assessment

Online

toolkit

Process
Self-Assessment
Identifying

and Assessing Risks

Mitigating Risks and Re-assessment
http://www.repositoryaudit.eu

Trusted Repository Audit Checklist

(TRAC)
Auditing

tool

Assess
Reliability
Commitment
Readiness

Currently

under the Center for

Research Libraries (CRL)

NDSA Levels of Preservation (LC)

http://www.digitalpreservation.g
ov/ndsa/activities/levels.html

tiered set of recommendations

for how organizations should
begin to build or enhance their
digital preservation activities

+ Considerations
What decisions has your organization
made about repository-level
management?
Has your organization explored cloud
computing options?
How will you anticipate change?
What is your technical capacity?

+ Administration
Follow

key developments

Balance
Know

yourself

Adjust

for your organizational context

Manage
No

planning and doing

human side of technology, too

on/off switch incremental progress

Anticipate
Manage

change

technology over time

Tools
What will help you get the
job done?

Tools Overview
Often

initiated to solve a specific problem

Tools

plug into workflows and repositories

Developments
Increasing

began with Ingest

numbers of open source tools

Generic

tools suffice in some cases

Projects

for most OAIS functions now

Status:

emerging and evolving rapidly

+ Ingest Tools (producer)

Prompt/assist
descriptive

producer with:

data
provenance data
technical data (e.g. creator software)
initial fixity determination

Ingest Tools (repository)

Virus

checking

File

type identification/verification

File

validation

Metadata
File

extraction (technical metadata)

normalization

Fixity

verification

Persistent

identifiers (assign and manage)

BagIt
Protocol for

packaging and exchanging

digital content in a generic way

Defined

by California Digital Library

and Library of Congress

Software independent

DROID
DROID

Digital Record and Object Identification

Identifies

the precise format of all stored digital

objects
links

that identification to a central registry

http://www.nationalarchives.gov.uk/information-

management/projects-and-work/droid.htm

JHOVE2
JHOVE

- JSTOR/Harvard Object Validation

Environment

Format

aware characterization of digital objects

Functions:

What is it? What about it? What is it,

really? So what?

https://bitbucket.org/jhove2/main/wiki/About

Metadata Extraction Tool

Automatically

extracts preservation metadata

from files
Outputs

that metadata in a standard format

(XML) for use in preservation activities.

http://meta-extractor.sourceforge.net/

+
Tools for Digital Forensics

http://www.bitcurator.net/
Information and Quick Start on the wiki

PRONOM
File

format registry

Online

information system about data file

formats and supporting products

http://www.nationalarchives.gov.uk/PRONO

M/Default.aspx

Registries
GDFR

Global Digital Format Registry

http://gdfr.info/

UDFR

Unified Digital Format Registry

http://udfr.cdlib.org/

+
FITS Tool Set
FITS

File Information Tool Set

https://code.google.com/p/fits/
Uses

a variety of tools

Common Tool Problems

Installation glitches and

Delays

other bugs

and stoppages
Insufficient documentation / support
Task and data redundancy
Tool Incompatibility
Learning curve / training requirements
Data independence from tool
Organizational / IT support

Digital Preservation Workflows:

Tools all grown up!

+
Digital Preservation Systems
Holistic

view

Integrated

tools

Automated

workflow management

+
Status of DP Workflows
Systems

are maturing

Combined
Informed

- building on one or more tools

by e-science developments

May be:
Integrated into repositories
Defined as a sequence of human/tool
Factor

in managing at repository level

Encouraged

by focus on re-use

steps

CDL Micro-Services

Micro-services launched 2010

Archivematica

http://www.ifs.tuwien.ac.at/
dp/ipres2010/papers/vanG
arderen28.pdf

Collaborative Efforts
MetaArchive
Chronopolis
Academic

Preservation Trust

(APTrust)
Digital

Preservation Network (DPN)

+ POWRR

http://digitalpowrr.niu.edu

+
Leadership and Training

Digital Preservation Management

Follow

key developments

Balance
Know

yourself

Adjust

for your organizational context

Manage
No

planning and doing

human side of technology, too

on/off switch incremental progress

Anticipate
Manage

change

technology over time

Technology Investments
Prioritize:

meet essential requirements

Sequence:
Assess:

Fund:

identify stages to accomplish

determine when to respond

decide when to own/share

Anticipate:

Evaluate:

understand past, look ahead

establish ongoing review

Considerations
How

does technology investment work at

your organization? (understand the system)

What

level of support is there for technology

(e.g., direct or indirect, skills, development)?

Are

there development plans for humans and

systems in place? (if not, add to to-dos)

How

willing is your organization to lead, test,

anticipate, fail?

Judging Solutions
written

in a well-documented language
usable on a wide variety of platforms
longevity commitment, duration of support
modular in design
support for batch processing and workflows
designed for workflow integration
development by quality staff
licensing options and good access to code

Digital Preservation Training

DPOE
http://www.digitalpreservation.gov/educatio

n/
DigCurv
http://www.digcur-education.org

DigCCurr

http://www.ils.unc.edu/digccurr/

Digital

Preservation Mgt Workshop

http://www.dpworkshop.org/dpm-

eng/eng_index.html

+ Engaging with the

Community

Resources
Organizations
Listservs
Conferences
Web

and meetings

resources

Webinars

Organizations

Preservation and Archiving Special Interest Group (PASIG)

ALA ALCTS PARS Digital Preservation Interest Group

Association for Information Science and Technology (ASIS&T)

Society for Imaging Science and Technology (IS&T)

Archiving

Digital Preservation Coalition

Natl Digital Stewardship Alliance (NDSA)

Society of American Archivists (SAA)

+
National Digital Stewardship
Alliance (NDSA)
Mission:

establish, maintain, and advance

the capacity to preserve our nation's digital
resources for the benefit of present and
future generations.

Working

Groups: Content, Standards,

Infrastructure, Innovation, Outreach

http://www.digitalpreservation.gov/ndsa/

Conferences
International

Digital Curation Conference (IDCC)

PASIG
Open

Repositories

iPres
Joint

Conference on Digital Libraries (JCDL)

NDSA

+ Web resources
Digital

Preservation Outreach & Education (DPOE)

http://www.digitalpreservation.gov/education/index.html

Digital

Curation Centre (DCC) http://www.dcc.ac.uk/

Digital

Preservation Coalition http://www.dpconline.org/

Digital

Curation Exchange
http://digitalcurationexchange.org

Listservs
digipres@ala.org
digital-preservation@jiscmail.ac.uk

+
Questions and Discussion