tackling file characterization and analysis in archivematica
TRANSCRIPT
![Page 1: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/1.jpg)
Tackling File Characterization & Analysis with Archivematica
Courtney C. MummaCurateGear 2013
Wednesday, January 9, 2013
Jetsons-robot-football-player1 - I, Foxbot
![Page 2: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/2.jpg)
digital preservation consulting open-source sofware for archives and libraries
![Page 3: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/3.jpg)
`
web-based dashboard
monitor and control
web server
MCP server
micro-service processing clients
watched directory
success
error
fileshare
successdigital curationmicro-services
pythonscripts
FOSStools
AIP
DIP
SIP or
transfer of digital objects
& metadata
![Page 4: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/4.jpg)
Preservation planning
● A two-pronged approach:● Normalization on ingest● Preservation of the original file to support future
strategies such as emulation
● Normalization relies on format policies based on an analysis of the significant characteristics of file formats
– A format policy indicates the actions, tools and settings to apply to a file of a particular file format (e.g. normalization to preservation and/or access format)
![Page 5: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/5.jpg)
Archivematica format policies
● Criteria for selecting default formats:– Non-proprietary– Freely available specifications– Widely used/endorsed by major repositories– No compression/lossless video compression– Tools available to write and render the format
● Format policies will change as community standards, practices and tools evolve.
![Page 6: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/6.jpg)
https://www.archivematica.org/wiki/Format_policies
![Page 7: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/7.jpg)
Format confessional
●
iPres 2012 Toronto CurateCamp
![Page 8: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/8.jpg)
24-hour CurateCamp/OPF worldwide file id hackathon
● participants from every time zone
● rapid, iterative testing● OpenFITS (github
fork)● Open Planets Format
Corpus (github)
![Page 9: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/9.jpg)
Choose normalization tool
![Page 10: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/10.jpg)
Select normalization type
![Page 11: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/11.jpg)
Review normalization results
![Page 12: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/12.jpg)
Format Policy Registry - FPR
● To share and test format choices and tool commands for normalization
– ie “format policies”
● To support the community-wide evolution of best practices
● Hosted at archivematica.org/FPR with local dashboard customization and updates
![Page 13: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/13.jpg)
Format Policy Registry - FPR
● Allow users to choose:● normalization tool ● preservation and/or access format ● file properties (eg resolution, bitrate)● to use local tool/process outside of the system
● Allow users to add new format policies
![Page 14: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/14.jpg)
Format Policy Registry - FPR
![Page 15: Tackling File Characterization and Analysis in Archivematica](https://reader035.vdocuments.net/reader035/viewer/2022081404/5578f3b4d8b42a675b8b4571/html5/thumbnails/15.jpg)