web archiving workflow

Web Archiving Presentation Oliver MattheussensOctober 16th, 2014

Wednesday, October 15, 14

New Web Archiving Research Guide is now available (private setting)

Wednesday, October 15, 14

• What is Web Archiving and WAS?

• What projects are suitable for Web Archiving?

• If a librarian, faculty member or student is interested in doing a web archiving project, what are the steps you need to take?

Introduction to Web Archiving

Wednesday, October 15, 14

What is Web Archiving?Web archiving is the process of collecting portions of

the World Wide Web to ensure the information is preserved for future researchers and the public.

Wednesday, October 15, 14

The Web Archiving Service (WAS) was developed by the University of California Curation Center as a full-service archiving solution for libraries and institutions.

http://webarchives.cdlib.org/

WAS provides all the tools necessary to capture, manage, and preserve web content and give public access to collections of archived sites.

What is WAS?

Wednesday, October 15, 14

You can use WAS in two ways: (1) to build your own archives (2) to access freely availablepublic archives built by UC

libraries and other institutions.

Wednesday, October 15, 14

Is Web Archiving the best tool for your project?

Yes No

Collection of websites around the same topic

One or only a few sites

Content on websites is not prohibitively large

Website is over 10 GB

Information is available without having to login

Facebook, Twitter and other social media

Content falls within fair use

Content has copyright issues

Wednesday, October 15, 14

The Web Archiving Research Guide helps UCLA Librarians, Faculty and Students to create Web Archiving projects in a step-by-step process:

• Develop a collection plan for your project

• Capture relevant websites

• Evaluate the captured content

• Describe the archived websites

• Publish the captured content

Wednesday, October 15, 14

Step 1A UCLA faculty member, student or librarian is

interested in doing a web archiving project.

Wednesday, October 15, 14

Step 2Make sure WAS is the best option

Yes No

Collection of websites around the same theme

One or only a few sites

Content on websites is not prohibitively large

Website is over 10 GB

Information is available without having to login

Facebook, Twitter and other social media

Content falls within fair use

Content has copyright issues

Wednesday, October 15, 14

Step 3The faculty member or student and responsible librarian meet with OM

to work on the WAS Collection Plan Form.

Wednesday, October 15, 14

Step 4The Collection Plan form is sent to Angela Riggio (who serves as WAS

Administrator for UCLA).

Step 5The WAS project is set up with a Project

Administrator (which can be a faculty member, student or librarian).

Wednesday, October 15, 14

Step 6The Project Administrator receives training from OM

and runs test captures for the WAS project.

Wednesday, October 15, 14

Step 7The Project Administrator and OM

go over the test captures.

Wednesday, October 15, 14

Step 8The Project Administrator captures the

other websites with assistance from OM.

Wednesday, October 15, 14

Step 9The Project

Administrator evaluates the captures (and

provides metadata).

Wednesday, October 15, 14

Step 10The archived websites are published online

on WAS after an embargo of 6 months.

Wednesday, October 15, 14

Workflow chart

Wednesday, October 15, 14

Questions?

Wednesday, October 15, 14

Wednesday, October 15, 14