team bc 2017 politics - archives unleashed · team bc 2017 politics. what we learned. 1. that...
TRANSCRIPT
![Page 1: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/1.jpg)
Team BC 2017 Politics
![Page 2: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/2.jpg)
![Page 3: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/3.jpg)
![Page 4: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/4.jpg)
![Page 5: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/5.jpg)
![Page 6: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/6.jpg)
![Page 7: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/7.jpg)
What we learned
![Page 8: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/8.jpg)
1. that working with web archives is highly dependent on the quality of the data and the context and constraints with which it was collected.
![Page 9: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/9.jpg)
2. The framework is cool, but requires programming skillz (command-line comfort, which mean greater opportunities for digital training needed for humanities scholars.)
![Page 10: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/10.jpg)
3. You have to know how to create your own datasets or get ahold of WARC files. MOU Economy? How do we surface WARC files for this type of work?
![Page 11: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/11.jpg)
4. Need to link efforts among Canadian institutions, a community of web-archiving people, and archives unleashed can be hybrid community to bring Librarian/Archivist folks with the Historian folks.
![Page 12: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/12.jpg)
Problems
1. Crawler trap baggage (West Point Grey);
510255 URLS
510242 were 404s.
Out of those 13 that were “good” , only 7 were real information, the other 6 were redirects
![Page 13: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/13.jpg)
2. Topic Modeling: Noise in the data. Special Characters. (Null characters encoding)
![Page 14: Team BC 2017 Politics - Archives Unleashed · Team BC 2017 Politics. What we learned. 1. that working with web archives is highly dependent on the quality of the data ... apps f ebook.co](https://reader036.vdocuments.net/reader036/viewer/2022081402/5f0cafbe7e708231d436a284/html5/thumbnails/14.jpg)
With Ian and future historians in mind…Where's the measure of completeness, and how do you build that into the web archive?
Historian | Archivist | Librarian | Systems |