open refine: clean your messy data
DESCRIPTION
Open Refine: Clean your messy data. Valrie Minson Outreach Librarian for Agricultural Sciences. OpenRefine. OpenRefine.org ( Google Refine) Open Source Runs locally on computer (privacy) Looks like Excel or Google Spreadsheets Data: clean it, transform it, extend it !. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/1.jpg)
MSL
George A. Smathers Libraries
Marston Science Library
OPEN REFINE:CLEAN YOUR MESSY DATA
Valrie Minson
Outreach Librarian for Agricultural Sciences
![Page 2: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/2.jpg)
MSL
OpenRefine OpenRefine.org (Google Refine) Open Source Runs locally on computer (privacy) Looks like Excel or Google
Spreadsheets Data: clean it, transform it, extend it!
![Page 3: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/3.jpg)
MSL
Excel: my messy data
![Page 4: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/4.jpg)
MSL
Data issues Human/free-text errors Inconsistent journal titles Redundant citations Data (volume/issue) in wrong fields ARTICLES IN CAPS LOCK
![Page 5: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/5.jpg)
MSL
Data in Open Refine
![Page 6: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/6.jpg)
MSL
Use filters to edit data
![Page 7: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/7.jpg)
MSL
Faceted: journal titles by count
![Page 8: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/8.jpg)
MSL
![Page 9: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/9.jpg)
MSL
Filtering/faceting Use filters or facets to select subsets
of data Journal of Agriculture Journ of Agriculture Journla of Agriculture Agriculture, Journal of
Not just for Messy data
![Page 10: Open Refine: Clean your messy data](https://reader035.vdocuments.net/reader035/viewer/2022062305/56815f3a550346895dce0862/html5/thumbnails/10.jpg)
MSL
OpenRefine Expression Language (GREL)
Transform list into table (create columns)
Merge datasets Export into Excel, CSV, OpenOffice,
Google Spreadsheets, JSON, RDF, etc.
Use with other systems (Excel, SPSS, etc.)
Great videos