open source: parliamentary search · open source: parliamentary search steve wise house of commons...
TRANSCRIPT
![Page 1: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/1.jpg)
Open Source: Parliamentary Search
Steve WiseHouse of Commons Library
![Page 2: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/2.jpg)
Parliamentary Search: What is it?
• POLIS (1980-2005) PIMS (2005-2012) Core Parliamentary Information Management Framework Programme (CPIMF, 2012-)
• OWLIM Triple Store & RDF – procedural data repository
• Indexing – librarians, indexers & taxonomy experts
• Bespoke indexing tool, Smartlogic taxonomy/thesaurus manager
• Procedural application Indexing Parly Search
• Parly Search = Lucene / Solr + Ontology Manager
• Why Lucene / Solr?
– we were already using it for something else!
![Page 3: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/3.jpg)
Digression: What is RDF?
• Resource Description Framework
• Linked data standard
• Describes data using subject, object & predicate
• Example: Steve’s email is [email protected]
– Subject = Steve
– Predicate = ‘has email address’
– Object = [email protected]
– 3 components, so called a ‘triple’
• Semantic query language - SPARQL
![Page 4: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/4.jpg)
Parly Search: What does it look like?
![Page 5: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/5.jpg)
![Page 6: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/6.jpg)
![Page 7: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/7.jpg)
![Page 8: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/8.jpg)
![Page 9: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/9.jpg)
![Page 10: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/10.jpg)
![Page 11: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/11.jpg)
![Page 12: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/12.jpg)
![Page 13: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/13.jpg)
Advantages of Lucene Solr for Parly Search
• Implemented on Parliament’s website – experience
• Simple to set up a development version / test-bed
• Lots of other users – readily available skill in marketplace
• Plenty of resources available to train developers/support staff
• Search algorithm: able to control, easy to modify, able to plug in our own taxonomies as facets
• Not as processor/server/memory-hungry as previous search engine
• Functional, flexibile and fast
• Reliable
![Page 14: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/14.jpg)
Some links:
• Public beta version of Parliamentary Search
– http://search-material.parliament.uk/
• Information on Apache Lucene /Solr
– http://lucene.apache.org/solr/
– https://en.wikipedia.org/wiki/Apache_Solr
• Information on Smartlogic Semaphore/Ontology Editor
– https://www.smartlogic.com/products
![Page 16: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/16.jpg)
Some other search examples:
![Page 17: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/17.jpg)
Some other search examples:
![Page 18: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/18.jpg)
![Page 19: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/19.jpg)
![Page 20: Open Source: Parliamentary Search · Open Source: Parliamentary Search Steve Wise House of Commons Library. Parliamentary Search: What is it? • POLIS (1980-2005) PIMS (2005-2012)](https://reader034.vdocuments.net/reader034/viewer/2022050209/5f5b86cca3e2621c7f0452bb/html5/thumbnails/20.jpg)