mantas zimnickas - how open is lithuanian government data? atviriduomenys.lt
TRANSCRIPT
![Page 1: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/1.jpg)
Mantas Zimnickas
atviriduomenys.lt
OpenCon 2016 Lithuania
![Page 2: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/2.jpg)
What is open?
“Open means anyone can freely access, use, modify, and share for any purpose.”
– opendefinition.org
![Page 3: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/3.jpg)
What is open data?
5stardata.info
![Page 4: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/4.jpg)
Open data status in Lithuania
http://ivpk.lrv.lt/lt/ivpk-leidiniai/atliktas-galimybiu-tyrimas-skirtas-apibrezti-atviru-duomenu-iniciatyvos-igyvendinimo-lietuvoje-architekturos-modeli
![Page 5: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/5.jpg)
What atviriduomenys.lt is about?
Dataproviders Data Projects
provides are used by
needsimportance
Users
likes
are used by
atviriduomenys.lt
![Page 6: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/6.jpg)
Data packages
CSV/JSON RDF/DCAT
'2016-11-12' "2016-11-12"^^xsd:date
Datapackage
date(2016, 11, 12)
frictionlessdata.io/data-packages/
![Page 7: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/7.jpg)
HTML data to download first page
extract links
download all links
extract data
transform data
with index.download('http://opendata.gov.lt/'):
with urls.select('table td[3] a@href'):
with pages.download():
with raw_data.select(row.key, [ 'table xpath:tr[count(td)=2]', ('td[1]:content', 'td[2]:content'), ]):
data.call( lambda x: (x.key, dict(x.value)) )
data.export('opendatgovlt.csv')export data
atviriduomenys.lt/data
![Page 8: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/8.jpg)
Data to
Rawvalues
UniformResourceIdentifier
LRS
ld:orgs/gov/42
Canonicalobject
registry
LietuvosRespublikos
SeimasSeimas
LR Seimas
Aliases andtemplates
Lietuvos Respublikos {name} LR{name|abbr} {name} LR {name}
https://github.com/sirex/databot-bots/tree/master/index
![Page 9: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/9.jpg)
Technology moves forwardpeople don’t
225 yearslater
![Page 10: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/10.jpg)
A4 paper data format
Writes onA4 paper
ReadsA4 paper
![Page 11: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/11.jpg)
In a perfect world...
Createsontologies
Createstemplates
Fills intemplateswith data
HTMLrepresentation
Printingon paper
Smartphoneapp
Single source
publishing
WYSIW
YM
Context
![Page 12: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/12.jpg)
Real world examples
AbbyeFormFiller
Akoma Ntoso(LegalDocML)
LegisProBy Xcential
Word processortemplates with
fields
![Page 13: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/13.jpg)
Text data to
Textstream
Patternrecognition
engineTemplates Data
Field: value N-gram magic Field: {value} {'Field': 'value'}
automatization
![Page 14: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/14.jpg)
Text data to
Textsamples
Training Data
big trees machine learning forest
NLP
a tree
![Page 15: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/15.jpg)
Manuscript to
epaveldas.lt
![Page 16: Mantas Zimnickas - How Open is Lithuanian Government data? atviriduomenys.lt](https://reader033.vdocuments.net/reader033/viewer/2022052915/58ce718b1a28abdc578b5897/html5/thumbnails/16.jpg)
Thank you!
● https://github.com/sirex/atviriduomenys.lt● https://github.com/sirex/databot/● https://github.com/sirex/databot-bots● https://github.com/sirex/gramtool● https://bitbucket.org/sirex/morfologija● https://github.com/frictionlessdata/
Source code of atviriduomenys.lt and related projects: