dynamic semantics for the internet of...
TRANSCRIPT
![Page 1: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/1.jpg)
Dynamic Semantics for the Internet of Things
1
Payam Barnaghi Institute for Communication Systems (ICS) University of Surrey Guildford, United Kingdom
![Page 2: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/2.jpg)
2
Things, Devices, Data, and lots of it
image courtesy: Smarter Data - I.03_C by Gwen Vanhee
![Page 3: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/3.jpg)
Data in the IoT
− Data is collected by sensory devices and also crowd sensing sources.
− It is time and location dependent. − It can be noisy and the quality can vary. − It is often continuous - streaming data.
− There are other important issues such as: − Device/network management − Actuation and feedback (command and control)
− Service and entity descriptions are also important.
![Page 4: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/4.jpg)
Internet of Things: The story so far
RFID based solutions
Wireless Sensor and Actuator networks
, solutions for communication
technologies, energy efficiency, routing, …
Smart Devices/ Web-enabled Apps/
Services, initial products, vertical applications, early concepts and demos, …
Motion sensor
Motion sensor
ECG sensor
Physical-Cyber-Social Systems, Linked-data,
semantics, M2M, More products, more
heterogeneity, solutions for control and
monitoring, …
Future: Cloud, Big (IoT) Data Analytics, Interoperability,
Enhanced Cellular/Wireless Com. for IoT, Real-world operational
use-cases and Industry and B2B services/applications,
more Standards…
![Page 5: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/5.jpg)
Scale of the problem
5
Things Data
Devices
2.5 quintillion bytes per day
Billions and Billions of them…
Estimated 50 Billion by 2020
![Page 6: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/6.jpg)
Heterogeneity, multi-modality and volume are among the key issues. We need interoperable and machine-interpretable solutions…
6
![Page 7: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/7.jpg)
Human Brain and (Sensory) Big Data
− Collecting the data is done by human senses but encoding and retrieving it is a bigger challenge.
− The two key properties of the human brain and its design are Richness and Associative Access*.
− Associative access enables us to access our thoughts in different ways by semantic or perceptual associations.
− Brian can process these data and provide actionable-knowledge.
7
Image source: Wikipedia
* The organised Mind, Daniel J. Levitin, Penguin Books.
![Page 8: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/8.jpg)
IoT and and (Sensory) Big Data
− Collecting data is not the most difficult challenge (of course we still need better devices, more energy efficient devices/way of collecting data, intelligent networks and better telecom)
− The biggest challenge is to organise and access/retrieve data more efficiently and by using different (high-level) associations.
− We need to integrate different sources and process/analyse them to extract actionable-information from the raw data.
− Semantic technologies and rich metadata seem to be the way forward.
8
![Page 9: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/9.jpg)
9
But why don’t we still have fully integrated semantic solutions in the IoT?
![Page 10: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/10.jpg)
10
Some good existing models: SSN Ontology
Ontology Link: http://www.w3.org/2005/Incubator/ssn/ssnx/ssn
M. Compton et al, "The SSN Ontology of the W3C Semantic Sensor Network Incubator Group", Journal of Web Semantics, 2012.
![Page 11: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/11.jpg)
Several ontologies and description models
11
![Page 12: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/12.jpg)
12
We have good models and description frameworks; The problem is that having good models and developing ontologies is not enough.
![Page 13: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/13.jpg)
13
Semantic descriptions are intermediary solutions, not the end product. They should be transparent to the end-user and probably to the data producer as well.
![Page 14: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/14.jpg)
A WoT/IoT Framework
WSN
WSN
WSN
WSN
WSN
Network-enabled Devices
Semantically annotate data
14
Gateway CoAP
HTTP
CoAP
CoAP
HTTP
6LowPAN
Semantically annotate data
http://mynet1/snodeA23/readTemp?
WSN
MQTT
MQTT
Gateway
And several other protocols and solutions…
![Page 15: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/15.jpg)
Publishing Semantic annotations
− We need a model (ontology) – this is often the easy part for a single application.
− Interoperability between the models is a big issue. − Express-ability vs Complexity is a challenge.
− How and where to add the semantics − Where to publish and store them − Semantic descriptions for data, streams, devices
(resources) and entities that are represented by the devices, and description of the services.
15
![Page 16: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/16.jpg)
16
Simplicity can be very useful…
![Page 17: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/17.jpg)
Hyper/CAT
17 Source: Toby Jaffey, HyperCat Consortium, http://www.hypercat.io/standard.html
- Servers provide catalogues of resources to clients. - A catalogue is an array of URIs.
- Each resource in the catalogue is annotated with metadata (RDF-like triples).
![Page 18: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/18.jpg)
Hyper/CAT model
18 Source: Toby Jaffey, HyperCat Consortium, http://www.hypercat.io/standard.html
![Page 19: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/19.jpg)
19
Complex models are (sometimes) good for publishing research papers…. But they are often difficult to implement and use in real world products.
![Page 20: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/20.jpg)
What happens afterwards is more important
− How to index and query the annotated data − How to make the publication suitable for constrained
environments and/or allow them to scale − How to query them (considering the fact that here we are
dealing with live data and often reducing the processing time and latency is crucial)
− Linking to other sources
20
![Page 21: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/21.jpg)
The IoT is a dynamic, online and rapidly changing world
21
isPartOf
Annotation for the (Semantic) Web
Annotation for the IoT
Image sources: ABC Australia and 2dolphins.com
![Page 22: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/22.jpg)
Tools and APIs
22 http://iot3.ee.surrey.ac.uk/s2w/
![Page 23: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/23.jpg)
23
Creating common vocabularies and taxonomies are also equally important e.g. event taxonomies.
![Page 24: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/24.jpg)
24
We should accept the fact that sometimes we do not need (full) semantic descriptions. Think of the applications and use-cases before starting to annotate the data.
![Page 25: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/25.jpg)
An example: a discovery method in the IoT
time
location
type
Query formulating
[#location | #type | time]
Discovery ID
Discovery/ DHT Server
Data repository (archived data)
#location #type
#location #type
#location #type
Data hypercube
Gateway
Core network
Network Connection
Logical Connection
Data
![Page 26: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/26.jpg)
An example: a discovery method in the IoT
26 S. A. Hoseinitabatabaei, P. Barnaghi, C. Wang, R. Tafazolli, L. Dong, "A Distributed Data Discovery Mechanism for the Internet of Things", 2014.
![Page 27: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/27.jpg)
An example: a discovery method in the IoT
27 S. A. Hoseinitabatabaei, P. Barnaghi, C. Wang, R. Tafazolli, L. Dong, "A Distributed Data Discovery Mechanism for the Internet of Things", 2014.
![Page 28: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/28.jpg)
28
Semantic descriptions can be fairly static on the Web; In the IoT, the meaning of data and the annotations can change over time/space…
![Page 29: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/29.jpg)
Static Semantics
29
![Page 30: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/30.jpg)
Dynamic Semantics
<iot:measurement> <iot:type> temp</iot:type> <iot:unit>Celsius</iot:unit> <time>12:30:23UTC</time> <iot:accuracy>80%</iot:accuracy> <loc:long>51.2365<loc:lat> <loc:lat>0.5703</loc:lat> </iot:measurment>
30
But this could be a function of time and location;
What would be the
accuracy 5 seconds after the measurement?
![Page 31: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/31.jpg)
Dynamic annotations for data in the process chain
31 S. Kolozali et al, A Knowledge-based Approach for Real-Time IoT Data Stream Annotation and Processing", iThings 2014, 2014.
![Page 32: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/32.jpg)
Overall, we need semantic technologies in the IoT and these play a key role in providing interoperability.
![Page 33: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/33.jpg)
However, we should design and use the semantics carefully and consider the constraints and dynamicity of the IoT environments.
![Page 34: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/34.jpg)
The IoT
WSN
WSN
WSN
WSN
WSN
Network-enabled Devices
Network-enabled Devices
Network services/storage and
processing units Data/service access at application level
Data collections and processing within the
networks
Query/access to raw data
Or Higher-level abstractions
MW
MW
MW Data streams
![Page 35: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/35.jpg)
#1: Design for large-scale and provide tools and APIs. #2: Think of who will use the semantics and how when you design your models. #3: Provide means to update and change the semantic annotations.
35
![Page 36: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/36.jpg)
#4: Create tools for validation and interoperability testing. #5: Create taxonomies and vocabularies. #6: Of course you can always create a better model, but try to re-use existing ones as much as you can.
36
![Page 37: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/37.jpg)
#7: Link your data and descriptions to other existing resources. #8: Define rules and/or best practices for providing the values for each attribute. #9: Remember the widely used semantic descriptions on the Web are simple ones like FOAF.
37
![Page 38: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/38.jpg)
#10: Semantics are only one part of the solution and often not the end-product so the focus of the design should be on creating effective methods, tools and APIs to handle and process the semantics. Query methods, machine learning, reasoning and data analysis techniques and methods should be able to effectively use these semantics.
38
In Conclusion
![Page 39: Dynamic Semantics for the Internet of Thingsontolog.cim3.net/file/work/OntologySummit2015/2015... · Internet of Things: The story so far RFID based solutions Wireless Sensor and](https://reader034.vdocuments.net/reader034/viewer/2022051606/601dbe071b9f113bb1618618/html5/thumbnails/39.jpg)
Q&A
− Thank you.
− EU FP7 CityPulse Project:
http://www.ict-citypulse.eu/
@pbarnaghi
http://personal.ee.surrey.ac.uk/Personal/P.Barnaghi/