Upload
jean-paul-calbimonte
View
254
Download
1
Embed Size (px)
DESCRIPTION
Citation preview
-
© Copyright 2013OpenIoT Consortium
EU OpenIoT ProjectFP7 ICT-2011 1.3: Internet-connected Objects
Open Source blueprint for largescale self-organizing cloud
environments for IoT applications
OpenIoT X-GSN
OpenIoT Summer School, Galway, August 5, 2014
Jean-Paul CalbimonteEPFL, Switzerland
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 2
Outline
• Why GSN• Global Sensor Networks in a nutshell
– Virtual Sensors– Wrappers– Processing classes– Distributed processing– Storage– Services
• X-GSN in OpenIoT– Semantics– Sensor & Observation annotations– Linked Sensor Middleware
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 3
Sensor deployments everywhere
MountainsGlaciersSnow regionsSea CoastalAgriculture…
DIYMobileParticipatory
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 4
We want the data
• Open data repositories• Accessible research datasets• Discoverability• Reuse datasets• Metadata access
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 5
Sensor Networks and the Web
5
Sensor Networks
users
applicationsdata
streams
Volume
VelocityVariety WEB
Universal Web-based access to Sensor data
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 6
Motivation
6
from Sensor Networks
to the Sensor Web
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 7
GSN: Global Sensor Networks
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 8
GSN: Global Sensor Networks
Help managing sensor datasets
Help publishing the data
Help making the data discoverable and reusable
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 9
GSN: things to know
GSN
GSN exposes Virtual Sensors
Sensing Device
temp_vstimed: datetimetemperature: float
Virtual Sensor
GSN
Sensing Device
temp_vstimed: datetimetemperature: float
Virtual SensorAggregate, process, fusion
A virtual sensor, any kind of data producer
a real sensor, a wireless camera, a desktop computer, GPS sensor, network traffic, etc.
combination of other virtual sensors.Logical view of the sensor network.Described in an XML file
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 10
Virtual Sensor Config
<virtual-sensor name="testsensor_1" priority="10" > <processing-class> <class-name>org.openiot.gsn.vsensor.LSMExporter</class-name> <output-structure> <field name="noise" type="double" /> </output-structure> </processing-class> <description>sensorscope station</description> <life-cycle pool-size="10"/> <streams> <stream name="input1"> … <query>select timed, noise as noise from source1</query> </stream> </streams></virtual-sensor>
Virtual sensor name
Streams & wrappers
data fields
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 11
GSN: things to know
GSN
Virtual Sensors get the data through wrappers
wra
pper
Examples:•HTTP generic wrapper•Serial forwarder wrapper•USB camera wrapper•RFID wrapper•WiseNode wrapper•Generic UDP wrapper•Generic serial/bluetooth wrapper•CSV wrapper
Or implement your own wrapper:
50RFID reader (TI)
50Generic HTTP
300Wired camera
180Generic serial
45Generic UDP
75WiseNode
160TinyOS
Lines of codeWrapper type
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 12
Wrapper config
<address wrapper="csv"> <predicate key="file">data/station_1061.csv</predicate> <predicate key="fields">timed, noise</predicate> <predicate key="formats">timestamp(d/M/y H:m), numeric</predicate> <predicate key="bad-values">NaN,6999,-6999,null</predicate> <predicate key="timezone">Etc/GMT-2</predicate> <predicate key="sampling">5000</predicate> <predicate key="check-point-directory">csv-check-points</predicate></address>
Wrapper typeFile location
Fields
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 13
GSN: things to know
GSN
Virtual Sensors produce streams of data
Streams are processed on the fly by a Processing Class
Data ProcessingFilteringAggregationOutlier detectionStoringPublishingExpensive processing.Archiving
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 14
GSN: things to know
• GSN works in a distributed fashion– Data can be kept locally– Break data silos
• Put sensor data on the web
14
GSN nodes
Remote wrappers can get data from another GSN instance
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 15
GSN Distributed Deployment
15
Integrity ServiceAccess Control
GSN/Web/Web-ServicesNotification Manager
Query ProcessorQuery RepositoryStorage Manager
Virtual Sensor ManagerInput Stream Manager
Stream Quality ManagerLife Cycle Manager
Pool Of Sensing Devices
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 16
Motivation
16
from Sensor Networks
to the Sensor Web
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 17
Heterogeneity problems
17
Discoverability
Heterogeneity
Metadata quality
Integration
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 18
Querying the semantic sensor Web
18
e.g. publish sensor data as RDF/Linked Data?
URIs as names of thingsHTTP URIs
useful information when URI is dereferenced
Link to other URIs
users
applications
WEB
Use ontology models to continuously query real-time data streams originated from sensors?
static vs. streams
one-off vs. continuous
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 19
The OpenIoT Architecture
Sensor data management
Semantic data
management
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 20
We need ontologies!
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 21
We need ontologies!
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 22
X-GSN Sensor annotation
sensorName=opensense_1sourceType=lausannesensorType=lausanneinformation=Air Quality Sensors from Lausanne station 1author=opensensefeature="http://lsm.deri.ie/OpenIoT/opensensefeature"fields="humidity,temperature"field.temperature.propertyName="http://lsm.deri.ie/OpenIoT/Temperature"field.temperature.unit=Cfield.humidity.propertyName="http://lsm.deri.ie/OpenIoT/Humidity"field.humidity.unit=Percentlatitude=46.529838longitude=6.596818
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 23
X-GSN Observation annotations
Open Source blueprint for large scale self-organizingcloud environments for IoT applications
© Copyright 2013OpenIoT Consortium 24
Motivation
24
from Sensor Networks
to the Sensor Web
and the Semantic Sensor Web
-
© Copyright 2013OpenIoT Consortium
EU OpenIoT ProjectFP7 ICT-2011 1.3: Internet-connected Objects
Open Source blueprint for largescale self-organizing cloud
environments for IoT applications
OpenIoT X-GSN
OpenIoT Summer School, Galway, August 5, 2014
Jean-Paul CalbimonteEPFL, Switzerland