25
- © Copyright 2013 OpenIoT Consortium EU OpenIoT Project FP7 ICT-2011 1.3: Internet-connected Objects Open Source blueprint for large scale self-organizing cloud environments for IoT applications OpenIoT X-GSN OpenIoT Summer School, Galway, August 5, 2014 Jean-Paul Calbimonte EPFL, Switzerland

X-GSN in OpenIoT SummerSchool

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: X-GSN in OpenIoT SummerSchool

-

© Copyright 2013OpenIoT Consortium

EU OpenIoT ProjectFP7 ICT-2011 1.3: Internet-connected Objects

Open Source blueprint for largescale self-organizing cloud

environments for IoT applications

OpenIoT X-GSN

OpenIoT Summer School, Galway, August 5, 2014

Jean-Paul CalbimonteEPFL, Switzerland

Page 2: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 2

Outline

• Why GSN• Global Sensor Networks in a nutshell

– Virtual Sensors– Wrappers– Processing classes– Distributed processing– Storage– Services

• X-GSN in OpenIoT– Semantics– Sensor & Observation annotations– Linked Sensor Middleware

Page 3: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 3

Sensor deployments everywhere

MountainsGlaciersSnow regionsSea CoastalAgriculture…

DIYMobileParticipatory

Page 4: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 4

We want the data

• Open data repositories• Accessible research datasets• Discoverability• Reuse datasets• Metadata access

Page 5: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 5

Sensor Networks and the Web

5

Sensor Networks

users

applicationsdata

streams

Volume

VelocityVariety WEB

Universal Web-based access to Sensor data

Page 6: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 6

Motivation

6

from Sensor Networks

to the Sensor Web

Page 7: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 7

GSN: Global Sensor Networks

Page 8: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 8

GSN: Global Sensor Networks

Help managing sensor datasets

Help publishing the data

Help making the data discoverable and reusable

Page 9: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 9

GSN: things to know

GSN

GSN exposes Virtual Sensors

Sensing Device

temp_vstimed: datetimetemperature: float

Virtual Sensor

GSN

Sensing Device

temp_vstimed: datetimetemperature: float

Virtual SensorAggregate, process, fusion

A virtual sensor, any kind of data producer

a real sensor, a wireless camera, a desktop computer, GPS sensor, network traffic, etc.

combination of other virtual sensors.Logical view of the sensor network.Described in an XML file

Page 10: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 10

Virtual Sensor Config

<virtual-sensor name="testsensor_1" priority="10" > <processing-class> <class-name>org.openiot.gsn.vsensor.LSMExporter</class-name> <output-structure> <field name="noise" type="double" /> </output-structure> </processing-class> <description>sensorscope station</description> <life-cycle pool-size="10"/> <streams> <stream name="input1"> … <query>select timed, noise as noise from source1</query> </stream> </streams></virtual-sensor>

Virtual sensor name

Streams & wrappers

data fields

Page 11: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 11

GSN: things to know

GSN

Virtual Sensors get the data through wrappers

wra

pper

Examples:•HTTP generic wrapper•Serial forwarder wrapper•USB camera wrapper•RFID wrapper•WiseNode wrapper•Generic UDP wrapper•Generic serial/bluetooth wrapper•CSV wrapper

Or implement your own wrapper:

50RFID reader (TI)

50Generic HTTP

300Wired camera

180Generic serial

45Generic UDP

75WiseNode

160TinyOS

Lines of codeWrapper type

Page 12: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 12

Wrapper config

<address wrapper="csv"> <predicate key="file">data/station_1061.csv</predicate> <predicate key="fields">timed, noise</predicate> <predicate key="formats">timestamp(d/M/y H:m), numeric</predicate> <predicate key="bad-values">NaN,6999,-6999,null</predicate> <predicate key="timezone">Etc/GMT-2</predicate> <predicate key="sampling">5000</predicate> <predicate key="check-point-directory">csv-check-points</predicate></address>

Wrapper typeFile location

Fields

Page 13: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 13

GSN: things to know

GSN

Virtual Sensors produce streams of data

Streams are processed on the fly by a Processing Class

Data ProcessingFilteringAggregationOutlier detectionStoringPublishingExpensive processing.Archiving

Page 14: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 14

GSN: things to know

• GSN works in a distributed fashion– Data can be kept locally– Break data silos

• Put sensor data on the web

14

GSN nodes

Remote wrappers can get data from another GSN instance

Page 15: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 15

GSN Distributed Deployment

15

Integrity ServiceAccess Control

GSN/Web/Web-ServicesNotification Manager

Query ProcessorQuery RepositoryStorage Manager

Virtual Sensor ManagerInput Stream Manager

Stream Quality ManagerLife Cycle Manager

Pool Of Sensing Devices

Page 16: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 16

Motivation

16

from Sensor Networks

to the Sensor Web

Page 17: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 17

Heterogeneity problems

17

Discoverability

Heterogeneity

Metadata quality

Integration

Page 18: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 18

Querying the semantic sensor Web

18

e.g. publish sensor data as RDF/Linked Data?

URIs as names of thingsHTTP URIs

useful information when URI is dereferenced

Link to other URIs

users

applications

WEB

Use ontology models to continuously query real-time data streams originated from sensors?

static vs. streams

one-off vs. continuous

Page 19: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 19

The OpenIoT Architecture

Sensor data management

Semantic data

management

Page 20: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 20

We need ontologies!

Page 21: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 21

We need ontologies!

Page 22: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 22

X-GSN Sensor annotation

sensorName=opensense_1sourceType=lausannesensorType=lausanneinformation=Air Quality Sensors from Lausanne station 1author=opensensefeature="http://lsm.deri.ie/OpenIoT/opensensefeature"fields="humidity,temperature"field.temperature.propertyName="http://lsm.deri.ie/OpenIoT/Temperature"field.temperature.unit=Cfield.humidity.propertyName="http://lsm.deri.ie/OpenIoT/Humidity"field.humidity.unit=Percentlatitude=46.529838longitude=6.596818

Page 23: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 23

X-GSN Observation annotations

Page 24: X-GSN in OpenIoT SummerSchool

Open Source blueprint for large scale self-organizingcloud environments for IoT applications

© Copyright 2013OpenIoT Consortium 24

Motivation

24

from Sensor Networks

to the Sensor Web

and the Semantic Sensor Web

Page 25: X-GSN in OpenIoT SummerSchool

-

© Copyright 2013OpenIoT Consortium

EU OpenIoT ProjectFP7 ICT-2011 1.3: Internet-connected Objects

Open Source blueprint for largescale self-organizing cloud

environments for IoT applications

OpenIoT X-GSN

OpenIoT Summer School, Galway, August 5, 2014

Jean-Paul CalbimonteEPFL, Switzerland