Click here to load reader

リアルタイムPoint cloudデータのビジュアライゼーションについて

Embed Size (px)

Citation preview

GISWEB

PointCloudIISA2015

1

()DIY

Twitter@wayama_ryousuke

DFID - CC BY 3.0https://www.flickr.com/photos/dfid/16691214064

https://ja.wikipedia.org/wiki/%E3%83%88%E3%83%A2%E3%83%80%E3%83%81%E4%BD%9C%E6%88%A6https://ja.wikipedia.org/wiki/%E6%9D%B1%E6%97%A5%E6%9C%AC%E5%A4%A7%E9%9C%87%E7%81%BDhttp://www.fdma.go.jp/neuter/topics/kyukyu_kyujyo_kokusaikyouryoku/symposium14.pdf

https://en.wikipedia.org/wiki/Parrot_AR.Drone#/media/File:2_Parrot_AR.Drone_2.0_in_flight.jpg

https://en.wikipedia.org/wiki/File:AR.Drone_2.0_flying_over_suburd_in_Avignon,_France.jpg

1.WiFi

2.GPSEXIFSfM

3.LiDAR

4.GPS

WiFiVGAHD VGA

LTEWiFiASCIIFPV()

SDRAWSDKWiFi0.03mDEM

USBnVIDIAtk1PCRS232CGPIO

v-SLAM visual SLAM LSD-SLAMORB-SLAMSVOPTAMPTAM LiDAR-1

https://www.youtube.com/watch?v=GnuQzP3gty4LSD-SLAMORB-SLAMSVOPTAM

https://www.youtube.com/watch?t=142&v=Y9HMn6bd-v8https://www.youtube.com/watch?v=2YnIMfw6bJY

https://www.youtube.com/watch?v=8DISRmsO2YQ

SfMStructure from MotionDEMAgisoftPhotoScanWEBPix4DVisualSfMOpenMVGOpenSfMv-SLAM-2

https://www.flickr.com/photos/crschmidt/15260888506/PhotoScanPro

Pix4Dhttps://pix4d.com/

VisualSfMhttp://ccwu.me/vsfm/

OpenMVG

OpenSfMhttps://github.com/mapillary/OpenSfMhttps://github.com/openMVG/openMVG/

SfMDOpenDroneMap-3

GPSEXIFGPSGCP -4http://www.lancaster.ac.uk/staff/jamesm/software/sfm_georef.htm

http://grass.osgeo.org/grass70/manuals/addons/v.ply.rectify.html

GeoTIFFQGISGISGCP

-1

http://www.gsi.go.jp/gazochosa/gazochosa40001.html

DEM-2http://www.gsi.go.jp/gyoumu/gyoumu41000.html

3DSfM3D3Dcesium-http://betaserver.icgc.cat/cesium/Girona3D.html

http://www.google.com/url?q=http%3A%2F%2Fwww.3dcitydb.net%2F3dcitydb%2Ffileadmin%2F3DWebClient%2Findex.html&sa=D&sntz=1&usg=AFQjCNHsudbJnq9rcLt8kFaipqTaHBd5EA

3D3D

SfMv-SLAM LiDAR3-http://subspace.nicta.com.au/#publicDemos

https://www.youtube.com/watch?v=r9LegSK6MfU

Cesium

Google Earth

https://www.google.co.jp/intl/ja/earth/

Bing Mapshttp://apps.microsoft.com/windows/en-us/app/bing-maps-preview/75ce2a6a-8a25-4916-83d0-19b8e7b60787

Cesium

https://cesiumjs.org/Cesium/Apps/HelloWorld.html

CesiumWeb3D2DJavaScriptWebGLGoogle EarthCesium

https://cesiumjs.org/index.htmlhttps://cesiumjs.org/Cesium/Apps/Sandcastle/index.html

Google EarthWEBChrome

Google EarthCesiumUI

WebGL

WebSocketWebRTCHTML5

KMLGeoJSONCesium

VRLeapmotion

Cesium

http://cesiumjs.org/plugins/index.html

Cesium

61v1.10v1.2subspace

v1.9 subspace v1.2

SfMv-SLAM3Dcesium

PLY+Point3DobjCOLLADAMeshLabglTF(Cesium1.10)Cesium3D

http://www.cs.cornell.edu/~snavely/bundler/

http://meshlab.sourceforge.net/SfMMeshLab

CesiumPictures

3SfMv-SLAM

SfMIN:OUT:v-SLAMIN:OUT:

SfMSLAM

DEM3DCUDA174608x3455GPUCPUCore-i5 3.4Ghz32GBOpenDroneMapGPUSfMGPUnVIDIAtk1SfM-1http://queue.acm.org/detail.cfm?id=2206309

http://www.nvidia.co.jp/object/jetson-tk1-first-mobile-supercomputing-embedded-20140326-jp.htmlnVIDIA tk1

AgisoftPhotoScan ProEXIFSfM-2http://www.agisoft.com/pdf/PS_1.1%20-Tutorial%20(BL)%20-%20Orthophoto,%20DEM%20(without%20GCP).pdf

VisualSfMGCPEXIFEXIFSfM-3

http://ccwu.me/vsfm/

OpenDroneMapPMVSCMVSBundlerOpenMVGOpenSfMMicmacSfM-4https://github.com/OpenDroneMap/OpenDroneMaphttp://www.cs.cornell.edu/~snavely/bundler/

https://github.com/openMVG/openMVG/https://github.com/mapillary/OpenSfMhttp://logiciels.ign.fr/?Telechargement,20PMVSOpenDroneMapCMVS

Bundler

OpenMVG

OpenSfM

Micmac

OpenDroneMap3DGCPSfM-5https://github.com/OpenDroneMap/OpenDroneMaphttps://smathermather.wordpress.com/category/3d/opendronemap-3d/

SfMGCP

GCPEXIFGPS

SfM-6

SfM-7OpenDroneMap

Fig.1

Fig.2Fig.3

SfM-8OpenDroneMapFig.Fig.

SfM-9OpenSfM

Fig.1Fig.2

SfMGCPEXIFGPSPLY+GCP+Grass GISGCPSfM

EXIFOpenDroneMap/run.plOpenDroneMap

3D

3DobjcesiumMeshlabCOLLADAcesiumglTFcesium3DSfMCesium-OpenDroneMap

EXIFimagesconfig.yaml OpenSfM/bin/run_all

testData/ config.yaml images/ img_00.jpg img_01.jpg img_02.jpg img_03.jpg img_04.jpg img_05.jpg

OpenSfM/bin/run_all testData

JSONECEF()ECEF

PlyPythonCesiumSfMCesium-OpenSfM

()XMLXML

Micmac UAS_test.sh-----------------------------------------------#!/bin/sh

BIN_DIR=$1CHANT_DIR=$2${BIN_DIR}mm3d OriConvert OriTxtInFile GPS_WPK_Grand-Leez.csv Nav-Brut-RTL [email protected] MTD1=1 NameCple=FileImagesNeighbour.xml CalcV=1 ImC=R0040536.JPG NbImC=25${BIN_DIR}mm3d Tapioca File FileImagesNeighbour.xml -1${BIN_DIR}mm3d Tapas RadialBasic "R0040536.JPG|R0040537.JPG|R0040535.JPG|R0040578.JPG|R0040498.JPG|R0040499.JPG|R0040579.JPG|R0040538.JPG|R0040577.JPG|R0040534.JPG|R0040497.JPG|R0040500.JPG|R0040580.JPG|R0040456.JPG|R0040616.JPG|R0040576.JPG|R0040496.JPG|R0040617.JPG|R0040455.JPG|R0040457.JPG|R0040615.JPG|R0040539.JPG|R0040501.JPG|R0040581.JPG|R0040533.JPG" Out=Sample4Calib-Rel${BIN_DIR}mm3d AperiCloud "R0040536.JPG|R0040537.JPG|R0040535.JPG|R0040578.JPG|R0040498.JPG|R0040499.JPG|R0040579.JPG|R0040538.JPG|R0040577.JPG|R0040534.JPG|R0040497.JPG|R0040500.JPG|R0040580.JPG|R0040456.JPG|R0040616.JPG|R0040576.JPG|R0040496.JPG|R0040617.JPG|R0040455.JPG|R0040457.JPG|R0040615.JPG|R0040539.JPG|R0040501.JPG|R0040581.JPG|R0040533.JPG" Sample4Calib-Rel Out=Sample4Calib-Rel.ply${BIN_DIR}mm3d Tapas RadialBasic "R.*.JPG" Out=All-Rel InCal=Sample4Calib-Rel${BIN_DIR}mm3d CenterBascule "R.*.JPG" All-Rel Nav-Brut-RTL tmp CalcV=1${BIN_DIR}mm3d OriConvert OriTxtInFile GPS_WPK_Grand-Leez.csv Nav-adjusted-RTL [email protected] MTD1=1 Delay=-0.0854304${BIN_DIR}mm3d CenterBascule "R.*.JPG" All-Rel Nav-adjusted-RTL All-RTL${BIN_DIR}mm3d ChgSysCo "R.*JPG" All-RTL SysCoRTL.xml@SysCoBL72_EPSG31370.xml All-BL72${BIN_DIR}mm3d AperiCloud "R.*.JPG" All-BL72 Out=All-BL72-cam.ply WithPoints=0${BIN_DIR}mm3d Malt Ortho "R.*JPG" All-BL72 DirMEC=MEC DefCor=0 AffineLast=1 Regul=0.005 HrOr=0 LrOr=0 ZoomF=1${BIN_DIR}mm3d to8Bits MEC/Z_Num8_DeZoom1_STD-MALT.tif${BIN_DIR}mm3d Nuage2Ply "MEC/NuageImProf_STD-MALT_Etape_8.xml" Scale=8 Attr="MEC/Z_Num8_DeZoom1_STD-MALT_8Bits.tif" Out=CanopySurfaceModel.ply-----------------------------------------------

./UAS_test.sh micmac/bin

PDF350SfMCesium- Micmac

LSD-SLAMv-SLAM-1http://vision.in.tum.de/research/lsdslam?redirect=1

ORB-SLAMTIPSLSD-SLAMv-SLAM-

http://webdiis.unizar.es/~raulmur/orbslam/

LSD-SLAMv-SLAM-

http://wiki.ros.org/camera_calibration/Tutorials/MonocularCalibration

LSD-SLAM

v-SLAM-https://www.flickr.com/photos/sorenragsdale/3192314056

ply5

GBplyLSD-SLAM

https://www.youtube.com/watch?v=3LIGvCTPJtM

SfM

GPS

LSDSLAMORBSLAM

ar-droneVGA30fpsQVGA

120VGA30~60fps

wifiwifiLSDSLAMChainerDQNDeep Q-Network

http://research.preferred.jp/2015/06/distributed-deep-reinforcement-learning/https://www.youtube.com/watch?v=a3AWpeOjkzw

PFIChainerDQNDeep Q-Network

https://www.youtube.com/watch?v=2JYFSiWDV-40719

cesiumOculus+LeapMotion+PointCloud3D-1

cesiumNetCDF3D-2NetCDFCesium

http://cesiumjs.org/demos/GridViz.html

[email protected]