1. ochyai #ochyai IPAyoichi.ochiai@me.com

2. 2014 7 2007 1 3. 4. 5. 3D VRAR Physicalization of Computer Graphics 2 CG 3D 1987 09 6. Yoichi Ochiai Media Artist The University of Tokyo) 3D Acoustic Manipulation Technology Colloidal Display: BRDF Bubble Screen Real World Texture Transformation Pixie Dust: Graphical Levitation Also you can see my work in this years SIGGRAPH Art Gallery. Research Interest Dynamic physicalization of Computer Graphics What would happen? If the real world things had the characteristics like computer graphics model As an independent Media Artist SIGGRAPH 2014 SIGGRAPH 2012,2013,ACE 2013 Eurohaptics 2014 PLOS ONE SIGGRAPH 2014 Born 1987 in Tokyo. BA(Media Arts and Sciences) from University of Tsukuba, 2011 MA(Applied Computer Science) from University of Tokyo 2013. Entered PhD program, 2013. He is now under defense of his Ph.D Thesis. He is on the committee of Information Processing Society of Japan. He is interested in the eld of real world oriented computer graphics and new media art composed of mixture of new media and classic technologies. He was technical paper author of SIGGRAPH and selected artist of SIGGRAPH Art Gallery. He received the Super Creator Title from IPA and METI, Grand Prix of LAVAL VIRTUAL AWARD, Best paper Award from ACE, Springer, Student Innovation Contest Award in UIST, Best Demo Award from EUROHAPTICS, Japan Manifest Award and awarded in many competitions. His research projects were selected in the best of Siggraph 2014s technical papers(By CGCHANNEL) and the best research video 2012 (by NewScientist). He and his work was featured on BBC, Discovery channel, AP, Reuters, Dairy Mail, Daily Telegraph, France 2, Russia 1 and over 100 famous web/magazine/tv media. Speeches and Lectures in various colleges, museums, corporations and events(e.g. TED and local TED talks). at Microsoft Research 7. 1 8. Field Interface: Computational Fields exists between atom and bit. 9. Matter BC 13.8billion GUI 1963- Programable Matter 2000s- Computational Field Interface 2014- AR & TUI 1990s- 10. Radical AtomsProgramable Matter Computational Potential Field Concept Our Approach Self Actuation Interface Ishii et al. 2012Hawkes et al. 2010 Poupyrev et al. 2007 Self Actuated Environmental Actuation 11. For the first step to test our idea: implementation with CAPF 12. 12 13. our approach decompose the components BRDF swich these states in time division reection of surface texture reection of light source light source surface texture in real world reection of light source x % y % mirror screen image projector image source projector as light source = = diuse texture + reection texture 16 14. http://www.bbc.co.uk/news/technology-18671061 18 15. 022 Web Designing RG !? Twitter@satoshogo1 sato.shogo@yoshimoto.co.jp !? Web Designing http://book.mycom.co.jp/wd/cb/ RG OCHIAI YOICHIuhttp://web.me.com/kuro.ochiai/ '87 File.14 text by Tomohiro Okada photo by Daisuke Yamashiro Next Creator File 21 16. C ~~ 2011 17. 18. 19. TEDx3 20. PART 1 -1 ACM UIST yoichi.ochiai@me.com 21. 26 Vol.52 No.12 Dec. 2011 PART 1 3 http:// ochyai.com . -1 SIGGRAPH 1 2 -2 SIGGRAPH 3 1 : : The Visible Breadboard, 15(3), pp.463-466 (Oct. 2010). 2Ochiai, Y. and Toyoshima, K. : Homunculus : the Vehicle as Augmented Clothes, ACM Augmented Human 2011, Paper with Demo (Mar. 2011). 3Ochiai, Y. and Takai, H. : The Cyclone Display : Rotation, Reflection, Flicker and Recognition Combined to the Pixels, ACM SIGGRAPH 2011 Emerging Technologies (Aug. 2011) 2011 9 16 ACM UIST yoichi.ochiai@me.com -1 -2 2011 TEDxTokyo yz 22. 2007-2011 23. 2007 24. 2007 25. BASIS FUNCTION 26. 20075 27. GHQ(Go Home Quickly) 28. 29. 2007-2011 30. 31. 32. 2008 33. 2007 34. 35. 36. 37. 2008 38. 2008 39. 40. 41. 42. 43. Nokia 44. 2008 45. IPA 2009 46. 2010Indicatable Media 47. Indicatables &Indicatable Media What is happening inside is what you see outside. Indicatable Road Indicatable Knockin Blocks Indicatable Media Blocks Worlds Interface Visible Electricity Device Heart-Linking Clothes Collaboration Tact System 48. 2010 SIGGRAPH 49. 2010 IPA 50. ACM UIST 2010 51. 2011 52. SIGGRAPH 53. 54. 20086 55. 56. 10 57. 58. M e c h a n i c a l A r t s / L i b e r a l A r t s 59. Photon 60. 61. Research focused on Illuminance Field (3D discontinuous Display) SIGGRAPH 2007SIGGRAPH 2006 SIGGRAPH 2010 SIGGRAPH 2014 Plasma Laser Spinning Mirror Water Drop CAPF Particle 62. 63. M a g i c a l l y , P h y s i c a l l y , I n t e r a c t i v e , I n t u i t i v e , P e r s o n a l i z e 64. 65. 1940 76 Shannon, 1940 66. 1940 77 67. C o m p u t e r a s m u l t i m e d i a d e v i c e 1 0 1 9 6 3 t o 1 9 7 2 68. Ivan Sutherland demonstrating the Sketchpad system on the console of the TX-2 at MIT(1963) Source: Sun Microsystems 69. 80 Ivan Sutherland The Ultimate Display 1965 70. NLS(oN Line System) Hyper-text Mouse - Keyboard GUI Network Collaboration D.Engelbert 1968 71. 1972 Alan Kay A personal computer for children all ages 72. 1982-2000 - Web PC / 83 73. P e r s o n a l C o m p u t e r 74. 1984- Mac / 1990- NeXT 75. Tim Berners Lee 1990,WWW 76. 87 We believe that one of the most powerful uses of virtual worlds will not be to replace the real world, but rather to augment the user's view of the real world with additional information. This idea, introduced by Ivan Sutherland's pioneering work on head-mounted displays, is often referred to as augmented reality. For example, graphics and text overlaid on the surrounding world could explain how to operate, maintain, or repair equipment, without requiring that the user refer to a separate paper or electronic manual. Karma, Steven Feiner 1991,92 77. 1991,the Computer for 21C Weiser,M 78. 89 79. C o m p u t e r a s U b i q u i t o u s E n v i r o n m e n t 80. in 1967, at MIT in 2013, at 91 81. 92 The ultimate display would, of course, be a room within which the computer can control the existence of matter. A chair displayed in such a room would be good enough to sit in. Handcuffs displayed in such a room would be confining, and a bullet displayed in such a room would be fatal. With appropriate programming such a display could literally be the Wonderland into which Alice walked. ! The Ultimate Display, Ivan E. Sutherland 1965 82. 93 () , 1965 83. 84. 95 85. 1 t o N 86. A r t a n d C r a f t 87. 88. D e s i g n < - > P r o d u c t 89. J e a n - P a u l G A U L T I E R 1 2 A W 90. p r t - - p o r t e r 91. R e a d y - m a d e 92. 1 9 c1 8 c 2 0 c 2 1 c P e r s o n a l i z eM a s s D e s i g n T e c h n o l o g y P e r s o n a l i z e C r a f t 1 t o N N t o N1 t o 1 93. 1 t o N 94. 95. D e s i g n i s a p a r t o f T e c h n o l o g i e 96. 1 t o N b u t c u s t o m i z e R a r i t y < $ 1 0 0 0 > $ 1 0 0 0 0 97. 98. v s v s 99. 100. 113 101. 102. T e c h n e C r a f t A r t K n u s t A r s T e c h n i k M e c h a n i c a l A r t s T e c h n o l o g i e A r t e s M e c h a n i c a e A r t e s L i b e r a l e s L i b e r a l A r t s 103. ( d e v e l o p : ) 104. 2 105. 106. 107. SIGGRAPH 2013 124 108. 125 109. Methods: Principle of the Diffusion (BRDF model) BRDF model on the surface incoming light i outgoing light normal vector n i irradiance Li illuminance Ei irradiance Lr surface(colloidal membrane) o Activated Colloidal Film(200x 500fps) : wavelength : the surface tension : the density of the colloidal solution f : the excitation frequency. with 40kHz ultrasounds, the wavelength is 2/k=83m. 126 110. Models: Capillary Waves surface tension Ultrasounds : wavelength : the surface tension : the density of the colloidal solution f : the excitation frequency. f activated 127 111. 17591110 - 180559 112. Artes Liberales Artes Mechanicae 113. W O W 114. 1 8 7 0 2 115. 1 9 2 0 2 1 116. 117. 118. 119. S e n s e C a m : M i c r o s o f t R e s e a r c h 120. P r o j e c t D a n i e l : 3 D p r i n t i n g r o b o t a r m 121. E y e w r i t e r 122. W e a rB l i z z i d e n t 123. h e l p o n e / h e l p m a n y 124. 141 125. 142 $ 21,011,040 / year 126. 127. 128. 129. 2D display texture display 2.5D display 3D displayTexturePresent Deformation 3D Manipulation Physicalization of Graphics 147 130. texture display 2.5D display 3D displayTexture 148 131. texture display 2.5D display 3D displayTexture 149 132. 2.5D display 3D displayDeformation 150 133. 3D display 3D Manipulation 151 134. Animation 1.Movement of Potential eld 2. Objects move along the potential eld Distribution Objects are arrayed in Potential Field 2D display texture display 2.5D display 3D display Object Potential Field Suspension O P 135. 136. I n R a s c o w , B C . 1 3 0 0 0 155 137. 156 138. 157 139. 158 140. 159 141. Ivan Sutherland demonstrating the Sketchpad system on the console of the TX-2 at MIT(1963) 142. Computer Graphics 161 Computer Graphics 143. 164 144. 165 145. 146. 147. 148. 149. Yoichi Ochiai Canvas as a skin exhibited in shibuya le deco 2011 150. 151. MAKE IT HOME 152. 153. Retina display 154. 3.2images mixed in stereo kaleidoscopes As shown in figure3, the kaleidoscopic image has a repetitive structure of the same triangle image. Since a repetitive nature of the images is alike, binocular rivalry[1] starts partially even if the images are different from one to the other. Because of these structures, the images are mixed in some places of the view, or are not mixed at all. The significant point of the kaleidoscopes is not only structure of images but also their endless image repetition by the mirrors. It causes a vision effects from large field of views including a peripheral vision. With this work, viewer can experience the special effect on the kaleidoscopes. It is essentially different from ordinary stereo vision. 3.2images mixed in stereo kaleidoscopes As shown in figure3, the kaleidoscopic image has a repetitive structure of the same triangle image. Since a repetitive nature of the images is alike, binocular rivalry[1] starts partially even if the images are different from one to the other. Because of these structures, the images are mixed in some places of the view, or are not mixed at all. The significant point of the kaleidoscopes is not only structure of images but also their endless image repetition by the mirrors. It causes a vision effects from large field of views including a peripheral vision. With this work, viewer can experience the special effect on the kaleidoscopes. It is essentially different from ordinary stereo vision. Netherlands: Royal VanGorcum), 1965. over 300ppi high resolution display 155. 156. 157. 192 158. 159. 194 160. 1 9 c1 8 c 2 0 c 2 1 c P e r s o n a l i z eM a s s D e s i g n T e c h n o l o g y P e r s o n a l i z e C r a f t 161. 162. 1 t o N 163. 164. Artes Liberales Artes Mechanicae 165. 166. 167. 202 168. Yoichi OCHIAI and Keisuke TOYOSHIMA Sakura Media Cherry Blossom as Particle Screen(2011 Apr) 203 169. Yoichi OCHIAI and Keisuke TOYOSHIMA Sakura Media Cherry Blossom as Particle Screen(2011 Apr) 204 170. 171. ochyai #ochyai IPAyoichi.ochiai@me.com 172. 10 #ochyai