90
Reverse Engineering & Scanner 3D

Scanner 3D e reverse Engineering

Embed Size (px)

DESCRIPTION

3D scanner & Reverse Engineering. Una panoramica sulle tecnologie di reverse engineering e sui modelli di scanner commerciali e open source/DIY. Come riparare i file con Meshlab e netfabb. Uso della kinect.

Citation preview

Page 1: Scanner 3D e reverse Engineering

Reverse Engineering & Scanner 3D

Page 2: Scanner 3D e reverse Engineering

Cos'è uno scanner 3D

un dispositivo che analizza gli oggetti o gli ambienti del mondo reale per collezionare dati sulle loro forme o sul loro aspetto, e per costruire modelli tridimensionali digitali

Page 3: Scanner 3D e reverse Engineering
Page 4: Scanner 3D e reverse Engineering

Intro / storia 1

MisurarePrimi tentativi per standardizzare le misure: 2600 AC nella valle dell'Indo

240 AC Erastotene stimò la circonferenza della Terra al solstizio d'estate misurando l'altezza del sole a Alexandria e Siene

1750 / 1850 Rivoluzione Industriale – la misura delle cose divenne fondamentale

Primi metodi di misura per contatto diretto: calibri e metri

Pantografi per replicare gli oggetti

La rivoluzione c'è stata con le misure non invasive e a distanza.

Page 5: Scanner 3D e reverse Engineering

Intro / storia 2

Laser ranging systems have been in use in a variety of industries for decades, with the first patented instruments appearing as early as the late 1980’s. 3D scanning was first applied in the Architecture, Engineering, and Construction industry in the 1990’s with the market debut of the first integrated commercial systems for 3D scanning

Page 6: Scanner 3D e reverse Engineering
Page 7: Scanner 3D e reverse Engineering

Applicazioni / 1

A cosa serve? Quali applicazioni?

Product inspection – per vedere se un prodotto è uscito come previsto (si misurano parti e rilevano difetti)

Medicina – si rilevano parti in 3D per creare protesi su misura. Negl interventi la scansione è proiettata sul paziente

Product design

Page 8: Scanner 3D e reverse Engineering

Applicazioni / 2

Edilizia – verifica che l'edificio sia uscito come previsto

Clothes fitting – misurazione del corpo – es esercito USA ha un sistema di misurazione automatico

Art historySculptures & interesting objects to look atArt: studying working techniquesArt historyCultural heritage preservationHigh-visibility project

ArchaeologyRicostruzione di parti e ricombinazione frammentiRicostruzione oggetti in 3D per evitare di toccarli

Page 9: Scanner 3D e reverse Engineering

Applicazioni / 3

Computer graphicsCinemaGiochi (hanno un fatturato maggiore del cinema)

Robot navigation

Page 10: Scanner 3D e reverse Engineering

Possibilità tecnologiche

ContattoSonde a contatto

TrasmissiveMagnetic Resonance Imaging (MRI)UltrasuoniRaggi XSuoni e Vibrazioni

RiflessioneOtticaNon ottica (radar e sonar)

Page 11: Scanner 3D e reverse Engineering

Tecnologie ottiche

Immagini stereo Oggetto inquadrato da due angolature (doppia immagine)Meglio più di due per evitare ambiguitàNon vedo quello che c'è dietro

Page 12: Scanner 3D e reverse Engineering

Tecnologie ottiche

Shape from motionDa analisi di una sequenza di immagini, ricavo l'oggetto in 3d

Shape from shadingSi evidenziano le forme illuminando l'oggetto da diversi punti

Page 13: Scanner 3D e reverse Engineering

Tecnologie ottiche

Shape from textureSi proietta una texture nota sull'oggetto e vedendo come si

deforma si ricava la forma dell'oggetto (esempio una serie di righe)

Page 14: Scanner 3D e reverse Engineering

Tecnologie ottiche

Shape from focus/defocusSi determinano distanze e forme vedendo come e dove si

mette a fuoco l'immagine – la messa a fuoco dipende dalla distanza

Tempo di volo del laserOpera su grandi volumi (lati da 100m)Precisione grossolana – 5mmPer scavi archeologici, edifici, stanze

Page 15: Scanner 3D e reverse Engineering

Tecnologie ottiche

TriangolazioneUna lama laser che scorre sull'oggettoLaser e camera posti a triangolo con l'objSe camera e laser si muovono indipedentemente, è difficile

poi ricostruire con precisione. Molti scanner hanno camera e laser fissi.

Per grandi oggetti si usano sistemi che muovono il gruppo di scansione e gli fanno coprire delle piccole regioni (moto su tilt e pan)

Page 16: Scanner 3D e reverse Engineering

MakerScanner

Page 17: Scanner 3D e reverse Engineering

Distanze e colori

Misura della distanza e nuvola di punti

Scanning systems primarily capture the physical position of a target object, represented as a series of points (forming a “point cloud”) typically in Cartesian coordinates (XYZ). This is accomplished by comparing the emitted and returned light pulse, and determining the value of the target object in relation to the position of the scanning instrument

Colori

determine the colour of the each point by using a camera (can be built-in or seperate), which is represented by the commonly used RGB (red, green, blue) value scale. Because scanners are optical systems, only what the scanner can “see” is captured,

Page 18: Scanner 3D e reverse Engineering

Precisione, Risoluzione, Accuratezza

Risoluzione: densità della nuvola di punti

Accuratezza: differenza tra misura e valore reale

Precisione: indica la correttezza della misura (posso avere un point set preciso ma inaccurato – es se offset iniziale e non mi accorgo)

Peggiorano con:DistanzaSuperficie riflettenteVelocità di scansione

Si va da qualche millimetro (5 mm) fino a freazioni di millimetro (0,3 mm)

Page 19: Scanner 3D e reverse Engineering
Page 20: Scanner 3D e reverse Engineering

Formato file

Lo scanner raccoglie una nuvola di punti che poi è raccolta in un file

ASTM E57 File Format (XYX I RGB) questo rappresenta la nuvola di punti

Questi formati derivano dal mondo grafico:

OBJ (con colori)

STL

VRML (con colori)

Page 21: Scanner 3D e reverse Engineering
Page 22: Scanner 3D e reverse Engineering
Page 23: Scanner 3D e reverse Engineering
Page 24: Scanner 3D e reverse Engineering

Scanner professionali

Page 25: Scanner 3D e reverse Engineering

Makerbot Digitizer

Circa 800$

Page 26: Scanner 3D e reverse Engineering
Page 27: Scanner 3D e reverse Engineering

Prezzo: circa 400€

Page 28: Scanner 3D e reverse Engineering

Uniscan

Prezzo: 4000€

Page 29: Scanner 3D e reverse Engineering

Scanner low cost

Page 30: Scanner 3D e reverse Engineering

David Scanner

A starter kit of the David Scanner is available for 399 €.

360 scans are possible, although the user needs to turn the object manually between multiple scans.

The software is proprietary and runs only on Windows.

Minimal equipment is needed, such as a line laser, a camera and a calibration pattern which can be printed out.

Using the DAVID- Shapefusion software the user can manually merge multiple point-clouds from different scans and convert them to a surface mesh by-hand.

Page 31: Scanner 3D e reverse Engineering

David Scanner

Page 32: Scanner 3D e reverse Engineering

David Scanner

Page 33: Scanner 3D e reverse Engineering
Page 34: Scanner 3D e reverse Engineering

Makerbot Scanner v.0

The MakerBot 3D Scanner (formerly know as Cyclops) is a 3D scanning mounting kit for a pico projector, a webcam and an iPhone or iPod.

The mounting kit is available for 50$.

A set of additional open-source software is required (ThreePhase, PeasyCam, ControlP5, Processing).

Extensive instructions are provided on the website to perform a single face scan.

Using Blender and MeshLab the point-clouds are transformed into surface meshes which can then be printed on the MakerBot.

http://wiki.makerbot.com/3D-scanner

Page 35: Scanner 3D e reverse Engineering

Makerbot Scanner v.0

Page 36: Scanner 3D e reverse Engineering

3D Photograpy on your desk

This project requires very little hardware: a camera, a desk- lamp, a pencil and a checkerboard.

The checkerboard is used for calibration. The pencil is waved between the lamp and the object to be scanned, casting a shadow on the object.

The 3D shape of the object is extracted from the spatial and temporal location of the observed shadow.

Several implementations of this technique are available on the project’s website.

http://www.vision.caltech.edu/bouguetj/ICCV98/

Page 37: Scanner 3D e reverse Engineering

FabScanner

Fabscanner http://hci.rwth-aachen.de/fabscan

Un progetto simile:

Scanner con arduino e mathlabhttp://makezine.com/projects/diy-3d-laser-scanner-using-arduino/

Page 38: Scanner 3D e reverse Engineering

FabScanner

Page 39: Scanner 3D e reverse Engineering

MakerScanner

Scanner con webcam fissa e laser lineare da muovere a mano

Il software è disponibile per Windows, Linux e come sorgenti.

Page 40: Scanner 3D e reverse Engineering

MakerScanner

Page 41: Scanner 3D e reverse Engineering
Page 42: Scanner 3D e reverse Engineering

MakerScanner

Page 43: Scanner 3D e reverse Engineering

I used Blender 3D to clean the pointcloud and MeshLab to create a surface which we then 3D printed on a Makerbot. If you're interested you can get the pointcloud and STL files here.

Page 44: Scanner 3D e reverse Engineering
Page 45: Scanner 3D e reverse Engineering
Page 46: Scanner 3D e reverse Engineering

123D Catch

Download e demo

Page 47: Scanner 3D e reverse Engineering

123D Catch

Page 48: Scanner 3D e reverse Engineering
Page 49: Scanner 3D e reverse Engineering
Page 50: Scanner 3D e reverse Engineering
Page 51: Scanner 3D e reverse Engineering
Page 52: Scanner 3D e reverse Engineering
Page 53: Scanner 3D e reverse Engineering

Kinect

Kinect also includes infrared projectors and cameras which are used for depth detection, hence it could also be used to build a 3D scanner.

The depth perception technology in the Kinect works best at distances of 6-8 feet ( 2m). ⇡

Thus, the Kinect is better suited for identifying ”likely humans in the scene and the likely positions of their arms and legs.” than for precise short-range 3D scanning.

Attenzione alle versioni per: Window e XBox

Alternative: ASUS xition

SOFTWARE: KScan 3D, Skanect, FARO...

Page 54: Scanner 3D e reverse Engineering
Page 55: Scanner 3D e reverse Engineering
Page 56: Scanner 3D e reverse Engineering
Page 57: Scanner 3D e reverse Engineering
Page 58: Scanner 3D e reverse Engineering
Page 59: Scanner 3D e reverse Engineering
Page 60: Scanner 3D e reverse Engineering

Skanect

Per Windows e Mac

Limitato a 5000 facce in versione free

E' molto facile da usare

Spiegazione programma e demo scansione

Page 61: Scanner 3D e reverse Engineering
Page 62: Scanner 3D e reverse Engineering

Riparare i modelli con Meshlab

Nuvola di punti | Riparare | Chiudere | Esportare

Page 63: Scanner 3D e reverse Engineering

MeshLabFile → import Model

Import della tazza.obj fatta con Skanect

Movimenti:- drag dei cerchi per ruotare- CMD + drag per il PAN- zoom (rotellina mouse)

Visualizzazioni (toolbar) punti, triangoli...

IlluminazioneRender → lightening

Tasto toolbox: fill hole

Icona con i 3 assi a colori : serve per ruotare, traslare e spostare

Cancellare parti con la selezione per vertici e facce e l'apposito filtro.

Page 64: Scanner 3D e reverse Engineering

MeshLabSemplificare facce

https://www.shapeways.com/tutorials/polygon_reduction_with_meshlab

From the menu, select Filters > Remeshing, simplification and construction > Quadratic Edge Collapse Detection.

Target number of faces: numero facce desiderate

Quality threshold: 1. Enter a value between 0 and 1 here; the higher the value the harder MeshLab tries to stick to your original model's shape.

Preserve Boundary of the Mesh: Yes. 'The simplification process tries not to destroy mesh boundaries, e.g. exposed edges of the mesh are left untouched. This parameter has no effect on watertight meshes.'

Preserve Normal: Yes. Select this to stop MeshLab from accidentally flipping the face normals.

Planar simplification: Yes. Paolo's comment: 'Add additional simplification constraints that try to preserve the current shape of the triangles.

Page 65: Scanner 3D e reverse Engineering
Page 66: Scanner 3D e reverse Engineering
Page 67: Scanner 3D e reverse Engineering
Page 68: Scanner 3D e reverse Engineering
Page 69: Scanner 3D e reverse Engineering
Page 70: Scanner 3D e reverse Engineering
Page 71: Scanner 3D e reverse Engineering

Link dei tutorial

cleaning: http://abarry.org/makerscanner/4-makerscanner-post-processing.htmlmeshing: http://abarry.org/makerscanner/5-makerscanner-meshing.html

Page 72: Scanner 3D e reverse Engineering

● Filters -> Normal, Curvatures and Orientation -> Compute normal for points set

● Filters -> Remeshing, Simplification and Reconstruction -> Surface Reconstruction Poisson

● Filters -> Normals, Curvatures and Orientation-> Re-Orient All Faces Coherently

Page 73: Scanner 3D e reverse Engineering

NetFabb

Programma a uso gratuito (funzioni limitate)

Si usa per lavorare sui modelli STL

Utile per: - riparare file- individuare errori- tagliare i file- ruotare e ridimensionare oggetti

Page 74: Scanner 3D e reverse Engineering

NetFabb

Page 75: Scanner 3D e reverse Engineering
Page 76: Scanner 3D e reverse Engineering
Page 77: Scanner 3D e reverse Engineering
Page 78: Scanner 3D e reverse Engineering
Page 79: Scanner 3D e reverse Engineering

Editare l'stl con 123D design

Importare e aggiungere una base

Oppure scritte in svg...

Page 80: Scanner 3D e reverse Engineering
Page 81: Scanner 3D e reverse Engineering

Altre fonti

DICOM

Seg3d v2.1 + imagevis

Aerial - planimetry

Page 82: Scanner 3D e reverse Engineering
Page 83: Scanner 3D e reverse Engineering
Page 84: Scanner 3D e reverse Engineering
Page 85: Scanner 3D e reverse Engineering
Page 86: Scanner 3D e reverse Engineering
Page 87: Scanner 3D e reverse Engineering
Page 88: Scanner 3D e reverse Engineering
Page 89: Scanner 3D e reverse Engineering
Page 90: Scanner 3D e reverse Engineering

Grazie!

Paolo [email protected]