UNIVERSITY OF KRAGUJEVAC - catia · ‐ City of Kragujevac is industrial, cultural, educational, university and political center ofthe Sumadija andPomoravljeregion. ‐ City of Kragujevac

‐ Invitedpaper‐

Engineeringdesigneducationforindustry4.0:implementationofaugmentedreality

conceptinteachingcadcourses

UNIVERSITYOFKRAGUJEVACFaculty of Engineering

InBucharest,01.04.2016.

SasaCUKOVIC,GoranDevedzic,IonutGHIONEA,MicheleFIORENTINO,KarupppasamySUBBURAJ

1.UniversityofKragujevac,FacultyofEngineering,Kragujevac,Serbia.2.UniversityPolitehnicaofBucharest,TCMDepartment,Romania.

3.PolytechnicUniversityofBari,Italy.4.SingaporeUniversityofTechnologyandDesign,Singapore.

DrSašaĆuković,grad.mech.eng. 231.3.2016.22:48:31

Content:1.INTRO

1. Serbia / Kragujevac,2. University of Kragujevac,3. My teaching and research activities.

2.INDUSTRIALREVOLUTION4.01.Newindustrialparadigm/revolution,2. Cyber‐physical System (CPS),3. What will change Industry 4.0?

3.AUGMENTEDREALITY‐ AR1. Concept of Augmented reality,2. Marker based AR system,3. Magic Book – Android Version,4. Magic Book – Desktop Version,5. Markerless algorithm (Natural Feature Tracking).

4.CONCLUSIONS&FUTUREWORK


1.1 City of Kragujevac

‐ City of Kragujevac is industrial, cultural,educational, university and political centerof the Sumadija and Pomoravlje region.

‐ City of Kragujevac has approximately180000 citizens, and it is the fourth largestcity in Serbia.

1.


1.1 Europe / Serbia / Kragujevac

1.


1.2 University of Kragujevac (www.kg.ac.rs)

FacultyofEngineeringKragujevac*(2011‐present),www.fink.rs

(8departmentsforBachelor,MasterandPhDstudies)

*NewnameforFacultyofMechanicalEngineering(1960‐2011)

1.FacultyofEngineering2.FacultyofLaw3.FacultyofEconomics4.FacultyofNaturalSciences5.FacultyofMedicine6.FacultyofLiteratureandLanguages7.FacultyofArts8.FacultyofAgriculture9.FacultyofEducation10.FacultyofTechnicalSciences

FacultyofEngineeringKragujevac

UniversityofKragujevac– Rectorate

1.

CAD/CAM/CAE,Catalogues,

Kax,Digitalmodels&data.

AR@FinKg

CloudComputing&Cybersecurity

@FinKg

1.CAD/CAM/CAE

@FinKg


1.3ResearchatFacultyofEngineering. My research activities (Mechanical and Biomedical):

1.


1.3TeachingatFacultyofEngineering. My teaching activities (CAD/CAM technologies): CATIA 3D modeling and

Machining, Collaboration with: Technical University of Munich, Politehnica of Bucharest,

Polytechnic of Bari, Singapore University of Technology and Design.

InformationandCommunicationTechnology(ICT),

NetworkCommunications, Cyber‐physicalSystems, Data‐ BigData, CloudComputing TheInternetofthings

Sensors, Robots, AdditiveManufacturing

Simulation, AugmentedReality, IntelligentTools.

2.

REPORT:Industry4.0theindustrialrevolutionhappening

now!

2.1Newindustrialparadigm/revolution – Industry4.0 New industrial revolution (Industry 4.0) depends on development of numerous

innovative technological and scientific achievements .



2.2.2Cyber‐physical System (CPS)– Industry4.0

Cyber‐physical (CPS)systemallows„cooperation“ofcomputerelementsandsoftwarewithphysicalcomponentsoftheenterprisesindistributedenvironment.

Cyber‐physicalsystemsallowcommunicationandcooperationamongmachinesitself(„social machines“)andwithhumansinrealtime (AR)via „InternetofServices“.

DIGITALWORLD

REALWORLD

DIGITALIZATION (CAD/CAM, AR), INCREASING FLEXIBILITY OF PRODUCTION ‐ SMARTFACTORIES,

MASS CUSTOMIZATION, INCREASING PRODUCTIVITY, INTEGRATED PRODUCT AND PROCESS DEVELOPMENT, INCREASING A QUALITY OF PRODUCTS,APPLICATION OF PREDICTIVE MAINTENANCE, CUSTOMERSWILL BE INVOLVED IN PRODUCT DESIGN, INCREASING ENERGETIC EFFICIENCY.


2.2.3WhatwillchangeIndustry4.0?

Fig.1.Changesthatbringnewindustrialrevolution

3.


3.1ConceptofAugmentedreality. Augmented Reality in general is the concept of enhancing the real world with

additional virtual information. One of the most commonly used definitions ofAugmented Reality was given by Ron Azuma [3]. Independent of specifictechnologies, an Augmented Reality system has to meet the following requirements(Fig. 1).

Combine real and virtual worlds, Augmentations are interactive in real time, Augmentations are registered in 3D to the real world.

Fig.2.Simplified representation oftheReality‐Virtuality Continuum

3.


3.1ConceptofAugmentedreality(Markervs.markerless AR). To fulfill the requirements for an augmented reality system, the foundation is to

estimate the position and orientation of the camera in respect to the world or viceversa. To do this we employ a technique called marker tracking.

3.1.1 Marker tracker Marker tracking makes use of the camera image to find optical square markers

and estimate their pose relative to the camera.

3.1.2 System description As the tracking framework we are using UbiTrack. UbiTrack is an open source,

general purpose tracking framework for Augmented Reality developed by the„Fachgebiet Augmented Reality” group of the TUMünchen.

3.1.3 Magic Book The basic principle is that a real book is enhanced using Augmented Reality.

Virtual objects are superimposed on the different pages of the book in theAugmented Reality mode.

MarkerbasedAR

3.


3.2MarkerbasedARsystem. Marker tracker.

Fig.3.Markertrackerpipeline

3.


3.2MarkerbasedARsystem. System Description.

Fig.4:VideobasedAugmentedReality

EachpageofthetutorialbookhasanembeddeduniquesquaremarkerassociatedwiththeCADmodel.

3.


3.3MagicBook– AndroidVersion. Focusing the camera on the markers retrieve the virtual 3D objects from database

and the information and graphics are then overlaid onto the screen.

Fig.5.CADMagicBookApplication– a)Androidversion

3.


3.4MagicBook– DesktopVersion. Example – desktop application.

Fig.6.CADMagicBookApplication– b)Desktopversion– illustration

Focusing the camera on the markers retrieve the virtual 3D objects from databaseand the information and graphics are then overlaid onto the screen.

ByrecognizingtheIDofthesquare‐sizedmarker,theapplicationdetermineswhichCADmodeltodisplay.

3.


3.4MarkerbasedARsystem,medicalapplication.

Fig.7.Markerbasedtrackerpipeline– 3Dmodelofthefoot

Asthetrackingfram

ework

weimplem

ented

UbiTrack!

2.


3.4MarkerbasedARsystem,medicalapplication.

Fig.8.Startingimageusedfortrackingontheleftandfeaturesextractedfromitontheright(adoptedfrom[14])

Students and/or doctors observe the scene through a video camera, where therendered image of the virtual phantom is composed with video stream,directed at the patient’s foot.

3.


3.5Markerless algorithm(NaturalFeatureTracking).

Fig.9.NaturalFeatureTrackingPipeline

Natural Feature Tracking is an image‐basedtracking technique that detects and tracksthe features that are naturally found in theimage itself. These could be corners, edges,blobs, etc., without using specificallydesigned ID markers.

There are several Natural Feature Trackingapproaches such SIFT, SURF, Ferns.

As tracking framework, we used Vuforia SDKimage targets. We created our own image targetusing the page of the Atlas book.

3.


3.5Markerless algorithm(NaturalFeatureTracking).

Fig.11.Startingimageusedfortrackingontheleftandfeaturesextractedfromitontheright

Fig.10.ApplicationbuildusingNaturalfeaturetracking:with"extendedtracking"modeoff(onthetop)andon(on

thebottom).

We, then, developed our AR applicationusing Unity3D software, importing thetracking database generated in theVuforia developer portal.

4.


4.1CONCLUSIONS. AR can be used as a new tool to support of the teaching activities.

It emphasizes the perception of 3D space.

AR Magic CAD Book aims at comprehending geometric relationships ofreference lines, sides, planes, angles, developing their ability to make sense ofvisual information, and motivating logical thinking and cultivating logicalskills.

In the future we plan to replace the standard square marker tracker with atexture/image based tracking system.

Such models can be further enhanced by integrating types of information otherthan just simple 3D representations (audio, text annotations, 2D images, anddiagrams).

4.2FUTUREWORK.

5.


LIVEDEMO!

Presenter:DrSašaĆuković,grad.mech.eng.

[email protected]

UNIVERSITYOFKRAGUJEVACFaculty of Engineering

InBucharest,01.04.2016.

THANKYOU!!!‐ Invitedpaper‐

Engineeringdesigneducationforindustry4.0:implementationofaugmentedrealityconceptinteachingCADcourses

Documents

UNIVERSITY OF KRAGUJEVAC - catia · ‐ City of Kragujevac is industrial, cultural, educational, university and political center ofthe Sumadija andPomoravljeregion. ‐ City of Kragujevac