30
Profil: AI och Maskininlärning Fredrik Heintz, IDA, Linköpings universitet [email protected] @FredrikHeintz

Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Profil: AI och MaskininlärningFredrik Heintz, IDA, Linköpings [email protected]@FredrikHeintz

Page 2: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision
Page 3: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision
Page 4: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

http://deeplearningskysthelimit.blogspot.se/2016/04/part-2-alphago-under-magnifying-glass.html

Page 5: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Image Classification

Page 6: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Speech Recognition

Page 7: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Artificial Intelligence

Interaction

• Human-AI collaboration

• Social and ethical aspects

• Multi-agent systems

Reasoning

• Inference

• Prediction

• Decision making

• Planning

Learning

• Deep learning

• Bayesian learning

• Reinforcement learning

Robotics / Cyber-PhysicalSystems

Decision Support Systems

AGI

“Artificial Intelligence is the science and engineering of making intelligent machines, especially intelligent computer programs.” John McCarthy, Stanford

Page 8: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision
Page 9: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Why now?

• Software is eating the world

• The digital and the analog are becoming one

• Computer power and GPUs

• Massive amounts of labeled data

• Improved algorithms due to increasing research inacademia and industry

1997

Page 10: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

• Safety guarantees

• Decision making in complex situations

• Integration in transportation infrastructure

• Handle all operational environments

Page 11: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

• Manipulation

• Human-robot collaboration

• Robustness and extended operation

• From single task to general purpose

Page 12: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

IoT

IBM Watson

• Extracting and leveraging semantics

• From single questions to continuous dialogue

• Online and stream reasoning

• Proactive decision support

• Combine model-based and data-driven approaches

Page 13: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Types of Machine Learning

• Supervised learning

– Given input-output examples f(X)=Y, learn the function f().

• Unsupervised learning

– Given input examples, find patterns such as clusters

• Reinforcement learning

– Select and execute an action, get feedback, update policy (what action to do in which state).

https://www.techleer.com/articles/203-machine-learning-algorithm-backbone-of-emerging-technologies/

Page 14: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision
Page 15: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

https://spectrum.ieee.org/the-human-os/biomedical/diagnostics/stanford-algorithm-can-diagnose-pneumonia-better-than-radiologistshttps://arxiv.org/abs/1711.05225

NIH released data set with 112 120 chest X-ray images with 14 labeled diagnoses. 4 Stanford radiologists annotated 420 images for indications of pneumonia.After 1 month of training cheXNet outperformed all the radiologists.

Page 16: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Ian J. Goodfellow, Jonathon Shlens, Christian Szegedy. Explaining and Harnessing Adversarial Examples. ICLR 2015https://arxiv.org/abs/1412.6572

Machine learning is still brittle…

Page 17: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Generative Adversarial Networks (GANs)

Kevin McGuinness. Deep Learning for Computer Vision: Generative models and adversarial training (UPC 2016).http://www.slideshare.net/xavigiro/deep-learning-for-computer-vision-generative-models-and-adversarial-training-upc-2016

Page 18: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Visual Question Answering

http://visualqa.org/

Page 19: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Explainable AI

https://www.darpa.mil/program/explainable-artificial-intelligence

Page 20: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Generative Adversarial Networks (GANs)

• Sample efficient learning

• Online learning

• Learning with guarantees

• Learning explainable models

• Statistical-relational learning

• Transfer learning

Page 21: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

“Weak human + machine + superior process was greater than a strong computer and, remarkably, greater than a strong human + machine with inferior process.”

Garry Kasparov

< <

Page 22: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Vision

A principled approach to building collaborative intelligent autonomous systems for complex missions.

Page 23: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Autonomous Systems at AIICS, Linköping University

Micro UAVsweight < 500 g, diameter < 50 cm

Yamaha RMAXweight 95 kg, length 3.6 m

PingWing

LinkMAV

LinkQuad weight ~1 kg, diameter ~70cm

Page 24: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision
Page 25: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Delegation-Based CollaborationDelegation

AdjustableAutonomy

Mixed-InitiativeInteraction

Delegate(A, B, task, constraints)

Delegate(GOP, UAV, task, constraints)Delegate(UAV, GOP, task, constraints)Important: Safety, security, trust, etc.

By varying the task and constraints parameters the degree of autonomy allowed can be controlled.

Page 26: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Wallenberg AI, Autonomous Systems and Software Program (WASP)

Research ProgramThe best researchers in the field

Graduate SchoolAmbitious program, Industrial PhDs

Demonstrator ArenasDemonstrations with external parties

Recruitment Program Internationally competitive offers

Ten year program 3000+ MSEK~300 million Euro

Page 27: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Wallenberg AI, Autonomous Systems and Software Program (WASP)

Extends WASP with 1000 MSEK for AI. Two tracksAI/ML: Machine Learning, Deep Learning,

eXplainable AI (XAI)AI/Math: Theoretical questions related

to AI in a wide senseAI4X Conferences in the spring:

Feb 12: IndustryFeb 27: Education & EntertainmentMar 13: HealthMar 27: Finance & ServicesApr 11: Society & Environment

WASP AI

http://wasp-sweden.se/ai/ai4x/

Page 28: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Profilregler

• Minst 36 hp inom profilen

• Varav 30 hp på avancerad nivå

• Obligatoriska kurser

– TDDC17 Artificiell intelligens

– TDDE01 Maskininlärning

– TDDE19 Avancerad projektkurs: AI och maskininlärning

Page 29: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

TDDD41 – Data Mining – Clustering and Association AnalysisTDDE16 – Text Mining TDDE19 – Språktekno-logiTBMI19 – Medicinska informationssystem TSKS11 – Algoritmer och Tjänster i Stora Nätverk

TDDE05 – AI-robotikTSFS06 – Diagnos och övervakning TSRT07 – Industriell ReglerteknikTSRT62 – Modellbygge och simuleringTSBB09 – BildsensorerTSRT14 – Sensorfusion TSRT78 – Digital signalbehandling

TDDC17 – Artificiell intelligensTDDD08 – LogikprogrammeringTDDD20 – Konstruktion och analys av

algoritmerTDDD48 – Automatisk planeringTDDE01 – MaskininlärningTDDE07 – Bayesianska metoderTDDE13 – MultiagentsystemTDDE15 – Avancerad maskininlärning TDDE19 – Avancerad projektkurs TBMI26 – Neuronnät och lärande system TSBB06 – Multidimensionell signalanalysTSBB08 – Digital bildbehandlingTSBB17 – Visuell detektion och igenkänning

Datadrivet beslutsfattande Autonoma system

Profilkurser

Page 30: Profil: AI och Maskininlärning - Linköping University€¦ · Learning •Deep learning •Bayesian learning •Reinforcement learning Robotics / Cyber-Physical Systems Decision

Work in the Age of Automation?