Inteligencia Cognitiva: El sexto sentido de la máquina

Technology that can perceive, learn, reason, assist in decision making, and act to help us solve problems.

Geoffrey Hinton

“The next Einstein will

be a combination of

people and machines.”

Miguel G. Corral | @miguelgcorral

Recent years…

When they talk to you

about "our IA-based solutions"

Artificial Intelligence

(simulating human intelligence)

Robotics

(hardware, mechanics)

Scary, but far in the future

Less scary, practical and now!

Cognitive Services

(custom vision, NLP,

search, etc)

Machine learning

(tools/algorithms)

Deep learning

(one type of

ML algorithm)

Valu

e

• Complete a cloud native platform.

• Create organization that develops and runs the cloud platform

• Integrate with current IT

• Bring additional workloads live

• Establish workload management (intakes, backlog, priorities) SCALE

Visible AIMatureFoundational AspirationalApproaching

I don’t understand my data and my model

It’s difficult to retrain my old model

My enterprise compliance standards require the highest levels of X

It’s difficult to replicate the training environment in the model hosting environment

It’s difficult to scale up and out with really large workloads

It’s difficult to ingest, track and leverage my data

It’s hard to get started with AI

There are many personas

and ways to do ML

It is hard to integrate AI into my existing processes

Time

Explainable Autonomous AI Systems

Why is it special?

Ingest Store Prep & train Evalutation Serve

No expert machine-

learning requiredAll it takes is an API call to

embed AI

{

"status": "Succeeded",

"succeeded": true,

"failed": false,

"finished": true,

"recognitionResults": [

{

"page": 1,

"clockwiseOrientation": 358.85,

"width": 1000,

"height": 945,

"unit": "pixel",

"lines": [

{

"boundingBox": [

249,

268,

671,

259,

672,

308,

250,

316

],

"text": "You must be the change you",

"words": [

{

"boundingBox": [

259,

268,

307,

267,

310,

Deep Learning: Feature Extraction

Machine Learning vs Deep Learning

Language

Vision

Speech

Decision

The most comprehensive pre-trained AI

The most comprehensive pre-trained AI

Web search

Bing Autosuggest

Give your app intelligent autosuggest options for searches

Bing Search

Web SearchImage SearchNews SearchVideo Search

Create a highly-customized web search experience

Enrich user experiences with contextual entity search results

Bing Entity Search

Bing Custom Search

Bing Visual Search

Get rich insights to help build

compelling image applications on

the device of your choice

Find local business results in your place of interest

Bing Local Business Search

The most comprehensive pre-trained AI

Vision

Custom Vision

Video Indexer

Process and extract smart insights from videos

Customizable web service that learns to recognize

specific content in imagery

Computer Vision

Distill actionable information from images

Face

Detect, identify, analyze, organize, tag faces in photos, and even recognize emotions

Ink Recognizer

Recognize digital ink and handwriting

Form Recognizer

Extract text, key-value pairs, and tables from documents

The most comprehensive pre-trained AI

Language

Language Understanding

Teach your apps to understand commands from your users

Text Analytics

Detect sentiment, key phrases, language, and extract

top entities from your text

Bing Spell Check

Detect and correct spelling mistakes within your app

Easily perform speech and text translation

Translator Text

QnA Maker

Distill information into conversational, easy-to-

navigate answers

Inmersive Reader

Embed inclusive capabilities into your apps for users

regardless of age or ability

QnA Maker

Map complex information

and data in order to solve

specific tasks

Text Analytics

Extract data

from any text

Natural Language Processing

The most comprehensive pre-trained AI

Speech

Speaker Recognition

Use speech to identify and

verify individual speakers

Speech CustomizationSpeech Service

The customization capabilities of Speech

Services can help you improve the

accuracy of speech services.

Unified Speech service for general

use:

Speech-To-Text

Text-To-Speech

Translator Speech

Custom Speech

Custom Voice

Custom Translator

Speech

The most comprehensive pre-trained AI

Decision

Anomaly Detector

Monitor business health in real-time

Conduct IoT-remote monitoring

Content Moderator

Machine-assisted moderation of text and images, augmented

with human review tools

Personalizer

Deliver rich personalized experiences in your apps

Metrics Advisor

Protect your organization’s growth

by proactively monitoring metrics

and diagnosing issues

Root-cause analysis

Anomaly detection

Personalization

Sentiment analysis

Intent understanding

Text and document translation

Q & A creation

Speaker recognition

Speech to text

Entity extraction

Vision Speech Language Decision

Metric monitoring

Image understanding

Image captioning

Video indexing

Text extraction

Facial recognition

Form recognition

Spatial analysis

Text to speech

Custom neural voices

Speech translation

Content Moderator

Anomaly Detector

Personalizer

Language Understanding

Text Analytics

Text and document Translation

QnA Maker

Speaker Recognition

Speech

Customizable

Immersive Reader

Vision Speech Language Decision

Metrics Advisor

Computer Vision

Face

Video Indexer

Custom Vision

Form Recognizer

Deploy anywhere using containers

Azure Cognitive Services Wherever your data resides

Vision Speech

Language Decision

Improve interaction

between people and

processes

Extend human capacity

and knowledge for

decision making

Simplify and

optimize repetitive

tasksInteraction Amplify Automation

Impact of Cognitive Services

Information, Knowledge

& Intelligence

Understanding the latent value in all content

AI is here to help Text

(1) Validate enrichment pipeline

Tags

“throwing”, “ball”, “girl”, “grass”, “basketball”

Caption

“A girl throwing a ball”

Entities:Person(s)“Anita Christiansen”,“Conrad Nuber”,

Location(s) “Bothell”, “Woodinville”

Organization(s) “Litware Insurance Corp.”

Going beyond Search

0 Results Any time

I’m sorry… this isn’t a question that can be answered with search….

Show change in price over time

management free

keyword search

faceting

language analyzers

geospatial support

suggestions/auto-complete

customizable scoring

proximity search

synonyms

complex types

etc.

Azure Cognitive Search

Search-as-a-Service

At a high level…

Data in any format,

any Azure store

Annotations

Cognitive skills Search

Ingest Enrich Explore

Cognitive Search Architecture

Customer

Data

Document Cracking

Third Party Enrichers

Cognitive

Skill

Annotated

Documents

Indexing

For Search

Search

Index

Cognitive Search Architecture

Customer

Data

Document Cracking

Third Party Enrichers

Cognitive

Skill

Annotated

Documents

Indexing

For Search

Search

Index

Document Cracking

Different types of data sources Azure Blob Storage

Azure SQL

Azure Cosmos DB

Azure Table Storage

ADLS Gen2

File formats supported in blob storage PDF

Microsoft Office formats: DOCX/DOC, XLSX/XLS, PPTX/PPT,

MSG (Outlook emails)

HTML

XML

ZIP

EML

RTF

Plain text files (see also Indexing plain text)

JSON (see Indexing JSON blobs)

CSV (see Indexing CSV blobs preview feature)

Text

Images

Metadata

Cognitive Search Architecture

Customer

Data

Document Cracking

Third Party Enrichers

Cognitive

Skill

Annotated

Documents

Indexing

For Search

Search

Index

Built-in Cognitive SkillsOCR, Key Phrase Extraction, People Names,

Company Names, Sentiment Analyzer, Computer

Vision, etc.

Third Party EnrichersCustom classification models, Custom entity

extraction, etc.

Natural Language ProcessingKey Phrase Extraction Sentiment AnalysisOrganization Entity ExtractionLocation Entity Extraction Persons Entity ExtractionLanguage DetectionText Translation

Image ProcessingFace DetectionTag ExtractionCelebrity RecognitionLandmark DetectionHandwriting RecognitionPrinted Text Recognition

UtilitiesComplex Type ShapingText MergingText SplittingConditional Skill

Built-in Skills in

Multiple

Languages

OCR (text

recognition)

content

normalized

images

language

tags

orgscontent

content

SkillsetYou can create enrichment chains

…,

{

"@odata.type": "#Microsoft.Skills.Text.NamedEntityRecognitionSkill",

"categories": [ "Organization" ],

"defaultLanguageCode": "en",

"inputs": [

{ "name": "text", "source": "/document/content" },"name" "languageCode" "source" "/document/myLanguageCode"

],"outputs":[

{ "name": "organizations", "targetName": "organizations" }

]

},

Skillset

content

normalized

images

language

tags

orgscontent

content

SkillsetYou can create enrichment chains

…,

{

"@odata.type": "#Microsoft.Skills.Custom.WebApiSkill",

"uri" "https://myskill.azurewebsites.net/api/OrgId"

"context": "/document/organizations/*" ,

"httpHeaders": {"Api-Key": "mySecret" },

"inputs": [

{ "name": “organizationName", "source": "/document/organizations/*" },

],"outputs":[

{ "name": "organizationId", "targetName": "organizationId" }

]

},

Skillset

{

"values": [

{

"recordId": "7cad2",

"data":

{

"myOuput1": “animals"

}

},

{

"recordId": "7cad3",

"data":

{

"myOutput1": “colors"

}

},

…

]

}

{

"values": [

{

"recordId": "7cad2",

"data":

{

"myInput1": "fox","myInput2": "cat",

}

},

{

"recordId": "7cad3",

"data":

{

"myInput1": "blue",

"myInput2": "red",

}

},

…

]

}

Extend with your own skills…Well defined input/output schema

Built-in skills

Location entity extraction

Persons entity extraction

Celebrity recognition

Landmark detection

Sentiment analysis

Language detection

Image tag extraction

Printed text recognition

Key Phrase extraction

Organization entity extraction

Face detection

Text Utilities Azure Databricks

Machine LearningVMs

Azure Machine Learning

Custom skills

Your custom

skill goes here!

Custom Skills

Azure Machine

LearningAzure Container

Service

Azure Function

Framework

Cognitive Search Architecture

Customer

Data

Document Cracking

Third Party Enrichers

Cognitive

Skill

Annotated

Documents

Indexing

For Search

Search

Index

Mapping To Index Fields

New Indexer Property

{…"outputFieldMappings": [

{"sourceFieldName":

"/document/organizations/*/organizationId","targetFieldName":

"orgIds"} ,…

] }

Cognitive Search Architecture

Customer

Data

Document Cracking

Third Party Enrichers

Cognitive

Skill

Annotated

Documents

Indexing

For Search

Search

Index

Knowledge

Store

Uncover latent insights from all your content

Ingest Extract

experience 2

3

1

document

primaryImage

secondaryImage

job

company

duration

job

company

duration

job

company

duration

Ingest

Candidates with 5 years experience

Extract Search

experience 2

3

1

document

primaryImage

secondaryImage

job

company

duration

job

company

duration

job

company

duration

Candidates with 5 years experience

Ingest Extract Search

Knowledge store

Store

experience 2

3

1

document

primaryImage

secondaryImage

job

company

duration

job

company

duration

job

company

duration

Predict with Azure

Machine Learning

Infuse into your applications

Visualize with Power BI

Extract Store

experience 2

3

1

document

primaryImage

secondaryImage

job

company

duration

job

company

duration

job

company

duration

Ingest

Knowledge store

© Copyright Microsoft Corporation. All rights reserved.