52
Kevin Duh & 歐陽靖民 Supporting Communications in Global Networks

Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Kevin Duh & 歐陽靖民

Supporting Communications in Global Networks

Page 2: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Kevin Duh

Supporting Communications in Global Networks

Machine Translation

Page 3: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

6000 Number of Languages in the World

世界中の言語の数

Page 4: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Transportation

Telecommunications

Translation

Image courtesy of: nasa.gov

Page 5: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

MACHINE TRANSLATION

機械翻訳

There are 6000 languages in the world.

世界には6000の言語があります。

Page 6: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I will now proceed to decode. [1947]

Warren Weaver, American scientist (1894-1978)

Image courtesy: Biographical Memoirs of National Academy of Science, vol. 57

Page 7: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Rule-Based Machine Translation

(1960—now) -----------------------------

Manual encoding of linguistic knowledge

into rules

Data-Driven Machine Translation

(2000—now) -----------------------------

Exploiting Statistics

from Large Data

Page 8: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Architecture of Data-Driven Machine Translation

-------------------------------------------------------------------

Bilingual Text Data 対訳データ

There are 6000 languages in the world

世界には6000の 言語があります

Statistics 統計的学習

Probabilistic Models 確率モデル

Page 9: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

の あります 6000 言語 には 世界

the world languages 6000 in There are

あります 6000 言語 には 世界

Word Translation Model

Fluency Model

Architecture of Data-Driven Machine Translation

-------------------------------------------------------------------

Page 10: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

How to build these models?

Page 11: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Exercise: Let’s build one now!

Page 12: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

1a) evas dlrow-eht 1b) 2a) dlrow-eht si detcennoc 2b) 3a) hcraeser si tnatropmi 3b) 4a) ew eb-ot-mia tseb ni dlrow-eht 4b)

Page 13: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

1a) evas dlrow-eht 1b) 2a) dlrow-eht si detcennoc 2b) 3a) hcraeser si tnatropmi 3b) 4a) ew eb-ot-mia tseb ni dlrow-eht 4b)

dlrow-eht

dlrow-eht

3

1

Frequency

si

si

2

1

Page 14: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

1a) save the-world 1b) 2a) the-world is connected 2b) 3a) research is important 3b) 4a) we aim-to-be best in the-world 4b)

the-world

the-world

3

1

Frequency

is

is

2

1

Page 15: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

1a) save the-world 1b) 世界 を救え 2a) the-world is connected 2b) 世界 は 繋がってる 3a) research is important 3b) 研究 は 大事 4a) we aim-to-be best in the-world 4b)世界 一 を 狙う

世界 the-world

を救え the-world

3

1

Frequency

は is

繋がってる is

2

1

Page 16: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

in practice, it’s not that easy

Page 17: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Recent Research Efforts

Bilingual Text Data 対訳データ

Statistics 統計的学習

Probabilistic Models 確率モデル

What if data is insufficient?

Duh+(2010), “Analysis of Translation Model Adaptation ” Duh+(2011), “Bayesian Adaptation of Alignment Matrices”

Other Data

Other Data

Other Data

Page 18: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Recent Research Efforts

How to use Japanese-specific knowledge?

Bilingual Text Data 対訳データ

Statistics 統計的学習

Probabilistic Models 確率モデル

English: Object Verb Subject

主語 動詞 目的語 Japanese:

Visit us @ Posters 5-7 for more info

Page 19: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Recent Research Efforts

Can we translate faster?

Bilingual Text Data 対訳データ

Statistics 統計的学習

Probabilistic Models 確率モデル

Probabilistic Model as Finite State Transducer

Using technology from Speech Recognition: Hori+(2007), “Efficient WFST one-pass decoding w/ on-the-fly rescoring”

Page 20: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Killer Application for Translation?

Page 21: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Three General Scenarios

translate in

translate 2-way

translate out

Page 22: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

The Future Knowledge Worker

translate in

Social Media Breaking News

© Robert Brook

Technical Articles

Translation

Page 23: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

translate out

Export Culture: Movies Manga Apps Music …

Export Things: Cars Electronics Machinery Steel Chemicals

The entire world is your market.

Page 24: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Real-time Conversation– now

ー翻訳中ー

6000、言語の数

smartp

ho

ne

2-way

Page 25: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

How will you use translation technology?

あなたなら、

翻訳をどのようなコミュニケーションに使う?

Page 26: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I
Page 27: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Supporting Communication in Global Networks

Social Network Mining

歐陽靖民

Page 28: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Created by franckcuny@Flickr

Japanese Programmers on GitHub

Page 29: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I
Page 30: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Stanley Milgram American Social Psychologist

1933-1984

Six Degree of Separation

BBC recreating the experiment in 2009

(From Nairobi to Boston)

Page 31: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Obesity and Social Network

(Christakis and Fowler, 2007)

Happiness and Social Network

(Fowler and Christakis, 2008)

Page 32: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

500,000,000 Active Users

30 billion content shared

200,000,000 Users

65 million tweets per day

The Age of Online Social Networking

Page 33: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Social Network Mining

Page 34: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Why social network mining?

Identifying influential users in a network

Page 35: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Why social network mining?

Understanding how information spreads

^.^

^_^

I like

this!

I heard

that it is

good!

Page 36: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Why social network mining?

Making Social Recommendations

30 of your best

friends have

already bought

this!

Page 37: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Understanding

Social Networks

Page 38: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Measuring a Social Network

Example: Studying Twitter

Kwak et al. What is Twitter, a Social Network or a News Media? WWW, 2010.

Four Degree of Separation in Twitter

Page 39: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Modeling a Social Network

‘Exploring complex networks’

(Strogatz, 2001)

Small World Networks

Scale-free Networks

‘Emergence of scaling in random

networks‘

(Barabási & Albert, 1999)

Page 40: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Supporting Users

in Social Networks

Page 41: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Social

Information

Overloading

Page 42: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Supporting Users in Social Networks

Learning the relations among people

Many interactions / Similar Opinions

Few interactions / Different opinions

Page 43: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Users

participating

in the social

network

Measuring and

Modelling the

social network

New

algorithms for

supporting the

social network

Page 44: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Our Research

Page 45: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Research Question

How trust relations shape

user opinions?

How trust can be used to predict

user opinions?

Page 46: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I
Page 47: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I
Page 49: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Similarity between users

increases before and

after trust

Difference in ratings

decreases before and

after trust

Page 50: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

?

Estimating strength of relations + Predicting user ratings

=

Does he/she like this type of product?

+

Influence from different trusted friends

? ?

? ?

Page 51: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Summary

Page 52: Supporting Communications in Global Networks …...When I look at an article in Russian, I say: “This is really written in English, but has been coded in some strange symbols. I

Supporting Communication

in Global Networks