29
Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering) Mark Ackerman (University of Michigan, School of Information and Department of Computer Science and Engineering) 1/25 MobileHCI 2014, Toronto

Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Embed Size (px)

Citation preview

Page 1: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Understanding Local-ness of Knowledge

Sharing:A Study of Naver KiN

“Here”

Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)Mark Ackerman(University of Michigan, School of Information and Department of Computer Science and Engineering)

1/25

MobileHCI 2014, Toronto

Page 2: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Social Q&AConventional Q&A

Social Q&A has been widely used for information seeking

2 /25

Page 3: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Social Q&ALocation-based Q&A

“Please recommend me a good Korean restaurant near Hyatt Re-gency Toronto.”

Seeking location-based information via local experts

3 /25

Page 4: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Related Work Conventional social Q&A analysis• Question topic/type• User behavior patterns• Motivations

Location-based Q&A services analysis• Research prototypes for design exploration• Small scale user studies

4 /25

Page 5: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Research Motivation Previous studies focused on• Conventional Q&A analysis• Small-scale feasibility tests on location-based Q&A ser-

vices

Our research goal• Understanding localness of knowledge sharing with• Real-world dataset• Geographical analysis

5 /25

Page 6: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Research Questions RQ1) Are topical/typological patterns related to ge-ographic characteristics, and how?

RQ2) How are users geographically focused in their asking/answering activities?

RQ3) What are the answer motivations that are unique in location-based social Q&A?

6 /25

Page 7: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

InteractionNaver KiN “Here” (Asking)

7 /25

My location

Search

Page 8: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

InteractionNaver KiN “Here” (Answering)

8 /25

My Regions of Interest

Page 9: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Methodology Crawled dataset from Naver KiN “Here”

- Dec 17, 2012 ~ Dec 31, 2013 (13 months)- 508,334 questions / 567,156 answers

Online survey- 285 users participated (Aug, 2013)- Questionnaire is composed of two parts• The number of selected regions of interests, A list of those names as well as the reason for each choice• Motivation answered questions (open-ended)

9 /25

Page 10: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Research Questions RQ1) Are topical/typological patterns related to geographic characteristics, and how?•What kinds of questions topics?•What kinds of questions types?

RQ2) How are users geographically focused in their asking/answering activities?

RQ3) What are the answer motivations that are unique in location-based social Q&A?

10 /25

Page 11: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Topical/Typological patternsTopic distribution

11 /25

Lifestyle and Travel were dominant

ICT and Game were minimal

(Naver KiN “Here”) (Naver KiN)

Page 12: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Topical/Typological PatternsTopic distribution of top 10 cities/districts

Top 10 Cities Top 10 Districts in Seoul

12 /25

The geographic characteristics were well reflected

The topical distributions were largely dependent on the size and functional complexity of the region

Page 13: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Topical/Typological PatternsTypological distribution

Location-basedSocial Q&A

(Naver KiN “Here”)

Information is dominant in location-based social Q&A

13 /25

Conventional Q&A(Yahoo! Answer)

(Kim, 2007)

Opinion

Information

Suggestion

Other

6.4%

72.2%

17.9%

3.5%

opinion

Information

Suggestion

Other

39.0%

35.0%

23.0%

3.0%

Page 14: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Research Questions RQ1) Are topical/typological patterns related to ge-ographic characteristics, and how?

RQ2) How are users geographically focused in their asking/answering activities?• The degree of geographic focus• Granularity of spatial locality• Categories of regions of users’ interest?

RQ3) What are the answer motivations that are unique in location-based social Q&A?

14 /25

Page 15: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Geographical FocusMeasuring geographic focus

Entropy = -

15 /25

0

City A City B

0.6251

City DCity C

2

Page 16: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Geographical FocusEntropy comparison btw asking and answering

16 /25

Askers’ activities typically spanned multiple districts/cities (Mean=3.5/2.5)

Answerers’ activities focused on multiple districts in a few cities (Mean=2.6/0.8)

Page 17: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Geographical FocusMeasuring granularity of spatial locality

17 /25

Primary cluster:User’ main focus

MCD:Mean Contribution Distance

Page 18: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Geographical FocusSpatial cluster analysis

0.00

0.25

0.50

0.75

1.00

0 5 10 15 20MCD of Primary Clusters

CD

F

minPts 10 minPts 5 minPts 1

0.00

0.25

0.50

0.75

1.00

0 1 2 3 4 5# of Clusters

CD

F

minPts 10 minPts 5 minPts 1

18 /25

More than 75% of users geographically focused on 1~2 clusters

The primary cluster covered a few nearby districts (Mean=2.3Km, minPts=1)

(km)

Page 19: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Geographical FocusRegions of interest

0

20

40

60

80

0 5 10 15 20 25# of Regions of Interest

# o

f u

sers

Users’ regions of interests were:• Home (93.7%)• Work/School (23.9%/28.9%)• Downtown (24.6%)

19 /25

Regions of interest is closely related to life experience

Mean=2.9SD=3.2

Page 20: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Research Questions RQ1) Are topical/typological patterns related to ge-ographic characteristics, and how?

RQ2) How are users geographically focused in their asking/answering activities?

RQ3) What are the answer motivations that are unique in location-based social Q&A?• Are there unique motivations related to localness?

20 /25

Page 21: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Answer Motivations1. Knowledge exchange (24.9%)2. Altruism (18.2%)3. Ownership of local knowledge (10.1%)4. Points (9.8%)5. Pastime (9.2%)6. Sense of community (7.0%)7. Business promotion, learning, etc.

21 /25

Page 22: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Answer Motivations:Ownership of local knowl-edge

Because I know everything about my town as I have lived in my town for a long time

- Ownership of local knowledge -

22 /25

I think kind and sincere answering is one of the rep-resentative images of the area, and I want to build a good image of my area.

- Sense of community -

Page 23: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

DiscussionDesign implications

Leveraging topical/typological patterns• Filtering location-based questions by topics • Local search by archived factual information Q&A dataset

Leveraging the geographical activity analyses• Extending the radius of questions notification• Recommending neighboring districts for subscribing

Motivating user contributions based on localness• Community-level symbols such as badges• Regional competition such as ranking

23 /25

Page 24: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Conclusion Topical/typological patterns• In general, lifestyle and travel were dominant• The geographic characteristics were well reflected• Information is dominant

Geographical focus• Askers’ activities typically spanned multiple districts/cities • Answerers’ activities focused a very few cities• A primary clustered region covered a few nearby districts

Unique motivators • Ownership of local knowledge• A sense of community

24 /25

Page 25: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

Understanding Localness of Knowledge Sharing:

A Study of Naver KiN “Here”

Sangkeun Park, Yongsung Kim, Uichin Lee(KAIST, Knowledge Service Engineering)

Ackerman Mark S.(University of Michigan, School of Information and Department of Computer Sci-ence and Engineering)

25 /25

Page 26: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

26

Type Manual Coding Randomly selected 1000 questions Coded by two external raters.

◦ 200 questions together◦ separately coded the remaining 800 questions (i.e. 400

questions each).◦ Cohen’s Kappa: 0.84 - substantial agreement.

Page 27: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

27

Categorization Extracted keywords from title

Searched the extracted keywords on Naver KiN which is a topic-based Q&A service

In the top 100 results, most frequent topic was selected as a topic of the questions

Manually coded the topics of 100 randomly selected ques-tions, then, inter-rater agreement: k = 0.87

Page 28: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

28

Geographical Focusbehavioral difference by geo-graphical focus

0

1

2

3

0 2 4 6City-level Entropy

To

pic

En

tro

py

GF: Geographically Focused (81%)

GS: Geographically Scattered (19%)• The active web searchers• The province-level experts

GF Group GS Group

Page 29: Understanding Localness of Knowledge Sharing: A Study of Naver KiN “Here” Sangkeun Park, Yongsung Kim, Uichin Lee (KAIST, Knowledge Service Engineering)

29

Geographical FocusSpatial cluster analysis

0

1

2

3

4

5

0 2 4 6City-level Entropy

Clu

ster

-lev

el E

ntr

op

y (m

inP

ts=

1)

A majority of users focused on one cluster