1 Overview of Component Search System SPARS-J Tetsuo Yamamoto*,Makoto Matsushita, Katsuro Inoue...

Overview of Component Search System SPARS-J

Tetsuo Yamamoto*,Makoto Matsushita**, Katsuro Inoue**

*Japan Science and Technology Agency**Osaka University

2Software Engineering Laboratory, Department of Computer Science, Graduate School of Information Science and Technology, Osaka University

OutlineMotivation and research aimSPARS-J

OutlineSystem architectureRanking methodEach part

Analysis partRetrieval partUser Interface

ExperimentConclusion and Future work

MotivationReuse of Software Components

is a technique of developing new software components by using the components developed in the past.

Example of reusable components: source code, document …..improves productivity and quality, and cuts down development cost as a result.

However, reuse of components is not utilized effectively.A developer doesn’t know existence of desirable components.Although there are a lot of components, these components are not organized.

In order to take advantage of reuse, it is required to manage components and search suitable component easily

Research aimWe have built the system which have functions as follows

Collects software components eagerly without preserving their inherent structuresManages the component information automaticallyProvides component be suitable for User’s request

TargetsIntranet

closed software development inside a companyInternet

Large open source software development web site– SourceForge, Jakarta Project. etc.

SPARS-J(Software Product Archive ， analysis and Retrieval System for Java)

Java Software Product Archiving, analyzing and Retrieving System

Many components are analyzed automatically. A search engine is built based on the analysis information.Component: a source code of class or interface

FeaturesKeyword searchTwo ranking methods

Frequency in use of a wordUse relation

Analyzed informationComponents using/used by a componentPackage hierarchy

Structure of SPARS-J

Component analysis part・ extract components from a file・ store analyzed information to DB・ clustering and rank components using DB

Database

Analyzedinformation

・ store analyzed information and component

Component retrieval part・ search components in correspondence with query from DB・ rank components based on frequency in use of a keyword・ aggregate two rankings

User interface partQuery

Result

・ deliver query to component retrieval part・ show search results 　

QueryHit components

Library(Java source files)

Componentinformation

Ranking search resultsRanking method

1. Component suited to a user request– Ranking based on frequency in use of a word

2. Component used mostly– Ranking based on component use relation

We make it high ranking that the component both 1 and 2 are high

Search results are shown to aggregate two ranks

Keyword Rank (KR)

Component Rank (CR)

Component analysis part

Extract component and its information from a Java source fileThe process

Extract a componentIndex the componentExtract use relationsClustering similar componentsRank components based on use relations (CR method)

Extract and index a component

Extracting componentFind class or interface block in a java source file

Location information in the file (start line number, end line number)

IndexingExtract index key from the component

Index key ： a word and the kind of itNo reserved words are extracted

Count frequency in use of the word

word kindSort Class namequicksort Commentquicksort Method

namepivot Variable

namequicksort Method call

：：Index key

public final class Sort { /* quicksort */ private static void quicksort(…) { int pivot; ： quicksort(…); quicksort(…); }}

11112：

frequency

Extract use relationsExtract use relations among components using semantic analysisMake component graph from use relations

Node: componentEdge: use relation Inheritance

Interfaceimplementati

onVariable type

Instance creation

Field accessMethod callThe kind of use relation

public class Test extend Data{ ： public static void main(…) { ： Sort.quicksort(super.array); ： }}

TestComponent graph

InheritanceField access

Method call

Similar componentSimilar component is copied component or minor modified componentWe merge similar components into single componentMerged component have use relations that all component before merging have

EComponent graph

Clustered component graph

Clustering componentsWe measure characteristics metrics to merge componentsThe difference ratio of each component metrics

Metricscomplexity

– The number of methods, cyclomatic, etc. – represent a structural characteristic

Token-composition– The number of appearances of each token– represent a surface characteristic

Ranking based on use relation

Component Rank (CR)Reusable component have many use relation

The example of use is muchGeneral purpose componentSophisticated component

We measure use relation quantitatively, and rank components

The component used by many components is importantThe component used by important component is also important

Katsuro Inoue, Reishi Yokomori, Hikaru Fujiwara, Tetsuo Yamamoto, Makoto Matsushita, Shinji Kusumoto: "Component Rank: Relative Significance Rank for Software Component Search", ICSE, Portland, OR, May 6, 2003.

Propagating weights

0.34 0.33

0.330.33

Ad-hoc weights are assigned to each node

Propagating weights

0.33 0.17

0.170.5

The node weights are re-defined by the incoming edge weights

Propagating weights

0.5 0.175

0.1750.345

We get new node weights

Propagating weights

0.4 0.2

0.20.4

• We get stable weight assignment next-step weights are the same as previous ones

• Component Rank : order of nodes sorted by the weight

Component retrieval part

Search components from database, rank components The process

Search componentsRanking suited to a user requestAggregate two ranks (CR and KR)

Search componentsSearch query

Words a user inputThe kind of an index word, package name

Components contain given query are searched from Database

Ranking suited to a user request

Keyword Rank (KR)Components which contain words given by a user are searchedRank components using the value calculated from index word weight Index word weight

– Many frequency in use of a component– A word contained particular components– A word represent the component function such as Class

nameSort the sum of all given word weightTF-IDF weighting using full-text search engine

Calculation of KR valueCalculate weight Wct with component c word tTFi： The frequency with which a kind i of word t occurs in component c IDF： the total number of components / the number of components containing word tkwi： Weight of a kind i

KR value is the sum of all word Wct

kindall

iict IDFTFkww ) (

the kind of a word

weight

Class name 200Interface name 50Method name 200Package name 50

Import 30Method call 10Field access 10Variable type 10

Instance creation

Local var access 1Comment 30

Doc comment 50Line comment 10

String 1

Aggregate two ranksAggregate two ranks KR and CRAggregation method

Borda Count method known a voting systemUse for single or multiple-seat electionsThis form of voting is extremely popular in determining awards

SPARS-JRank components both KR and CRUsing KR and CR, the component that be suitable user’s request, reusable and sophisticated

Borda Count methodThere are 10 voters and 5 candidates (from A to E) Each voter rank candidates1 point for last place, 2 points for second from last place …, and N points for first place1st=5points ， 2nd=4points ，…

A ： 15+3+6+4=28pointsB ： 38pointsC ： 38pointsD ： 22pointsE ： 26points

3 A B C D E

3 E B C D A

2 C B A E D

2 C D B A E

B C A D E

Aggregation

User interfaceReceive a user’s query and provide the search results through Web browser

Microsoft Internet Explore, Mozilla, etc.

The processParse query word and the search conditionShow rank ordered resultsShow analyzed information of the component

Used by/Using the componentMetrics

Analyzed informationA component information are as follows

MetricsThe number of method, variableLOC, cyclomaticEtc. (measurable metrics in the component itself)

Components used by/using the componentShow lists of nodes followed use relation

Components that are similar to the component

Show lists of similar components

Package browsingThe naming structure for Java packages is hierarchical

A user can search lists of components in same package of a component easily

Screenshot (top page)

Screenshot (search results)

Screenshot (source code)

Screenshot (similar components)

Screenshot (using the component)

Screenshot (used by the component)

Screenshot (package browsing)

Experiment(1/2)Comparison with Google

Register about 130,000 components get from InternetQuery words ‘calculator applet’ and ‘chat server client’

Calculate relevance ratio of 10 rank higherRelevance: The component is reusable source code

Google is a web search engine…Add ‘java source’ term to the query wordsFollow one link from the result web page

Experiment(2/2)Example 1 ：

”calculator applet”SPARS-J

9 hits7 suited components

Example 2 ：”chat server client”SPARS-J

69 hits57 suited components

Using SPARS-J, suited component is high order

orderrank componentrelevant ofnumber Theratio relevance

SAPRS-J Google SPARS-J Google

Relevance

Ratio Relevance

1 ○ 1 ○ 1 ○ 1 × 0

2 ○ 1 × 0.5 ○ 1 × 0

3 ○ 1 ○ 0.67

○ 1 × 0

4 ○ 1 × 0.5 ○ 1 × 0

5 ○ 1 ○ 0.6 ○ 1 × 0

6 × 0.83

○ 0.67

○ 1 × 0

7 ○ 0.86

× 0.57

○ 1 ○ 0.14

8 × 0.75

○ 0.63

○ 1 × 0.13

9 ○ 0.78

× 0.56

○ 1 ○ 0.22

10 - - × 0.5 ○ 1 ○ 0.3

Example1 Example2

Conclusion and Future work

We developed component search engine SPARS-JUsing SPARS-J, retrieval of components used well is enabled easily.

Future workMorphological analysis of Index keywordCollaborative filteringInvestigate best ranking method

The value of weightAggregation ranks

Evaluation of SPARS-JUsability

Component graph

System X System Y

componentuse relation

Weight of nodes

System X System Y

sum of all node weights = 1 ... (1)weight of node represents significance of node

0.10.1

0.1 0.1

0.050.05

1 w(x) 0

Weights of edges

d=1/4d=1/4d=1/4

d: distribution ratio• Node weight is distributed to each outgoing edge• Edge weights are collected at the destination node

sum of all outgoing edge weights = origin node weight ... (2)sum of all incoming edge weights = destination node weight ... (3)

Definition of weightsUnder constraints (1)~(3), we have a simultaneous equation

dddddd

Dt: transposed matrix of distribution ratios

W: node weight vectorThis simultaneous equation can be solved by propagating node weight through edges in the graph

Pseudo use relation

• Weight computation does not always converge

• Add a pseudo edge from a node to another, if there is no 'real' edge

• Distribution ratios: pseudo edges << real edges

Markov model

• Component rank model can be considered as a Markov Chain of user's focus

• User's focus moves from one component to another along a use relation at a fixed time duration

• Node weight represents the existence probability of the user's focus at infinite future

0.02 0.01

0.030.05

0.001 0.1

Related WorksMarkov models of documentation traversal

Influence Weight: impact factor of journal publication thought incoming referencesPage Rank: weight of HTML in the Internet through incoming web links

Explicit use relationsNo clustering (important for software products)

Measurement reusability of components or interfaces

Use various characteristic metrics Indirect indicator of reusability Our approach directly reflects usage of components

部品群グラフをもとにした繰り返し計算計算手順1. 各頂点に適当な重みを与える

– 重みの総和は 1 2. 各有向辺の重みを求める

– 頂点の重みを，出ていく辺で分配する3. 各頂点の重みを再計算

– 頂点に入ってくる辺の重みの総和を，その頂点の重みとして再定義する4. 頂点の重みが収束するまで， 2.3. を繰り返し計算する5. 収束した頂点の重みを，その頂点に対応する部品群の CR 値とする

– 部品の評価値は属する部品群の CR 値とする

C10.334

C20.333

C30.333

C10.334

C20.333

C30.333

v1×50%

v1×50%v2×100%v3×100%

0.1670.3330.333

C10.333

C20.167

C30.500

0.1665

0.16650.1670.500

C10.500

C20.1665

C30.3335

C10.400

C20.200

C30.400

0.2000.2000.400

CR 値の計算

1 Overview of Component Search System SPARS-J Tetsuo Yamamoto*,Makoto Matsushita, Katsuro Inoue...

Documents

Naoko Kanaeda and Tetsuo Deguchi- Universality in the diffusion of knots

Catalogue Tetsuo HARADA Espace-Calende.fr 2013

Leonardo Tetsuo Yamaguchi

Spars and derricks Capt. K. De Baere. Spars Rondhouten Espars

Antología de la poesía japonesa contemporánea-Tetsuo Nakagami y Yutaka Hosono

Kyoto Univ. RIKEN Katsuro Nakamura (Kyoto University) 2012/ 2/ 13 Kyoto University GCOE Symposium 2012/2/131 Kyoto University GCOE Symposium

杉山哲雄ピアノリサイタルTETSUO SUGIYAMA PIANO RECITAL ベートーヴェン・チクルス Ⅰ ～中期のベートーヴェン～ベートーヴェン L.v.Beethoven

I C F.O. USP1 BIBLIOGRAFIA PREPAROS DENTÁRIOS FUNCIONAIS Tetsuo Saito FUNDAMENTOS DOS PREPAROS DENTÁRIOS(Edição do Estudante) Shillingburg/ Jacobi/ Brackett

Sommerfest: Kinderweihnachtsfeier: Sonntag, 12. Juni, 15-18 Uhr, … · 2016. 1. 20. · -Holzwerkstatt für Kinder und Jugendliche ab 10 Jahren: Holzwerken zurn Spars, für den eigenen

SPARSgsars.org/wp-content/uploads/2016/06/RUS-SPARS-FINAL-080616.pdf · asse3 Пример swot анализа в Танзании 122 plan1 Сообщения для информационно-разъяснительной

1 Model Evolution with Aspect-oriented Mechanisms Naoyasu Ubayashi (Kyushu Institute of Technology) Tetsuo Tamai (University of Tokyo) Shinji Sano, Yusaku

FUNDAÇÃO UNIVERSIDADE FEDERAL DE RONDÔNIA EFETIVAÇÃO DA... · Professor Mestre Silvério dos Santos Oliveira ... Professor Mestre Gilson Tetsuo Miyakava ... possível vencer

Forças intermoleculares, sólidos e líquidos Carlos Tetsuo Ito – 15723 Bruno Mendonça Grilo - 15720

Publication & Presentation List of Tetsuo Hanaguri (Jan ... · Publication & Presentation List of Tetsuo Hanaguri (Jan. 15, 2019) Refereed articles 1. “Ultrathin Bismuth Film on

Präsentation Forum Wohnstandort Teil 2 - Wuppertal€¦ · TEIL 2 Präsentation 16.06.2015 5. Forum Wohnstandort Wuppertal. ÖKONOMIE DES PLANENS UND BAUENS PROF. DR. GUIDO SPARS

books, Tetsuo Kobayashi (Prof.) selects Principles …...2012/03/28 · books, Tetsuo Kobayashi (Prof.) selects. Book Selection Oct.24-Nov.13 2011 Kyoto University Library Principles

Overview and Evaluation of Java Component Search System SPARS-J

1 Overview and Evaluation of Java Component Search System SPARS-J Reishi Yokomori , Hideo Nishi, Fumiaki Umemori**, Tetsuo Yamamoto*, Makoto Matsushita**,

Jelly Roll Inspirationsjellyrollsfabric.com/.../uploads/2013/10/Jelly-Roll-Inspirations-3.pdf · Jelly Roll Inspirations Part Three: Diagonals Compiled By Liz Katsuro Karen W.’s

Shigeru Kimura Tetsuo Morikawa Han Phoumin

1 Overview of Component Search System SPARS-J Tetsuo Yamamoto*,Makoto Matsushita**, Katsuro Inoue**...

1 Overview of Component Search System SPARS-J Tetsuo Yamamoto*,Makoto Matsushita, Katsuro Inoue...