1 /106O /1070

US006223347B1

(12) United States Patent Watanabe et al.

US 6,223,347 B1 Apr. 24, 2001

(10) Patent N0.: (45) Date of Patent:

(54) DATA DISPLAY CONTROL APPARATUS

(75) Inventors: Shigeaki Watanabe, Kyoto; Kazutoshi Sumiya, Nishinomiya; Kiyokazu Yamanaka, Ashiya; Yuki Kusumi,

7/1996 Gibson. 10/1996 K0 et al. .

5,539,871 5,566,293

FOREIGN PATENT DOCUMENTS

Kashiba; Masahiro Oashi, Hirakata; 827336 3/1998 (EP) _ Tatsuya Shimoji; Masayuki Kozuka, 2728089 11/1995 (FR) _ both of NeyagaWa; Yoshihiro Mimura, 39393 1/1991 (JP) _ Hirakata; Yoshiyuki Miyabe, Osaka; 789267 1/1991 (JP) _ Kazuo Okamura, Hirakata; Takashi 4274553 9/1992 (JP) _ Kakiuchi, Toyonaka; J unichi Hirai, 8241065 9/1996 (JP) _ Suita; Naoya Takao, Kadoma; Toshiya 9525213 9/1995 (W0) _ Mori, Settsu; Ikuo Minakata, Souraku, 95/25313 * 9/1995 (WO) ........................... .. G06F/17/30 all of (JP) 9619077 6/1996 (WO) .

_ _ _ _ 9708837 3/1997 (WO) .

(73) AssIgnee: Matsushlta Electric Industrial Co., 9712342 4/1997 (W0) _ Ltd» Osaka (JP) 9737736 10/1997 (WO) .

( * ) Notice: Subject to any disclaimer, the term of this * _ d b _ patent is extended or adjusted under 35 Cue y exammer

U.S.C. 154(b) by 0 days.

' Primary Examiner—John W. Miller (21) Appl' NO" 08/928’010 (74) Attorney, Agent, or Firm—Price and Gess

(22) Filed: Sep. 11, 1997 (57) ABSTRACT (30) Foreign Application Priority Data

Adata display control apparatus receives a digital broadcast Sep. 11, 1996 (JP) ................................................. .. 8-240297 _ _ _ _ _ _

and compares the present time With a time indicated In a 7 .

Int. Cl. .............................. .. TimeiEVentiPart provided in navigation information used

(52) US. Cl. .............. .. 725/139; 725/140; 725/142 to Control the dis 1a of the multimedia data Com 05in a (58) Field Of Search ............................... .. 348/552, 906, p y _ _ _ p g

348/12; 345/327; 709/219 broadcast program. When the Indicated time has been _ reached, the data display control apparatus executes instruc

(56) References Clted tions to control the display of the multimedia data.

U.S. PATENT DOCUMENTS

5,195,134 3/1993 Inoue _ 21 Claims, 38 Drawing Sheets

/1000 DATADISPLAYCONTROLAPPARATUS l 1010 1020 1030

TS DECODER UNIT AV DECODER UNIT RECEPTION UNIT

1040 11111101111101 11111111111111 C1031 / 1 1021

RECEIVEDDATASTORAGBUNIT STREAMCORRIgSTKIJétIADSENSEI A050 (1 /106O /1070

/ INFORMATION 1041 - RECEPTIONCONTROLUNIT REPRODUCTION DISPLAY

NAVIGAIIONINFORMAIION _) IT __> UNIT / 00110111111 BYTECODEER UN

1042 SYSTEM INFORMATION INTERPRET /l080 / STORAGEUNIT 1051 AUDIO OUTPUT

1043 TlMEixlélgOgwTloN UNIT /STOR 101g SIGNAL RECEPTION #1100

UNIT

U.S. Patent Apr. 24, 2001 Sheet 2 0f38 US 6,223,347 B1

FIG. 2

210

MAIL ORDER 211

VIDEO

STEREO

212

220 230

STEREO

5Q 100000 MENU

221 231

U.S. Patent Apr. 24, 2001 Sheet 3 0f38 US 6,223,347 B1

moooomw OmQQ/ mmm

mmDmO 1:32 m .05

U.S. Patent Apr. 24, 2001 Sheet 4 0f38 US 6,223,347 B1

@NN 8N

@NN 3N mmm

@NN 3N mmm

mmm

-. ZQFEEQEH zoE<oH><z

3N 3mm 2w Maw 515

_ _-_____-___-L-_________________4-..-_____

v .05

U.S. Patent Apr. 24, 2001 Sheet 6 0f38 US 6,223,347 B1

FIG. 6

NE_iCl 0 l / 216

Bytecode_Part 301 BYTE CODE NO. BYTE CODE

0 PushL0,GotoPage 1 PushLl ,GotoPage

HandIer_Part 302

HANDLLER NO. BYTE C(SJDE NO. 1 I

303 Graphics_Property_Part GRAPHICS ND. TYPE COORDINATES HANDLER N0. INITIAL STATE

0 BUTTON (20,20) 0 Visible 1 BUTTON (20.60) I Visible

itmap_Inf0rmation_Part 304 INUMBER O 1

com IVIDEOI [STEREOJ

Hyperlink_Informati0n_Part 305 LINK NO. LINK DESTINATION MATERIAL ID

0 NE_id : 1, VE_id = 1 1 NE_id : Z, VE_id : Z

U.S. Patent Apr. 24, 2001 Sheet 8 0f38 US 6,223,347 B1

FIG. 8

2100

2110 MAIL ORDER

VIDEO

STEREO

2120

2200 2300

STEREO

:18 100000 MENU

19909.9,15200200' 2210 2310 /2130

THIS OFFER IS NO LONGER VALID

Z131

U.S. Patent Apr. 24, 2001 Sheet 11 0f38 US 6,223,347 B1

FIG. 11

NE_id 0 l /216O

Time_Event_Part 2161 ACTIVATE TIME HANDLER NO. 1996.9.9,15 I 00 I 00 2

Bytec0de_Part / 2162 BYTECODE NO. BYTECODE

0 PushL0,Got0Page 1 PushL1,GotoPage

PushLZ,PushL1,SetGraphicVisibiIity, Z PushLO,PushLO,SetGraphicVisibility,

PushLl,PushLO,SetGraphicVisibility

HandIer_Part I 2163

LER NO. BYTECODE NO.

Graphics_Pro _Part 2164

Bitmap_Information_Part 2165

NUMBER 0 1 2

CONIENI IEEQI THIS OFFER IS m NO LONGER VALID

Hyperlink_Inf0rmation_Part 2166

LINK NO. LINK DESTINATION MATERIAL ID 0 NE_id = l, VE_id = 1

1 NE_id= 2, VE_id= Z

U.S. Patent Apr. 24, 2001 Sheet 12 of 38 US 6,223,347 B1

FIG. 12

NE_id 1 I I / 2260

Time_Event_Part Z261

NOT WRITTEN

Bytecode_Part Z262 BYTECODE NO. BYTECODE

O PushLO,GotoPage

Hand1er_Part 2263 HANDLER NO. BYTECODE NO.

0 O

Graphics_Property_Part 2264 GRAPHICS NO. TYPE COORDINATESIANDLER N0. INITIAL STATE

0 BUTTON (20.60) 0 Visible

Bitmap__Information_Part 226 5 NUMBER 0

CONTENT [LE1

Hyperlink_Information_Part 2266 LINK NO. LINK DESTINATION MATERIAL ID

0 NE_id=0, VE_id=0

U.S. Patent Apr. 24, 2001 Sheet 13 of 38 US 6,223,347 B1

FIG. 13

NE_id 2 l /2360

Time_Event_Part 2361

NOT WRITTEN

Bytecode_Part 2362 BYTECODE NO. BYTECODE

0 PushLO,GotoPage

Handler_Part 2363 HANDLER NO. BYTECODE NO.

0 0

Graphics_Property_Part 2364 GRAPHICS NO. TYPE COORDINATES HANDLER N0. [INITIAL STATE

0 BUTTON (20,60) 0 Visible

Bitmap_Information_Part 2365 NUMBER 0

CONFENY IIEELD

I-Iyper1ink_Information_Part 2366 LINK NO. LINK DESTINATION MATERIAL ID

0 NE__id=0, VE_id=0

U.S. Patent Apr. 24, 2001 Sheet 14 of 38 US 6,223,347 B1

FIG. 14

I S3010 FIRST CONTENT INDICATED

O S3020 CONTENT SWITCHED?

YES S3030 CONTENT DISPLAYED

SELECTION POINTER MOVED IN ACCORDANCE WITH USER INPUT

U.S. Patent Apr. 24, 2001 Sheet 15 of 38 US 6,223,347 B1

FIG. 15

TIME DISPLAY SCREEN

MAIL ORDER

3210/, 1996.9.9 VIDEO 14 : 57 : 00 STEREO

VIDEO 1996.9.9 mm’

3220/ 14: 58 :00 ‘31520000? MENU

MAIL ORDER / 1996.9.9 VIDEO

2 O 3 3 14:59:00 STEREO

1996,99 THIS OFFER IS 3240/ NO LONGER VALID

U.S. Patent Apr. 24, 2001 Sheet 16 of 38 US 6,223,347 B1

FIG. 16A

TDT

PRESENT TIME

(1996:09:09:14:57:00)

FIG. 16B

TOT 4020

PRESENT TIME(1 996109109: 14:57:00) ‘

(CIOIEINTRY ID CODE TIME DIFFERENCE (+ 00:00:00)

COUNTRY ID CODE TIME DIFFERENCE (JAPAN) (+ 09:00:00)

U.S. Patent Apr. 24, 2001 Sheet 17 of 38 US 6,223,347 B1

FIG. 17

NE_id 0 | /2170

Time_Event_Part Z 1 7 1

NOT WRITTEN

Bytecode_Part 2172 BYTECODE NO. BYTECODE

O PushLO,GotoPage 1 PushLl ,GotoPage

PushL2,PushL1,SetGraphicVisibility, 2 PushL0,PushL0,SetGraphicVisibility,

PushLl,PushLO,SetGraphicVisibility

Hand1er__Part 2173 N0. ALID SUBHANDLER

0 N

1 1 2

Graphics_Pr0 _Part 2174

' isible

isible Invisible

2 1 7 5 Bitmap_Informati0n_Part

NUMBER 0 1 2

THIS OFFER IS COW" [ET-3E @ NO LONGER VALID

Hyper1ink_Inf0rmati0n__Part 2176 LINK NO. LINK DESTINATION MATERIAL ID

0 NE_id = 1, VE_id : 1 1 NE_id= 2, VE_id=Z

U.S. Patent Apr. 24, 2001 Sheet 18 of 38 US 6,223,347 B1

FIG. 18

‘ NE_id | 1 | /2270

Time_Event_Part 2271

NOT WRITTEN

Bytecode_Part Z272 BYTECODE NO. BYTECODE

0 PushL0,G0toPage

Hand1er_Part Z273 HANDLERNO. SUBHANDLERNO. VAUDPIRIOD SUBHANDLERNO. BYIECODENO.

0 0 —- 0 0

Graphics_Property_Part 2274 GRAPHICS NO. TYPE COORDINATES HANDLER N0. ITIALSTATE

0 BUTTON (20,60) 0 Visible

Bitmap_Information_Part 2275 NUMBER 0

CONTENT IE]

Hyper1ink_Information_Part Z276 LINK NO. LINK DESTINATIGN MATERIAL ID

0 NE_id=0, VE__id=0

U.S. Patent Apr. 24, 2001 Sheet 19 of 38 US 6,223,347 B1

FIG. 19

NE__id Z l /2370

Time_Event_Part 237 1

NOT WRITTEN

Bytecode_Part 2372 BYTECODE NO. BYTECODE

O PushL0,GotoPage

Handler_Part Z373 HANDLERNO. SUBHANDLER N0. VALIDPERIOD SUBHANDLERNO. BYIECUDENO.

0 O —- 0 0

Graphics_Property_Part 2374 GRAPHICS NO. TYPE COORDINATES HANDLER NOIINITIAL STATE

0 BUTTON (20,60) 0 Visible

Bitmap__Informati0n_Part 2375 NUMBER 0

CONTENT @@

HyperIink_Information_Part Z376 LINK NO. LINK DESTINATION MATERIAL ID

0 NE_id=O, VE_id=0