Title of Invention

METHOD FOR DISPLAYING MULTIMEDIA DATA AND APPARATUS THEREOF

Abstract An apparatus and method for displaying multimedia data described according to a MusicPhotoVideo (MPV) format. In the apparatus, it is checked whether an asset selected by a user is comprised of single photo data and one or more video data, reference information needed for displaying the photo data and the one or more video data is extracted, and the photo data and the one or more video data are extracted using the extracted reference information and displayed sequentially displayed using a predetermined displaying method.
Full Text FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
"APPARATUS AND METHOD FOR DISPLAYING PHOTO AND VIDEO
DATA AND RECORDING MEDIUM CONTAINING A PROGRAM FOR
PERFORMING THE SAME METHOD"
SAMSUNG ELECTRONICS CO. LTD., 416 Maetan-dong, Yeongtong-gu, Suwon-si, Gyeonggi-do, Republic of Korea,
The following specification particularly describes the invention and the manner in which it is to be performed.


WO 2005/029491

1

PCT/KR2004/002310

Description APPARATUS AND METHOD FOR DISPLAYING PHOTO AND VIDEO DATA AND RECORDING MEDIUM
CONTAINING A PROGRAM FOR PERFORMING THE
SAME METHOD
Technical Field
[1] The present invention relates to an apparatus and a method for displaying photo
and video data (hereinafter referred to as 'AV data') and a storage medium on which a program to execute the displaying method is recorded, and more particularly to management of photo and video data among multimedia data in the format of Multi-Photo Video or MusicPhoto Video (both of which are hereinafter referred to as 'MPV') and provision of the same to users.
Background Art
[2] MPV is an industrial standard specification dedicated to multimedia titles,
published by the Optical Storage Technology Association (hereinafter referred to as 'OSTA'), an international trade association established by optical storage makers in 2002. Namely, MPV is a standard specification to provide a variety of music, photo and video data more conveniently or to manage and process the multimedia data. The definition of MPV and other standard specifications are available for use through the official web site (www.osta.org) of the OSTA.
[3] Recently, media data comprising digital pictures, video, digital audio, text and the
like are processed and played by means of personal computers (PC). Devices for playing the media content, e.g., digital cameras, digital camcorders, digital audio players (namely, digital audio data playing devices such as Moving Picture Experts Group Layer-3 Audio (MP3), Window Media Audio (WMA) and so on) have been in frequent use, and various kinds of media data have been produced in large quantities accordingly.
[4] However, personal computers have mainly been used to manage multimedia data
produced in large quantities; in this regard file-based user experience has been requested. In addition, when multimedia data is produced on a specified product, attributes of the data, data playing sequences, and data playing methods are produced depending upon multimedia data. If they are accessed by the personal computers, the attributes are lost and only the source data is transferred. In other words, there is a very
-2--

WO 2005/029491



PCT/KR2004/002310

weak interoperability relative to data and attributes of the data between household electric goods, personal computers and digital content playing devices.
[5] An example of the weak interoperability will be described. A picture is captured
by use of a digital camera, and data such as the sequence for attributes of a show determined by use of a slideshow function to identify the captured picture on the digital camera, time intervals between pictures, relations between pictures whose attributes determined by use of a panorama junction are taken, and attributes determined by use of a consecutive photoing function are stored along with actual picture data as the source data. At this time, if the digital camera transfers pictures to a television set by use of an AV cable, a user can see multimedia data whose respective attributes are represented. However, if the digital camera is accessed to a personal computer by use of a universal serial bus (USB), only the source data is transferred to the computer and their respective attributes are lost.
[6] As described above, it is shown that the interoperability of the personal computer
for metadata such as attributes of data stored in the digital camera is very weak or there is no interoperability of the personal computer to the digital camera.
[7] In order to strengthen the interoperability relative to data between digital devices,
the standardization for MPV has been in progress.
[8] MPV specification defines Manifest, Metadata and Practice to process and play
sets of multimedia data such as digital pictures, video, audio, etc. stored in a storage medium (or device) comprising an optical disk, a memory card, and a computer hard disk, or exchanged by the Internet Protocol (IP).
[9] The standardization for MPV is currently being advanced by the OSTA (Optical
Storage Technology Association) and I3A (International Imaging Industry Association). The MPV takes an open specification and mainly proposes to make it easy to process, exchange and play sets of digital pictures, video, digital audio and text and soon.
[ 10] MPV is raghly classified into MPV Core-Spec (0.90WD) and Profile.
[11] The core is composed of three basic factors such as Collection, Metadata and Iden-
tification.
[12] The Collection has Manifest as a Root member, and it comprises Metadata, Album,
MarkedAsset and AssetList, etc. The Asset refers to multimedia data described according to the MPV format, being classified into two kinds: Simple media asset (e.g., digital pictures, digital audio, text, etc.) and Composite media asset (e.g., digital picture combined with digital audio (StillWithAudio), digital pictures photoed con-

3
WO 2005/029491 PCT/KR2004/002310
secutively (StillMultishotSequence), and panorama digital pictures (StillPanoramaSequence), etc.). FIG. 1 illustrates examples of StillWithAudio, StillMultishotSequence, and StillPanoramaSequence.
[13] Metadata adopts the format of extensible markup language (XML) and has five
kinds of identifiers for identification.
[14] 1. LastURL is path name and file name of a concerned asset (Path to the object),
[15] 2. Instance ID is an ID unique to each asset (unique per object: e.g., Exif 2.2),
[16] 3. Document ID is identical to both source data and modified data,
[17] 4. Content ID is created whenever a concerned asset is used for a specified purpose,
and
[18] 5. id is a local variable within metadata.
[19] There are seven profiles: Basic profile, Presentation profile, Capture/Edit profile,
Archive profile, Internet profile, Printing profile and Container profile.
[20] MPV supports management of various file associations by use of XML metadata
so as to allow various multimedia data recorded on storage media to be played. Especially, MPV supports JPEG (Joint Photographic Experts Group), MP3, WMA (Windows Media Audio), WMV (Windows Media Video), MPEG-1 (Moving Picture Experts Group-1), MPEG-2, MPEG-4, and digital camera formats such as AVI (Audio Video Interleaved) and Quick Time MJPEG (Motion Joint Photographic Experts Group ) video. MPV specification-adopted discs are compatible with BO9660 level 1, Joliet, and also multi-session CD (Compact Disc), DVD (Digital Versatile Disc), memory cards, hard discs and Internet, thereby allowing users to manage and process various multimedia data.
Disclosure of Invention
Technical Problem
[21] However, new formats of various multimedia data not defined in MPV format
specification, namely new formats of assets are in need, and addition of a function to provide the multimedia data is desired.
Technical Solution
[22] Accordingly, the present invention has been proposed to provide formats of new
multimedia data in addition to various formats of multimedia data defined in the current MPV formats, and increase the utilization of multimedia data of various kinds by proposing a method to provide multimedia data described according to MPV formats, to users in various ways.
[23] Consistent with an aspect of the present invention, there is provided an apparatus
4
WO 2005/029491
PCT/KR2004/002310
for displaying multimedia data described according to a MusicPhotoVideo (MPV) format, wherein it is checked whether an asset selected by a user is comprised of single photo data and one or more video data, reference information needed for displaying the photo data and the one or more video data is extracted, and the photo data and the one or more video data are extracted using the extracted reference information and sequentially displayed using a predetermined displaying method.
[24] In an exemplary embodiment, the asset includes information on a display time
when the photo data is displayed and information on a position at which the photo data is displayed. Also, the displaying method preferably comprises a first displaying method in which the video data is displayed after the photo data is displayed, and a second displaying method in which the photo data is displayed after the video data is displayed.
[25] Consistent with another aspect of the present invention, there is provided an
apparatus for displaying multimedia data described according to a MusicPhoto Video (MPV) format, wherein it is checked whether an asset selected by a user is comprised of single video data and one or more photo data, reference information needed for displaying the video data and the photo data is extracted, and the video data and the one or more photo data are extracted using the extracted reference information and sequentially displayed using a predetermined displaying method.
[26] In an exemplary embodiment, the asset includes information on a display time
when each photo data is displayed and information on a position at which the photo data is displayed. The displaying method may comprise a first displaying method in which the photo data is displayed before the video data is displayed, a second displaying method in which the photo data is displayed while the video data is displayed, a third displaying method in which the photo data is displayed after playback of the video data is completed, and a fourth displaying method which is a combination of at least two or more displaying methods.
[27] Consistent with another aspect of the present invention, there is provided a method
for displaying multimedia data described according to a MusicPhoto Video (MPV) format, the method comprising: checking whether an asset selected by a user is comprised of single photo data and one or more video data; extracting reference information needed for displaying the photo data and the video data; and extracting the photo data and the one or more video data using the extracted reference information and sequentially displaying the same using a predetermined displaying method.
[28] In an exemplary embodiment, the asset includes information on a display time
5
WO 2005/029491



PCT/KR2004/002310

when the photo data is displayed and information on a position at which the photo data is displayed. Also, the displaying method preferably comprises a first displaying method in which the video data is displayed after the photo data is displayed, and a second displaying method in which the photo data is displayed after the video data is displayed.
[29] Consistent with yet another aspect of the present invention, there is provided a
method for displaying multimedia data described according to a MusicPhotoVideo (MPV) format, the method comprising: checking whether an asset selected by a user is comprised of single video data and one or more photo data; extracting reference information needed for displaying the video data and the photo data; and extracting the video data and the one or more photo data using the extracted reference information and sequentially displaying the same using a predetermined displaying method.
[30] Here, the asset may include information on a display time when the photo data is
displayed and information on a position at which the photo data is displayed, and the displaying method may comprise a first displaying method in which the photo data is displayed before the video data is displayed, a second displaying method in which the photo data is displayed while the video data is displayed, a third displaying method in which the photo data is displayed after playback of the video data is completed, and a fourth displaying method which is a combination of at least two or more displaying methods.
[31] Consistent with a further aspect of the present invention, there is provided a
recording medium on which a program for displaying multimedia data described according to a MusicPhotoVideo (MPV) format is recorded, wherein the program checks whether an asset selected by a user is comprised of single photo data and one or more video data, reference information needed for displaying the photo data and the one or more video data is extracted, and the photo data and the one or more video data are extracted using the extracted reference information and displayed sequentially displayed using a predetermined displaying method, the predetermined displaying method comprising a first displaying method in which the video data is displayed after the photo data is displayed, and a second displaying method in which the photo data is displayed after the video data is displayed.
[32] In an exemplary embodiment, the asset includes information on a display time
when the photo data is displayed and information on a position at which the photo data is displayed.
[33] Consistent with another aspect of the present invention, there is provided a

6
WO 2005/029491



PCT/KR2004/002310

recording medium on which a program for displaying multimedia data described according to a MusicPhotoVideo (MPV) format is recorded, wherein the program checks whether an asset selected by a user is comprised of single video data and one or more photo data, reference information needed for displaying the video data and the photo data is extracted, and the video data and the one or more photo data are extracted using the extracted reference information and sequentially displayed using a predetermined displaying method, the predetermined displaying method comprising a first displaying method in which the photo data is displayed before the video data is displayed, a second displaying method in which the photo data is displayed while the video data is displayed, a third displaying method in which the photo data is displayed after playback of the video data is completed, and a fourth displaying method which is a combination of at least two or more displaying methods.
[34] The asset may include information on a display time when the photo data is
displayed and information on a position at which the photo data is displayed.
Description of Drawings
[35] The above and other features and advantages of the present invention will become
more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which:
[36] FIG. 1 is an exemplary diagram of the type of assets specified in a Mu-
sicPhoto Video (MPV) specification;
[37] FIG. 2 is an exemplary diagram briefly showing a configuration of a toWithVideo> asset consistent with an embodiment of the present invention;
[38] FIG. 3 is an exemplary diagram briefly defining a element consistent
with an embodiment of the present invention;
[39] FIG. 4 is an exemplary diagram briefly defining a element
consistent with an embodiment of the present invention;
[40] FIG. 5 is an exemplary diagram briefly showing a type definition for a toLocation> element consistent with an embodiment of the present invention, and FIG. 6 is an exemplary diagram of a spatial relationship among elements;
[41] FIG. 7 is an exemplary diagram showing a type definition for a
element consistent with an embodiment of the present invention;
[42] FIG. 8 is an exemplary diagram briefly showing a configuration of a oWithPhoto> asset consistent with an embodiment of the present invention;
[43] FIG. 9 is an exemplary diagram briefly defining a element
consistent with an embodiment of the present invention;
7

WO 2005/029491



PCT/KR2004/002310

[44] FIG. 10 is an exemplary diagram showing a type definition for a > element consistent with an embodiment of the present invention;
[45] FIG. 11 is an exemplary diagram briefly defining a element
consistent with an embodiment of the present invention;
[46] FIG. 12 is an exemplary diagram briefly defining a element
consistent with an embodiment of the present invention;
[47] FIG. 13 is an exemplary diagram briefly defining a consistent
with an embodiment of the present invention;
[48] FIG. 14 is a flowchart illustrating a method for playing back a 'PhotoWithVideo'
asset consistent with an embodiment of the present invention; and
[49] FIGS. 15 and 16 are a flowchart illustrating a method for playing back a 'Vide-
oWithPhoto' asset consistent with an embodiment of the present invention.
Mode for Invention
[50] Hereinafter, an apparatus and a method for displaying photo and video data
described according to MPV formats consistent with an aspect of the present invention will be described in more detail with reference to the accompanying drawings.
[51] In the present invention, XML is used to provide multimedia data according to a
MPV format. Thus, the present invention will be described according to XML schema.
[52] Various multimedia data are provided herein by proposing new assets of 'Au-
dioWithVideo' and 'VideoWithAudio' not provided by the OSTA. To describe the new assets, the following terms 'smpv' and 'mpv' are used to refer to 'namespace' in XML, wherein the former indicates a namespace relative to a new element proposed in the present invention and the latter indicates a namespace relative to an element proposed by the OSTA. The definitions and examples of these new assets will be described.
[53] 1. 'PhotoWithVideo' Asset
[54] 'PhotoWithVideo' is an asset that combines a single photo asset with at least one
video asset. If the asset is described using XML, it can be referred to as a toWith Video> element. The photo asset and the video asset are treated as an element in a file described using XML.
[55] The photo asset can be represented by , mpv:StillMultiShotSequenceRef>, and , and the video asset can be represented by , , , and .
[56] The element refers a element, which represents a
part of the Video asset. The element includes children elements defined
8

wo

2005/029491



PCT7KR2004/002310

by , and . At least one among the children elements must have a specific value.
[57] The element can be defined by type="xs:long" minOccurs="0"/>. A start time for a part of the whole time of the referenced video asset is represented in units of seconds. If no value is given, the start time can be calculated using the following equation on the basis of and values: [SMPV:start] = [SMPV:stop] - [SMPV:dur]. If the or value is not specified, the value becomes zero.
[58] The element can be defined by type="xs:long" minOccurs="0'7>. A stop time for a part of the whole time of the referenced video asset is represented in units of seconds. If no value is given, the stop time can be calculated using the following equation on the basis of and values: [SMPV:stop]= [SMPV:start] + [SMPV:dur]. If the value is not specified but the value is specified, the value equals the stop time of the reference asset. On the other hand, if the is not specified but the value is specified, the value equals the value.
[59] The element can be defined by type="xs:long" minOccurs="0"/>, which represents an actual play time cut of the overall time of the referenced video asset. If the value is not given, it can be calculated as follows: [SMPV:dur]= [SMPV:stop] - [SMPV:start]. FIG. 2 schematically defines a configuration of a asset.
[60] Referring to the diagram of the element in FIG. 2, the toWithVideo> element comprises multiple children elements using 'mpv' and 'smpv' as namespaces.
[61] Here, since the element using 'mpv' as a namespace has been described on OSTA's
website at www.osta.org, an explanation thereof will not be given. Thus, the elements using 'smpv' as a name space will now be described.
[62] (1) Element
[63] A element represents a time in which a single photo asset is displayed
in units of seconds. The element is an essential element for defining the element.
[64] (2) Element
[65] A element defines the position of a photo asset. That is, the PhotoLocation> element represents the temporal or spatial position in which a single
9

wo
2005/029491



PCT/KR2004/002310

photo asset is displayed while multiple video assets are displayed. FIG. 4 briefly defines the element. In FIG. 4, a element among the children elements forming the element represents the temporal relationship.
[66] The element basically operates in the 'Photo With Video' asset.
Suitable examples of the element include 'Title' representing that a photo asset should be displayed before the reproduction of the corresponding video asset starts and 'End' representing that a photo asset should be displayed after the reproduction of the corresponding video asset ends.
[67] In general, element, element, element,
and element representing die spatial relationship of the photo asset are rarely used in the 'PhotoWithVideo' element. FIG. 5 shows a type definition of the element, and FIG. 6 shows the positional relationship between each of a element, a element, a element, and a element forming the element.
[68] FIG. 7 shows a type definition of the element.
[69] A method of defining the PhotoWithVideo asset using the elements described
above will now be described by way of examples.
[70] Example 1)
[71]

SOOK/MPV:StillRef>
V001
5

Title

[72] 'Example 1' defines that photo data referred to as 'SOOl' should be displayed for 5
seconds before video data referred to as 'V001' is played back. For example, the photo data referred to as 'S001' can be used in displaying the played video title or messages relating to data-copy.
[73] Example 2)
[74]
10

WO 2005/029491



PCT/KR2004/002310


S002V0012
End


[75] 'Example 2' defines that photo data referred to as 'S002' should be displayed for 2
seconds after video data referred to as 'V001' is reproduced.
[76] 2. 'VideoWithPhoto' Asset
[77] 'VideoWithPhoto' is an asset that combines single video asset with one or more
photo assets. The asset described using XML can be referred to as the oWithPhoto> element. The photo assets and the video asset described using XML are
treated as elements. In this case, the photo asset can be represented by 'mpv.StillRef,
'mpv:StillMultiShotSequenceRef, or 'mpv:StillPnoramaRef and the video asset can be
represented by 'SMPV:VideoPartRef, 'mpv:VideoRef, 'SMPV:VideoWithAudioRef,
or 'SMPV:AudioWithVideoRef. The 'VideoWithPhoto' asset is used for displaying a
plurality of photo data while a single video data is playing. Thus, different kinds of
photo data can be displayed a predetermined time before, while and after playing the
video data. FIG. 8 schematically shows a structure of the 'VideoWithPhoto' element.
As shown in FIG. 8, the element includes a plurality of elements
using 'mpv' and 'smpv' as namespaces, respectively.
[78] Elements having 'mpv' as namespace are described in the official homepage of
OSTA (www.osta.org) proposing MPV specification, description thereof will be
omitted herein. Accordingly, only elements having 'smpv' as namespace will be
described below, with an exception of contents having been described above in the
section of the 'PhotoWith Video' asset.
[79] (1) Element
[80] A element denotes the display duration of each photo data. The PhotoDurSeq> element is a relative time value represented in units of seconds. The playing time can be represented in decimal representation. When a value of the element is not set, it is not possible to know how long it is displayed. Thus, the value of the element should be defined.
11

WO 2005/029491



PCT/KR2004/002310

[81] The value of the element will be described briefly as follows:
[82] [Equation 1]
[83] PhotoDurSeq = (";");
[84] [Equation 2]
[85] clock-value = ( I )
[86] [Equation 3]
[87] unknown-dur=the empty string
[88] [Equation 4]
[89] seconds = ().
[90] [Equation 1] means that the value of the element can be
represented by 'clock-value' and, when there are two or more photo data, a display time of each photo data can be distinguished using ";".
[91] [Equation 2] means that the 'clock-value' in [Equation 1] can be represented by
'seconds' or unknown-dur'.
[92] [Equation 3] means that the Unknown-dur' in [Equation 2] represents that the
'clock-value' is not set.
[93] [Equation 4] means that the value of 'seconds' in [Equation 2] is represented by a
decimal number and the display time of pertinent photo data is represented by a decimal point.
[94] For example, the 'clock-value' of '12.2' means that the display time of the pertinent
photo data is 12.2 seconds. As another example, the 'clock-value' of '20;8.9' means that the number of pertinent photo data is 2, the playback time of the first photo data is 20 seconds and the playback time of the second photo data is 8.9 seconds.
[95] FIG. 8 defines a element, which is a child element of oWithPhoto> element, in which the value of the element represents the time when the video data starts to be played back. Here, the element is represented in units of seconds and is a relative time value based on the time when the video data starts to be played back, which is also be given by decimal representation. For example, when the value of element is not set, it is assumed that the corresponding value is 0 seconds. In other words, the start time corresponds to the time when the pertinent video data starts to be played back. If the value of the element is greater than the overall playback time of the pertinent video data, the photo data is played back after playback of the pertinent video data is completed. In this case, it is assumed that the value of the element is '0'. The of a negative (-) value means that the photo data is displayed before the video data is
12

WO 2005/029491



PCT/KR2004/002310

played back. In this case, therefore, a value of a element must be set. If
the value of the is positive (+) and is less than the overall playback time of
the pertinent video data, the photo data and the video data may overlap each other.
Thus, the spatial position of the element must be defined. FIG. 9
briefly describes the element.
[96] A method of defining the 'VideoWithPhoto' asset using the above-described
elements will now be described by way of examples.
[97] Example 1)
[98]

SOOK/MPV:StillRef>
V001 5
Title

[99] 'Example 1' defines that photo data referred to as 'S001' should be displayed for 5
seconds before video data referred to as 'V001' is played back. For example, the photo data referred to as 'SOOT can be used in displaying the played video title or messages relating to data-copy.
[100] Example 2)
[101]
13

WO 2005/029491



PCT/KR2004/002310


SOOK/MPV:StillRef>
S002
S003
VOOK/MPV:VideoRef>
5;3;7
-5;5;10

S001Title


S002005050


S003
End


[102] 'Example 2' defines that photo data referred to as 'S001' should be displayed for 5
seconds before video data referred to as 'V001' is played back. 5 seconds after the
video data is displayed, the photo data referred to as 'S002' is played back for 3
seconds. Thereafter, when the playback of the video data is completed, the photo data
referred to as 'S003' is played back for 7 seconds. FIG. 10 illustrates a type definition
for a element.
[103] (2)
[104] A element is structured to make reference to the to With Video> element. FIG. 11 briefly describes the element.
[105] (3)
14

WO 2005/029491


PCT/KR2004/002310

[106] A element is structured to make reference to oWithPhoto> element. FIG. 12 briefly describes the element.
[107] Meanwhile, the present invention defines a reference group for referencing photo
assets, which is referred to as 'PhotoRefGroup' and is briefly described in FIG. 13.
[108] FIG. 14 is a flowchart illustrating a process of playing back a 'PhotoWithVideo'
asset consistent with an embodiment of the present invention, particularly illustrating a process for displaying 'Photo With Video' in which a photo asset is combined with a video asset.
[109] When a user runs software for MVP file playback and selects the 'PhotoWithVideo'
asset in a particular album in step SI300. Then, a thread or a child processor is created and information on the respective photo assets and information on the video assets are collected.
[110] In other words, a reference ID for the photo assets forming the user's selected 'Pho-
toWith Video' asset is extracted in step S1305. Then, information on the photo asset is extracted from AssetList using the extracted reference ID, although not shown in the flowchart. In another thread or child processor, first, a reference ID for a video asset combined with the photo asset is extracted in step S1310. Then, information on the video asset is extracted from AssetList using the reference ID for the video asset, although not shown in the flowchart.
[Ill] When the information on the respective photo assets and the information on the
video assets are both extracted, information on the element described in the MPV file is extracted in step S1315. In other words, it is necessary to decide when to display the photo asset during playback of the video asset.
[112] If the information on the element corresponds to 'Title', the photo
asset is first displayed and the video asset is then displayed in steps SI320, 1325 and 1330.
[113] If the information on the element corresponds to 'End', the video
asset is first displayed and the photo asset is then displayed in steps S1335, 1340 and 1345.
[114] If the information on the element is not 'Title' nor 'End', no asset
is displayed and the process is terminated. That is, the process returns to a software manner, in step S1350.
[115] FIGS. 15 and 16 are a flowchart illustrating a process of playing back a 'Vide-
oWithPhoto' asset consistent with an embodiment of the present invention.
[116] A user executes the software capable of executing any file written according to the
15

wo

2005/029491



PCT/KR2004/002310

MPV format and selects 'VideoWithPhoto' asset in a certain album SHOO. Then, a thread or a child processor is generated, which collects information on photo assets and video assets.
[117] In other words, a reference ID for the video asset forming the user's selected 'Vide-
oWithPhoto' asset is extracted in step S1405. Then, information on the video asset is extracted from AssetList using the extracted reference ID, although not shown in the flowchart. In another thread or child processor, first, a reference ID for a photo asset combined with the video asset is extracted in step S1410. Then, information on the photo asset is extracted from AssetList using the extracted reference ID for the photo asset, although not shown in the flowchart. At this time, a plurality of photo assets forming the 'VideoWithPhoto' asset are arranged using the information on the element, element or element sequentially in a display order in step S1415.
[118] In step S1420, the plurality of photo assets are grouped into several groups: a first
group comprised of photo assets displayed before the video asset forming the 'VideoWithPhoto' asset is played back; a second group comprised of photo assets displayed while the video asset is played back; and a third group comprised of photo assets displayed after the video asset is played back. At this time, information on the grouping can be stored in a separate database in step SI425.
[119] When steps S1405 and S1420 are terminated, in step S1430, the photo assets
belonging to the first group are first displayed on information on the grouping performed in step SI420. Then, a video asset to be played back is initialized in step S1435, and the video asset and the photo assets belonging to the second group are simultaneously displayed according to predetermined display information in step SI440 and 1445.
[120] If the playback of the video asset is completed, the photo assets belonging to the
third group is displayed in step S1450.
[121] Multimedia data provided in MPV format can be described in the form of XML
documents, which can be changed to a plurality of application documents according to stylesheets applied to the XML documents. In the present invention, the stylesheets to change an XML document to an HTML document has been applied, whereby a user is allowed to manage audio and video data through a browser. In addition, the stylesheets to change the XML document to a WML (Wireless Markup Language) or cHTML (Compact HTML) document may be applied, thereby allowing the user to access audio and video data described in the MPV format through mobile terminals such as a


16

WO 2005/029491 PCT/KR2004/002310
personal digital assistant (PDA), a cellular phone, a smart phone and so on.
Industrial Applicability
[122] As described above, the present invention provides users with a new form of
multimedia data assets in combination of audio data and video data, thereby allowing the users to generate and use various multimedia data described in the MPV format.
[123] Although the present invention has been described in connection with the
exemplary embodiments thereof shown in the accompanying drawings, they are mere examples of the present invention. It can also be understood by those skilled in the art that various changes, modifications and equivalents thereof can be made thereto. Accordingly, the true technical scope of the present invention should be defined by the appended claims.
-17-


WO 2005/029491



PCT/KR2004/002310

WE CLAM
[1] An apparatus for displaying multimedia data described according to a Mu-
sicPhotoVideo (MPV) format, the apparatus comprising:
a memory under control of a processor, the memory comprising software
enabling the apparatus to:
check whether an asset selected by a user is comprised of single photo data and
one or more video data;
extract reference information needed for displaying the photo data and the one or
more video data;
extract the photo data and the one or more video data using the extracted
reference information; and
sequentially display the photo data and the one or more video data using a pre
determined displaying method.
[2] The apparatus of claim 1, wherein the asset comprises information on a display
time when the photo data is displayed and information on a position at which the
photo data is displayed.
[3] The apparatus of claim 1, wherein the displaying method comprises a first
displaying method in which the video data is displayed after the photo data is
displayed, and a second displaying method in which the photo data is displayed
after the video data is displayed.
[4] An apparatus for displaying multimedia data described according to a Mu-
sicPhotoVideo (MPV) format, the apparatus comprising:
a memory under control of a processor, the memory comprising software
enabling the apparatus to:
check whether an asset selected by a user is comprised of single video data and
one or more photo data;
extract reference information needed for displaying the video data and the photo
data;
extract the video data and the one or more photo data using the extracted
reference information; and
sequentially display the photo data and the one or more video data using a pre
determined displaying method.
[5] The apparatus of claim 4, wherein the asset comprises information on a display
time when each photo data is displayed and information on a position at which
18

WO 2005/029491



PCT/KR2004/002310

the photo data is displayed.
[6] The apparatus of claim 4, wherein the displaying method comprises a first
displaying method in which the photo data is displayed before the video data is displayed, a second displaying method in which the photo data is displayed while the video data is displayed, a third displaying method in which the photo data is displayed after playback of the video data is completed, and a fourth displaying method which is a combination of at least two or more displaying methods.
[7] A method for displaying multimedia data described according to a Mu-
sicPhotoVideo (MPV) format, the method comprising: checking whether an asset selected by a user is comprised of single photo data and one or more video data;
extracting reference information needed for displaying the photo data and the video data; and
extracting the photo data and the one or more video data using the extracted reference information and sequentially displaying the same using a predetermined displaying method.
[8] The method of claim 7, wherein the asset comprises information on a display
time when the photo data is displayed and information on a position at which the photo data is displayed.
[9] The method of claim 7, wherein the displaying method comprises a first
displaying method in which the video data is displayed after the photo data is displayed, and a second displaying method in which the photo data is displayed after the video data is displayed.
[10] A method for displaying multimedia data described according to a Mu-
sicPhotoVideo (MPV) format, the method comprising: checking whether an asset selected by a user is comprised of single video data and one or more photo data;
extracting reference information needed for displaying the video data and the photo data; and
extracting the video data and the one or more photo data using the extracted reference information and sequentially displaying the same using a predetermined displaying method.
[11] The method of claim 10, wherein the asset comprises information on a display
time when the photo data is displayed and information on a position at which the photo data is displayed.

19

WO 2005/029491



PCT/KR2004/002310

[12] The method of claim 10, wherein the displaying method comprises a first
displaying method in which the photo data is displayed before the video data is displayed, a second displaying method in which the photo data is displayed while the video data is displayed, a third displaying method in which the photo data is displayed after playback of the video data is completed, and a fourth displaying method which is a combination of at least two or more displaying methods.
[13] A computer readable recording medium on which a program for displaying
multimedia data described according to a MusicPhotoVideo (MPV) format is recorded, the program enabling a processor to:
check whether an asset selected by a user is comprised of single photo data and one or more video data;
extract reference information needed for displaying the photo data and the one or more video data;
extract the photo data and the one or more video data using the extracted reference information; and
sequentially display the photo data and the one or more video data using a predetermined displaying method,
wherein the predetermined displaying method comprises a first displaying method in which the video data is displayed after the photo data is displayed, and a second displaying method in which the photo data is displayed after the video data is displayed.
[14] The computer readable recording medium of claim 13, wherein the asset
comprises information on a display time when the photo data is displayed and information on a position at which the photo data is displayed.
[15] A computer readable recording medium on which a program for displaying
multimedia data described according to a MusicPhotoVideo (MPV) format is recorded, the program enabling a processor to:
check whether an asset selected by a user is comprised of single video data and one or more photo data;
extract reference information needed for displaying the video data and the photo data;
extract the video data and the one or more photo data using the extracted reference information; and
sequentially display the video data and the one or more photo data using a predetermined displaying method,
20

wherein the predetermined displaying method comprises a first displaying
method in which the photo data is displayed before the video data is displayed, a
second displaying method in which the photo data is displayed while the video
data is displayed, a third displaying method in which the photo data is displayed
after playback of the video data is completed, and a fourth displaying method
which is a combination of at least two or more displaying methods.
[16] The computer readable recording medium of claim 15, wherein the asset ,
comprises information on a display time when each photo data is displayed and information on a position at which the photo data is displayed.
[17] An apparatus for displaying multimedia data described according to a
MusicPhoto Video (MPV) format substantially as herein described with reference to the accompanying drawings.
[18] A method for displaying multimedia data described according to a
MusicPhoto Video (MPV) format substantially as herein described with reference to the accompanying drawings.
[19] A computer readable recording medium on which a program for
displaying multimedia data described according to a MusicPhoto Video (MPV) format is recorded substantially as herein described with reference to the accompanying drawings.
Dated this 21st day of April, 2006
(G. DEEPAK SRINIWAS)
OF K & S PARTNERS
AGENT FOR THE APPLICANTS
-21 -

ABSTRACT
An apparatus and method for displaying multimedia data described according to a MusicPhotoVideo (MPV) format. In the apparatus, it is checked whether an asset selected by a user is comprised of single photo data and one or more video data, reference information needed for displaying the photo data and the one or more video data is extracted, and the photo data and the one or more video data are extracted using the extracted reference information and displayed sequentially displayed using a predetermined displaying method.


Documents:

468-mumnp-2006-abstract(14-07-2008).doc

468-MUMNP-2006-ABSTRACT(14-07-2008).pdf

468-mumnp-2006-abstract.pdf

468-MUMNP-2006-ASSIGNMENT(14-07-2008).pdf

468-mumnp-2006-cancelled pages(14-07-2008).pdf

468-MUMNP-2006-CANCELLED PAGES(24-04-2006).pdf

468-MUMNP-2006-CLAIMS(14-07-2008).pdf

468-mumnp-2006-claims(granted)-(14-07-2008).doc

468-mumnp-2006-claims(granted)-(14-07-2008).pdf

468-mumnp-2006-claims.pdf

468-mumnp-2006-correspondance-received.pdf

468-MUMNP-2006-CORRESPONDENCE(14-07-2008).pdf

468-MUMNP-2006-CORRESPONDENCE(28-8-2008).pdf

468-mumnp-2006-correspondence(29-09-2008).pdf

468-mumnp-2006-correspondence(ipo)-(21-11-2008).pdf

468-mumnp-2006-description (complete).pdf

468-MUMNP-2006-DESCRIPTION(COMPLETE)-(14-07-2008).pdf

468-MUMNP-2006-DRAWING(14-07-2008).pdf

468-mumnp-2006-form 1(24-04-2006).pdf

468-MUMNP-2006-FORM 1(25-04-2008).pdf

468-MUMNP-2006-FORM 1(28-8-2008).pdf

468-mumnp-2006-form 18(22-09-2006).pdf

468-mumnp-2006-form 2((14-07-2008).pdf

468-mumnp-2006-form 2(granted)-(14-07-2008).doc

468-mumnp-2006-form 2(granted)-(14-07-2008).pdf

468-MUMNP-2006-FORM 2(TITLE PAGE)-(14-07-2008).pdf

468-mumnp-2006-form 26(09-07-2008).pdf

468-MUMNP-2006-FORM 26(14-07-2008).pdf

468-mumnp-2006-form 26(27-04-2007).pdf

468-MUMNP-2006-FORM 3(14-07-2008).pdf

468-mumnp-2006-form 3(24-04-2006).pdf

468-mumnp-2006-form 3(26-10-2006).pdf

468-mumnp-2006-form 5(24-04-2006).pdf

468-MUMNP-2006-FORM 5(25-04-2008).pdf

468-mumnp-2006-form-1.pdf

468-mumnp-2006-form-2.pdf

468-mumnp-2006-form-3.pdf

468-mumnp-2006-form-5.pdf

468-mumnp-2006-form2.doc

468-MUMNP-2006-NOTARIAL CERTIFICATE(28-8-2008).pdf

468-MUMNP-2006-OTHER DOCUMENT(14-07-2008).pdf

468-MUMNP-2006-PETITION UNDER RULE 137(14-07-2008).pdf

468-mumnp-2006-petition under rule 137(24-04-2006).pdf

abstract1.jpg


Patent Number 225795
Indian Patent Application Number 468/MUMNP/2006
PG Journal Number 07/2009
Publication Date 13-Feb-2009
Grant Date 02-Dec-2008
Date of Filing 24-Apr-2006
Name of Patentee SAMSUNG ELECTRONICS CO. LTD.
Applicant Address 416 Maetan-dong, Yeongtong-gu, Suwon- si, Gyeonggi-do,
Inventors:
# Inventor's Name Inventor's Address
1 KIM, Du-il #108-1403 Dongsuwon LG Village, Mangpodong, Yeongtong-gu, Suwon-si, Gyeonggi-do,
2 KIM, Young-yoon #B-908 Gungjeon APT, Bangbae-gu, Seochogu Seoul,
3 PORTNYKH, Valdimir 17 Temple Road, Croydon, Surrey, CR01HU,
PCT International Classification Number G11B20/10
PCT International Application Number PCT/KR2004/002310
PCT International Filing date 2004-09-10
PCT Conventions:
# PCT Application Number Date of Convention Priority Country
1 60/505,625 2003-09-25 U.S.A.
2 10-2003-0079855 2003-11-12 U.S.A.