Title of Invention

PERSISTENT SAVING PORTAL

Abstract Persistent Saving Portal Abstract of the Disclosure Method and computer program product for collecting information on the Internet are disclosed, The method includes parsing contents of a web page to form a plurality of collectable objects, selecting one or more objects from the plurality of collectable objects, storing the one or more objects to one or more saving portals, annotating the one or more objects in accordance with user-specified data, and annotating the one or more objects in accordance with implicit data of the one or more saving portals. The method further includes annotating the one or more objects automatically, without manual intervention, using user-specified data, and annotating the one or more objects automatically, withotl manual intervention, using implicit data of the one or more saving portals. 28
Full Text PERSISTENT SAVING PORTAL
FIELD OF THE INVENTION
[0002] The present invention relates to the field of Internet applications. In
particular, the present invention relates to a method and system for collecting information on the Internet.
BACKGROUND OF THE INVENTION
[0003] Currently, if a user wants to save certain information from the web, the
user would have to go to the website, click through the web pages, and then bookmark the page in order to save information on the page. Essentially, the user has saved the access to the website. However, there are at least two problems associated with this approach because the Internet is a very transitory evolving environment. First, when the user needs the information again, the website may no longer be there. Second, even if the website is still there, the content of the website has changed such that the information of interest to the user may no longer be there.
[0004] Another approach to save certain information from the web is to open a
clipboard-like application, such as Microsoft Word, and then the user may select, copy, and paste particular information of interest to the Word document. One drawback of this approach is that other infortnat'mn related to the information of interest is not moved to the Word document when such information is copied. The user would have to manually enter the citation, URL, author, and other contextual information related to the information retrieved, which is a time consuming and tedious task.
[0005] Yet another approach is to use an application like My Web offered by
Yahoo! Inc., which allows the user to save a copy of the web page containing the
information of interest. However, this approach saves both information the user is
interested in and the information the user is not interested in. The user may be only
interested in a particular section of a page or a particular image on a page. Another
drawback of this approach is that once the user saves the page, the user may have lost
the citation, URL, author, and other contextual information related to the information
retrieved, unless the user enters such information manually.
[0006] In the above cases, one drawback is that the user is required to add
metadata about the information acquired as a post-harvest action. There is no
1/26

mechanism that allows the user to gather and annotate the information whli metadata in real time. In addition, there is no mechanism to save the information in a structured manner. As a resuh, the user would have to organize and structure the information into useful formats after such information is collected. Therefore, there is a need to address such issues of the current art. Specifically, there is a need for a persistent saving portal for collecting information on the Internet.
SUMMARY
[0007] In one embodiment, a method for collecting information on the
Internet includes parsing contents of a web page to form a plurality of collectable objects, selecting one or more objects from the plurality of collectable objects, storing the one or more objects to one or more saving portals, annotating the one or more objects in accordance with user-specified data, and annotating the one or more objects in accordance with implicit data of the one or more saving portals. The method further includes annotating the one or more objects automatically, without manual intervention, using user-specified data, and annotating the one or more objects automatically, without manual intervention, using implicit data of the one or more saving portals.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The aforementioned features and advantages of the invention as well as
additional features and advantages thereof will be more clearly understandable after reading detailed descriptions of embodiments of the invention in conjunction with the following drawings.
[0009] Figure 1 illustrates a system for running map applications on a website
according to an embodiment of the present invention.
[0010] Figures 2A, 2B and 2C illustrate a method of collecting information
according to an embodiment of the present invention.
[0011] Figure 3 illustrates a method of annotating information collected
according to an embodiment of the present invention.
[0012] Figure 4 illustrates examples of the objects collected in each persistent
saving portal of Figure 2 according to an embodiment of the present invention.
[0013] Figure 5 illustrates a mobile device running the applications described
above according to an embodiment of the present invention,
2/26

[0014] Figure 6 illustrates another set of persistent saving portals according to
an embodiment of the present invention.
[0015] Like numbers are used throughout the figures.
DESCRIPTION OF EMBODIMENTS
(0016} Methods and systems are provided for cotiecting information on the
Internet. The following descriptions are presented to enable any person skilled in the art to make and use the invention. Descriptions of specific embodiments and applications are provided only as examples. Various modifications and combinations of the examples described herein will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other examples and applications without departing from the spirit and scope of the invention, Thus, the present invention is not intended to be limited to the examples described and shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
[0017] Some portions of the detailed description that follows are presented in
terms of flowcharts, logic blocks, and other symbolic representations of operations on information that can be performed on a computer system. A procedure, computer-executed step, logic block, process, etc., is here conceived to be a self-consistent sequence of one or more steps or instructions leading to a desired resuH. The steps are those utilizing physical manipulations of physical quantities. These quantities can take the form of electrical, magnetic, or radio signals capable of being stored, transferred, combined, compared, and otherwise manipulated in a computer system. These signals may be referred to at times as bits, values, elements, symbols, characters, terms, numbers, or the like, Each step may be performed by hardware, software, firmware, or combinations thereof.
[0018] Figure 1 illustrates a system for running map applications on a website
according to an embodiment of the present invention. The system includes one or more Internet content provider servers 102, databases 105, and one or more clients 104. The servers 102 interface with the clients 104 via a communication network 103, The Internet content provider servers 102 are host servers operable to provide content to clients 104 via the network 103. One or more of the servers host websites and include the map functions. The databases 105 are operable to store data provided by the servers 102 and/or clients 104. The databases can communicate with the servers
3/26

102 or clients 104 via the network 103. The databases can store data items included in the web pages, such as maps and user information.
[0019] Alternatively, the servers 102 may include the databases, processors,
switches, routers, interfaces, and other components and modules. Each of the servers 102 may comprise one or more servers, or may be combined into a lesser number of servers than shown, depending on computational and/or distributed computing requirements. The servers 102 may be located at different locations relative to each other. The databases may also be separately connected to the servers 102. There may be more or fewer than two databases, depending on computational and/or distributed computing requirements. The databases may be located at different locations relative to each other and the servers 102.
[0020| Each of the clients 104 may be a general-purpose computer, such as a
personal computer, having a central processing unit (CPU), a memory, an input device, an output device, and a display. Other computer system configuradons, including Internet appliances, hand-held devices, wireless devices, portable devices, wearable computers, cellular or mobile phones, portable digital assistants (PDAs), muhi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, and the like may also be implemented as the clients 104, Each of the clients 104 may also implement analog and digital baseband circuitry, power management circuitry, radio frequency (RF) transceiver, and battery interface and charging circuitry. Clients 104 may include one or more applications, program modules, and/or sub-routines. As an example, clients 104 may include a browser application (e.g., Internet Explorer, etc.) and a graphical user interface (GUI) to access websites and web pages provided by the servers 102 and data stored at the databases 105. Clients 104 may be remote from each other, the servers 102, and/or the databases 105.
[0021] The network 103 is a communications network, such as a local area
network (LAN), a wide area network (WAN), or the Internet. When the network 103 is a public network, security features (e.g., VPN/SSL secure transport) may be included to ensure authorized access within the system.
[0022] The servers 102 further include a plurality of individual domains, for
example, shopping domain 106, news domain 108, My Web domain 110, Maps domains 112, etc. A domain is a computer system implemented with different hardware and software for a specific application, such as the shopping applications,
4/26

news applications, and maps applications. The persistent saving portal applications of the present invention are run on the My Web domain 110, which implement Web 2.0 functionalities using a combination of HTML, CSS, JavaScript, Widget Engine, and "Asynchronous JavaScript and XML" (AJAX).
[0023] Figures 2A, 2B, and 2C illustrate a method of collecting information
according to an embodiment of the present invention. As shown in Figure 2A, a set of
persistent saving portals 202 is displayed on a user's computing device along with a
web page 204. The set of persistent saving portals 202 may include one or more
persistent saving portals for storing and organizing information selected by the user.
In this specification, a persistent saving portal is also referred to as a portal for short.
In addition, the information saved in the persistent saving portal may also be referred
to as one or more objects. In this example, each persistent saving portal is represented
by a circle. In the enlarged view of the set of persistent saving portals 202, the three
circles are labeled "Project 1" 206, "Project 2" 208, and "Project 3" 210 respectively.
The user may add a new saving portal by using the "Add a Saving Portal" button 211.
The user may also modify' the labels to indicate the contents of the objects stored in
each portal. For instance, the three circles representing the set of persistent saving
portals 202 are labeled "My workspace" 206, "Xmas ideas" 208, and "Trip to France"
210 respectively in Figure 2B. In this example, the portals are projects, which contain
collections to be used for personal consumption. In another embodiment, one or more
of these portals may be destinations, such as a group mailing list or a group website.
For example, when a user drops a map onto a saving portal specified for a particular
group, the map may be deliver it to the group's collection of objects,
[0024] In Figure 2B, as a user browses the web page 204, the user may be
interested to save the map 212 on the web page. To do so, the user may simply drag-and-drop the map to the relevant portal in the set of persistent saving portals 202. In this example, the map relates to "Trip to France" and it is stored in the portal 210. Item 214 illustrates the map 212 being dragged to the portal labeled "Trip to France." Note that any unit or type of information on the web page may be saved, including but not limited to photo, text, graphics, video, sound, URL, etc. Also note that objects collected and annotated in accordance with the present invention are not limited to objects on a website; the user may collect and annotate self-created information, such as a photo of a car taken by his cellular phone or a bar code of a product scan by the user. Such objects can be used to obtain further information the user is interested in.
5/26

[0025] The user may define a set of attributes to label the objects collected.
These attributes are defined upon the collection of the objects, and they may be edited or modified any time afterwards. The set of attributes may include the key words and/or symbols the user may use to automatically annotate objects saved in a particular portal. For example, item 218 shows user-specified annotation terms, for example "Paris," "Honeymoon" that are used to label objects stored in the "Trip to France" portal. In addition, item 220 shows other implicit data, such as the user's name "Karon", the date the information is saved "12.26.05", and the datatype "jpg". These data are automatically attached to the information dropped in the portal without manual intervention. Note that other types of implicit data may be attached, including but not limited to time of the day, location, file type, file size, access permission, etc. Both the user-specified and the implicit terms of each object are considered as the metadata of the object.
|0026] Note that there are several ways of constructing and associating
structural data when an object is being collected or gobbled. First, the URL
associated with the object is analyzed to search for unique object identification that
may be used to subsequently query a backend database. For example, a business in
the Yahoo! local may have a unique ID in its URL. If a URL is identified as
belonging to Yahoo! local (from the domain local.yahoo.com), then the identity in the
URL, such as id=l234567, may be used to inquire the Yahoo! local web service /
database for more information about that business, like the phone number, hours of
operation, customer or expert reviews, all from the URL associated with the business.
[0027] Second, the object being collected may contain Microformats.
Microformats are markups that allow expression of semantics in an HTML (or
XHTML) web page. A gobbler application may extract meaning from a standard web
page that is marked up with Microformats. Existing XHTML (and HTML) standards
allow for semantics to be embedded and encoded within them. This is done using
specific HTML attributes. Adding Microformats to a standard HTML web page
allows machines to process HTML text and to possibly load data into remote
databases. This would allow programs such as the gobbler application to find items
such as contact information, events, and reviews on web pages,
[O028J Finally, one may use information analysis lechniques, like Live Words
(http://desktop.yahoo.com) or term extraction (hnp://developer.yahoo.com) to analyze the text in the gobbled object to extract entities. The Live Words feature gives a user a
6/26

simple way to search the web for additional information the user may be interested in.
Examples of entities include addresses, businesses and companies, which can then be
applied in other queries to data sources such as Yahoo! local (for searching more
business or company information) or in general web searches.
[0029] Such structured metadata may be applied in many ways (putting the
gobbled information on a map for example, or into a calendar) and may also be
gathered from the user's annotations or tags. For example, adding a text tag of "Palo
Alto" may be used to geo-tag objects collected in a saving portal with the geo-
coordinates of the city of Palo Aito, which is identified as a city by Live Words.
[0030] The gobbler application allows the user to efficiently categorize the
objects he has collected and to efficiently access such objects using the metadata that
annotate the objects. Metadata may be added or deleted afler the objects have been
collected. For instance, when the user adds a new term to a project, all objects
contained within the project may be updated with the term. In another approach, the
user may elect to selectively add certain terms to the metadata of certain objects. That
would require more steps on the part of the user to select and add the terms to the
particular objects specified. The metadata may be implemented in the user's
environment as a (ag cloud or in other visual ways to support browsing and query the
system for object and collection retrieval. As the user's collection of objects
increases, the need for object and collection retrieval also increases. In addition, if the
user's collection is published into a public repository, the metadata enables the
clustering of like projects or collections and supports retrieval from multiple sources,
|0031] In Figure 2C, a persistent saving portal "French Class" 216 is shown to
collect information relates to the French Class 101 Group. The user may create multiple saving portals for each group the user belongs to. In this example, item 219 shows user-specified annotation terms, for example "Reference," "Paris Trip," and "Travel Guide" that are used to label objects stored in the "French Class" portal. In addition, item 221 shows other implicit data, such as the user's name "Karon", and the data type "jpg". These data are automatically attached to the map of Paris 212 that is dropped in the portal without manual intervention. After an object is collected in a saving portal, it may be broadcasted or distributed to a destination the user subscribes to via an RSS {Really Simple Syndication) feed or other means of transmitting information over the Internet. The RSS file format is a family of web feed formats specified in XML and used for Web syndication. RSS delivers its
7/26

information as an XML file called an "RSS feed", "Webfeed", "RSS stream", or "RSS
channel". These RSS feeds provide a way for users to passively receive newly
released content (such as text, web pages, sound files, or other media); this may be the
fuU content itself or just a link to it, possibly with a summary or other metadata.
[0032| In a typical use scenario, a content provider publishes a feed link on
their site which end-users can add to an aggregator program running on their machine.
Periodically (typically every 5-10 minutes, though most aggregators make this user
configurable), the aggregator asks all the servers in its feed list if they have new
content. If so, the aggregator either makes a note of the new content or downloads it.
fn this example, the map of Paris is routed to the French Class 101 Group's home
page 222. On the French Class 101 Group's home page, objects that have been saved
and projects that have been created by group members are shown. For example, the
map of Paris the user just collected is posted along with other objects as item 224.
[0033] Figure 3 illustrates a method of annotating information collected
according to an embodiment of the present invention. In Figure 3, a user-interface window 302 displays the user-specified annotation terms "Paris, Honeymoon, 12.26.05" of the portal "Trip to France." The user-specified annotation terms are entered by the user in an edit field at the time a saving portal is created. Note that these user-specified annotation terms may be revised using an edh operation subsequently. In addition to text, any media asset may be attached to an object as an annotation. In this example, a user-defined icon, a thumbnail of the Eiffel Tower 304, is used to label objects saved in the "Trip to France" portal. Also shown in Figure 3, the user-interface window includes a display toggle 303. When the display toggle 303 points downwards, representative views and the automatically created annotations of the objects stored in the portal are displayed. As shown in Figure 3, the numerals 305, 306, 307, 308, and 309 indicate the five objects collected. The objects collected in the persistent saving portals acquire both user-defined annotations and implicit annotations. In one implementadon, each object is unique in that a unique identifier is assigned to it. The thumbnail of Eiffel Tower 304 is attached to each object. The user-defined icon allows for better organization and annotation of the objects collected in the portal. In another embodiment, a person's picture may be used as the user-defined icon to label information received/collected from that person. Note that such support for non-textual metadata enables query and retrieval of objects using properties, like computer vision, of the objects. For example, the ability to search
8/26

color properties of an image or to search shapes of graphical objects may resuh in a
different set of objects than simply search objects annotated with textual terms.
[0034] One aspect of the present invention is that the annotation data are
attached to (he objects collected in the portal automatically, without manual intervention after the initial setup, based on the terms defined by the user, also known as user-specified terms, when the portals are initially set up. Other implicit terms, such as the user's name, are determined from the owner or login of computing device. The file type is determined from the source of the data or provided by the URL of the data. In addition, the computing device can provide other types of implicit data, such as the date, time of the day, access permission, etc. The user-specified and implicit annotation data, also known as the metadata of the objects, are made available to the user and can be attached to the objects coHected when the object is transferred from one person to another.
[0035] In one embodiment, when an object is transferred from one person to
another, the method accumulates new metadata to the existing metadata that has
already been attached to the object. Thus, the method assigns a set of unique
metadata to each object. In such a way, the metadata supports citation and copyright
requirements as well as delivery of context. The user may used the metadata to find
the original website where an object was collected from, and allows the user to
retrieve other information from the website if necessary. This method of gathering
and annotating information supports the creation of derivative works by the user.
This is because not only the method supports adding metadata to each object gathered,
it also maintains the history, authorship, context, and location of the metadata.
[0036] Figure 4 illustrates examples of the objects collected in each persistent
saving portal of Figure 2 according to an embodiment of the present invention. As shown in Figure 4, both the "'Xmas ideas" and 'Trip to France" portals are open. The objects in the 'Trip to France" portal are similar to the ones shown in Figure 3. For the "Xmas ideas" portal, the objects are annotated with user-specified terms "2005, Christmas, family & friends" 402. The "Xmas ideas" portal includes three gift ideas, namely a doll for Klaire 404, a sail boat for Mike 406, and a tent for Anna 407. The user-specified terms "2005, Christmas, family & friends" and implicit terms "Karon" and "jpg" are automatically generated and attached to each of the gift ideas. The name of the receiver of a gift, such as Anna, is provided by the user as a user-specified term. In the portal "My workspace," the user may store various work
9/26

related information, including for example "Objects of interest." In this manner, the portal acts as a library for storing a collection of information that is relevant to the user's work. Potentially usefully and yet unstructured objects, or ideas in progress may be collected in one or more of such "Objects of interest" saving portals. These saving portals allow the user to collect he has not yet decided how to use, but he thinks the objects may be useful, and the user may organize such objects later into collections.
[0037] Note that the objects collected in the portals are more than lumps of
text and pictures. These objects may be used in conjunction with other information
available to an Internet content provider to provide additional information, goods, or
services to the user. For example, the objects collected in the "Xmas ideas" portal
may be linked to the shopping domain 106 of Figure 1. In this manner, the user may
be able to find the dealers in the local area that sell the sail boat. In addition,
information may be provided to the user to allow him to compare features and prices
for different models of sail boats. Information about the accessories of the sail boat
may also be provided to the user to further enrich the user experience of the sail boat.
Such information may be displayed in certain ways, such as a grid, or ranked by
particular criteria, for example price, selected by the user. The way the objects are
collected and annotated enables information to be viewed in different intelligent ways.
[0038] For another example, conventionally when people see an address on a
webpage, they either manually cul-and-paste the text into another document or manually write down the address on a piece of paper. Converting this address into an address-book item involves a number of tedious and time consuming steps. With the present invention, the addition of the metadata enables the object to provide the related context. For example, this address object may be linked to the Maps domain of an Internet content provider to obtain the name, phone number, location, and driving directions to the business at this address, or linked to the News domain of an Internet content provider to obtain additional information about the business at this address.
[0039] Figure 5 illustrates a mobile device running the applications described
above according to an embodiment of the present invention. In this example, the mobile device 500 is the palmOne device made by Palm, Inc., of Sunnyvale, California. Note that the applications described above may be run on different form of user devices, in additional to the traditional desktop computing devices. This
10/26

capability allows users to have multiple access points to information saved in the portals anywhere and anytime. To accomplish the capability of maintaining persistent saving portals, the objects contained in the persistent saving portals of a client device (e.g. desktop or mobile device) are saved and mirrored online in servers 102 and databases 105 of Figure 1. As a result, a user can have universal access to the information saved in the persistent saving portals via an Internet content provider's network.
[0040] The benefit of having universal access to the persistent saving portal
by different user devices can be illustrated by the following example. Assuming a user made a travel arrangement from his desktop computer at home and saved the itinerary in a persistent saving portal. While traveling, the user may access the itinerary saved in the persistent saving portal using a mobile device. For example, the user may obtain the hotel address with his mobile device. From the hotel address, the user may obtain map information and driving directions to the hotel through the Maps domain of the Internet content provider. Thus, the capability of having universal access to the persistent saving portals enables the user to navigate to his destinations. In one approach, the user may harvest information into one of the saving portals using their mobile device. For example, the user may scan a bar code, take a photo or video and immediately add the object to the portal with metadata. The application may apply the geo-location of the user automatically to assign implicit data to a photo in a saving portal, for example, photo taken in Paris would go into the Trip to France portal while the user is traveling in Paris.
[0041| In one embodiment, a portal may be shared among multiple users. For
example, user A and user B are working on different portions of a same project, and user B depends on the output of user A to continue his work. Each time user A finishes a task, he may place the task in a first shared portal such that user B may receive a notification of user A's status and retrieve the information from the first shared portal. Similarly each time user B finishes a task, he may also place the task in a second shared portal such that user A may receive a notification of user B's status and continue to supply new tasks to the first shared portal. The ability to share information collected may be done with an individual object, with a set of objects, or with the user's collection of objects in all saving portals. The user may define a customized sharing model for each portal, namely public, private, or to my friends only.
11/26

[0042] Figure 6 illustrates another set of persistent saving portals according to
an embodiment of the present invention. In the example shown in Figure 6, a thumbnail image 600 and a corresponding enlarged image of nine portals are provided. Each portal may be used to store different information selected by the user, and each portal may be customized to support different user-specified annotations for collection of different information. Each persistent saving portal may be linked to other portals through links (indicated in dotted lines) 602. A large number of persistent saving portals can be employed to allow the user to customize different sets of objects. Each portal provides a pre-determined area for storing information in real time seamlessly without the user having to stop and annotate each item saved in the portal. Each portal may be implemented as a widget and the user may combine multiple widgets to satisfy to different needs and purposes. In an alternate approach, the user may use a single widget to implement multiple portals to satisfy the different needs and purposes.
[0043] In one embodiment, the browser and the information gathering
application (also referred to as the gobbler application) may be implemented with JavaScript running on the user's computing device, such as a desktop personal computer. The gobbler application presents a user interface for collecting information, which is shown as one or more saving portals 206, 208, and 210 as in Figure 2A, and listens for data to be collected on a Transmission Control Protocol/Internet Protocol (TCP/IP) port using a dynamically linked library (DLL). In this example, either the web site provides the JavaScript or it is injected into the page using a bookmarklet. A bookmarklet is a small JavaScript program that can be stored as a URL within a bookmark in most popular web browsers, or within hyperlinks on a web page.
[0044] The browser JavaScript creates a Flash object and parses contents of a
web page into a plurality of collectable objects, creating collectable objects that may be selected, dragged, and dropped to a saving portal. A user may gobble data by dragging and dropping one or more collectable objects of the web page onto a saving portal, or by clicking on an action button near that element in the page. As objects are gobbled, the JavaScript in the web page uses the Flash object to establish a connection to a widget running on a predetermined TCP/IP port. The JavaScript then sends the data about the object being gobbled over this TCP/IP connection. The receiving widget processes the object by annotating it with various attributes, such as time, date,
12/26

etc. The receiving widget then sends the object to a backend server for storage and
ftirther processing. The further processing includes analyzing the source of the object
to establish other metadata related to the object that may be collected.
[00451 The JavaScript in the widget contacts the gobbler service using the
XMLHttpRequesl (XHR) or other similar techniques to add the object to the
appropriate user's store. XHR is an API that can be used by JavaScript, JScript,
VBScript and other web browser scripting languages to transfer and manipulate XML
data to and from a web server using HTTP, establishing an independent connection
channel between a web page's Client-Side and Server-Side. The data returned from
XMLHttpRequest calls may often be provided by back-end databases. Besides XML,
XMLHttpRequest can be used to fetch data in other formats, e.g. JSON or even plain
text. XMLHttpRequest is a part of the Ajax web development technique, and it is
used by many websites to implement responsive and dynamic web applications.
[0046] In another embodiment, the gobbler application includes only
JavaScript running in the browser of a user's computing device. Similarly, in thi.s
example, either the web site provides the JavaScript or it is injected into the page
using a bookmarklet. The browser JavaScript parses the web page, creating
collectable objects that may be selected, dragged, and dropped into a saving portal, in
addition, the browser JavaScript creates new page element presenting a user interface
comprising one or more saving portals for collecting information. Users may gobble
data by dragging and dropping the collectable objects of the web page onto the
gobbler part of the page or by clicking on an action button near that collectable object
in the page. As objects are gobbled, the JavaScript annotates the object with various
attributes, such as time, date, etc. The page JavaScript then sends the object to a
backend server for storage and further processing. The further processing includes
analyzing the source of the object to establish other related metadata that may be
collected. The JavaScript in the web page contacts the gobbler service using the XHR
or other similar techniques to add the object to the appropriate user's store.
[0047] In yet another embodiment, the Yahoo! widget engine described below
may be used to implement the persistent saving portals of the present invention. Persons of ordinary skill in the art would appreciate that other implementations or other types of widget engines may be used to implement the persistent saving portals. In addition, in the following discussions, methods of constructing and using the widgets are described for computing devices running Windows operating system.
13/26

Persons of ordinary skill in the art would understand that similar implementations
may be done for the Macintosh, UNIX, or Linux operating system.
[0048| The Yahoo! widget engine, also referred to as "widget engine" or
"engine" in this document, uses the Extensible Markup Language (XML) to define
widgets and objects. This language forms a clear hierarchical structure for each
object, the order the object is drawn in, and the order to associate the attributes of
each object. An example of a widget is shown as follows:


main window
500
500

250
250
menter


iexll
250
100
menler

sunl.opacity ~ (sunI.opacity /100) * 90;




[0049| The widget reduces the opacity of an image by 10% every time the
user clicks on the text that says "Click Here." This sample widget is used to illustrate a few points. First, the structure of the widget uses a symmetrical language XML such that each object specifier (e.g. ) has a corresponding terminator {). Within these pairs of specifiers and terminators, the attributes of the objects are
14/26

defined, such as screen positions, alignments, etc. Second, objects defined in XML
may be manipulated in JavaScript. Third, the name of objects begins with a letter.
Only letters, numbers and underscores are allowed for a name. The XML description
of a widget is stored in a file with the extension ,kon. In practice, a widget may have
many images and text objects, multiple JavaScript sections, and may create new
objects at runtime using JavaScript to implement complex functionality. The
following sections describe various embodiments of techniques and codes for creating
a new widget.
[0050] There are two styles of tag notations in terms of the XML syntax.
which are:

images/image.png
my Image

or:

A user may mix and match the two tag notations as follows:

my Image

[0051| Entities are an XML construct that allows a user to specify a character
via a special escape sequence. Some characters that are used to parse the XML syntax
are considered reserved. The symbol & is used as the entity escape start (and for that
reason is also a reserved character). The standard set of entities is used to represent
XML special characters:
& &
&quol; "
&apos: '
&gl>
15/26

A user may also use entities to specify a character by its Unicode code point:

(&Ux20;
(0052) Since the XML engine looks for the symbols to mark blocks
of XML data, the JavaScript engine needs to have these symbols replaced with & it
and (fe g? respectively. For example:

if(x <:> displayResultsQ;

[0053] Alternatively, the user may use XML comments to hide the JavaScript
code from the XML engine as is commonly done in HTML:

if(x displayResultsQ;

[0054] In yet another approach, the user may use CDATA sections as follows:

if(x displayResultsO;
]]>
(0055] These alternative approaches make the code easier to read. In yet
another approach, a user may put the XML parser in a "strict mode," which enforces the rules of XML in ways the parser normally does not do. To enable the strict mode, the following line is added to the top of the XML file:
16/26


[0056] In the strict mode, the following aspects of the program are enforced:
I) All attribute values are put into quotes; 2) No stray "tfe" characters are allowed in a
normal text section; 3) Entities (things that start with "ife") are evaluated inside
attribute values; 4) No double dash ("--") allowed inside a comment. For this reason,
it is preferable to put code into CDATA blocks; and 5) If an external file is included,
there is no need to replace entities such as & It in that file.
[0057] File paths in the widget engine are relative to the location of the XML
file. This means a file reference without a directory (e.g. main.js) will be searched in
the same directory as the XML file while one with a directory {t.%. javascripi/mam.is)
will be searched in the specified subdirectory of the directory where the XML file
resides. It is preferable not to use absolute paths (e.g. ones that begin with a I) since
the disk layout of different computers may differ greatly.
[0058] In Windows machines, the files that make up a widget are stored in a
.widget file. This is a standard ZIP file that has had its extension changed to .widget.
The Windows versions of the widget engine can read the zipped up .widget files.
This is also the format of choice when creating cross-platform widgets. In one
example, a widget bundle has the following structure:
my Widgel.widgel
Conlenls
myWidget.koyi
Resources

[0059| The .kon file contains the actual widget code (similar to the sample
widget in the section above). In one implementation, the .kon file is contained in the
Contents folder. A user may put resources, such as pictures, in it. Typically, the
resources would be put into a Resources folder, as shown above.
|0060] If the user does not use the widget converter and instead decides to zip
the files manually, this may be done on a Windows computer by right-clicking the widget folder and creating a ZIP file from that. It should be noted the user does not need to create a zipped up widget file for testing each time the user makes a change
17/26

while developing the widget. The user may double-click the .kon file to achieve the same effect.
[00611 Note that the widget package should not be modified at run time. In
other words, one should not use the widget package to store information inside of itself. While many widgets use preferences to store their settings, a widget may store information inside its own package. In addition, when the widget engine runs a zipped widget, it first unzips it into a special location and then runs it from there. This unzipping happens every time one runs the widget, so if information is stored in the widget's unzipped package, it may be overwritten. To accommodate widgets that need to store permanent data, a system widget DalaFolder folder path may be used to store a widget's permanent information.
[0062] In yet another embodiment, a widget engine may support a flat-file
format that is not zipped. When the flat-file format is not compressed, the size of a
widget is larger than the size of the widget in the zip formal. Since images take up
most of a widget's size, the increase is about 15% on average because images are
normally already in a compressed format (PNG, JPG) while text files are typically not
compressed. The benefit of having the files compressed is that there is no need to
store the files in RAM until actually needed because the files are file-mapped. By
using this new format, the time for launching a widget application is reduced.
[0063] When a widget uses a flat file format, items such as Dynamic-Link
Libraries (DLLs) that may have been packaged with the widget may not be used unless a new API (widget.extract File () ) is used to extract the file out of the flat-file widget into a location in the file system. One exception is that sound files played through the play () function may work without any changes.
[0064| This section discusses how widgets are run and some of the issues that
need to be addressed. When a widget is opened, it is run as a separate process. This is done to ensure one widget does not affect the rest of the widgets that a user may use. A widget that is in zip format is unzipped Into a special location (CJDocumenls andSeltings//Local Settings /Application Data on a PC). A widget that is not zipped is run from where it is located. For this reason, one may not rely on where the widget is. Once the .kon file is located in the widget, the current directory is set to the directory in which the .kon file is located. So for example, if a .kon file is in the Contents folder, the current working directory would be Contents. This allows relative paths to Resources to function properly. A .kon file would reference an
)8/26

image as Resources/Image I.png, for example, if its images are in the Resources folder in Contents folder.
(0065] When the .kon file is located and the current directory is set, the file is
parsed and the objects defined therein are created. After everything is created successftilly, the onload handler is called. Then the widget runs the initialization routine. Note that the onload handler is typically executed before the widget is rnade visible. In other words, many widgets set their window to be hidden at first and become visible upon complete execution of the o«ioot/handler. After the o«Io«c/ handler is run successfully, the widget is up and running. Note that the next time the widget is run, it is unzipped again. For this reason, one cannot rely on storing information in the widget bundle. Instead, it is preferable to store information in the widget's DalaFolder as discussed previously.
[0066] The widget engine keeps track of what widgets may be opened
automatically. The next time the widget engine is launched, it automatically reopens
any widgets that were running at the time when the widget engine was last shut down.
[0067] Actions are important in widgets because they are where a user defines
how a widget behaves when he interacts with the widget. In one implementation, an action is specified by setting the action to certain JavaScript text. This text is evaluated and run when the user clicks, for example: prmt( "hello");
[0068] However, there are at least two limitations: 1) the user may not use the
JavaScript 'this' object to refer generically to the object for which the action was running; and 2) if the user has several objects with the same code, he may have to duplicate the JavaScript and change the names of the objects to reflect each object to which he has attached the code.
[0069] To remedy these limitations, the widget engine supports proper
JavaScript functions for these actions. For example, no parameters are sent to the actions. In addition, an onMouseUp handler may receive the x and y coordinates of the mouse instead of inspecting syslem.event. To use functions, a user may either use a function in the XML (by using an attribute), or set the property to the function to call in JavaScript, as shown below:
19/26

-lnXML->
// in Javascript
mylmage.otiMouseUp = myMouseUp;
// and someplace in the JS code, the function need to be defined: function myMouseUpfJ
i
print( this.opacity );
}
[0070| In the XML description, a user may set the property. This
defines the global JavaScript object that may be created and bound to the object of which the name is a part. For example, the code
creates a JavaScript variable at the global scope with the name mainWindow. Note that all names need to be unique. In addition, since internally these names are used to track objects, they cannot be changed. The widget engine enforces this by making all name properties read-only. When a user creates an object on the fly using JavaScript, the object is given a generic name, such as ImageOO 1.
[0071] Some provisions are made for debugging the widgets. There is an
XML tag "debug" that a user may set to "on" for debugging purposes. When the
"debug" tag is set to on, a debug output window will open when a widget is launched.
Calls to logO orprintfj in the JavaScript code are routed to this debug window. Any
errors encountered inside the widget engine are also reported in this window. Note
that the debug window will not open unless the debug tag is set to on.
[0072] While developing a widget, it is preferable that the debug tag is turned
on so that it can inform the user about errors that occurred while the widget is
running. For example, if an attribute is spelled wrong, the output window informs the
user about this error, along with where in the code the problem may be found.
[0073] There are two types of security windows that may appear in the widget
engine. The first is a first-run / modification window. On a first run of a widget that the widget engine has not seen before, a window appears to inform the user that a new widget is about to open and ask the user to confirm the action. This is to protect
20/26

against widgets that may just run without the user's knowledge. Also, if the user allows a widget to run and subsequently the widget is modified, another window appears the next time the widget is launched, informing the user about the modified widget. Again, the user may confirm or deny the request to launch this modified widget.
[0074] If a user is in the process of debugging a widget, the user may turn on
the debug mode, which may suppress the first-run / modified security windows. Thus the user is not interrupted every time the user modifies the code and reloads the widget.
[0075] The second type of window is a 'sandbox' window. In one approach,
the sandboxed action relates to user's login to his Internet content provider account The first time a widget attempts to login to his account, a window will appear to alert the user of this fact and ask whether the widget should be granted permission to use the user's data on the account.
[0076] It will be appreciated that the above description for clarity has
described embodiments of the invention with reference to different functional units and processors. However, it will be apparent that any suitable distribution of functionality between different functional units or processors may be used without detracting from the invention. For example, functionality illustrated to be performed by separate processors or controllers may be performed by the same processors or controllers. Hence, references to specific functional units are to be seen as references to suitable means for providing the described functionality rather than indicative of a strict logical or physical structure or organization.
[0077] The invention can be implemented in any suitable form, including
hardware, software, firmware, or any combination of these. The invention may optionally be implemented partly as computer software running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally, and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units, or as part of other functional units. As such, the invention may be implemented in a single unit or may be physically and fimctionally distributed between different units and processors.
[0078] One skilled in the relevant art will recognize that many possible
modifications and combinations of the disclosed embodiments may be used, while
21/26

still employing the same basic underlying mechanisms and methodologies. The foregoing description, for purposes of explanation, has been written with references to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described to explain the principles of the inventioii and their practical applications, and to enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
22/26


What is claimed is:
1. A method for collecting information on the Internet, comprising:
parsing contents of a web page to form a plurality of collectable objects;
selecting one or more objects from the plurality of collectable objects;
storing the one or more objects to one or more saving portals;
armotating the one or more objects in accordance with user-specified data; and annotating ihe one or more objects in accordance with implicit data of the one or more saving portals.
2. The method of claim I, wherein Ihe one or more objects selected from the web page comprise one or more pieces of information selected from the group consisting of text, audio, video, graphics, image, and URL.
3. The method of claim ), wherein the one or more objects comprise information about a person, includingjob title, professional association, contact information, and area of expertise.
4. The method of claim 1, wherein the implicit data comprises social data associated with Ihe one or more objects, including reviews, rating, and number of times the one or more objects are viewed.
5. The method of claim 1, wherein the implicit data comprises one or more items selected from the group consisting of:
date an object was created;
location the object was created;
date the object was collected;
title of the object;
original ovmer of the object;
intermediate owner of the object; and
URL to the web page of the original owner.
6. The method of claim 1 fiirther comprising:
23

organizing one or more saving portals according to user-defined parameters to form sets of objects; and
linking the sets of objects to additional information on the Internet, wherein the additional information includes shopping, news, and map information.
7. The method of claim 1, wherein storing the one or more objects further comprises:
storing the one or more objects on the Intemet; and
sharing the one or more objects across multiple user devices.
8. The method of claim 7, wherein sharing the one or more objects comprises: providing access to the one or more objects to multiple user devices, including stationary-computing devices and mobile devices.
9. The method of claim 1 further comprising;
annotating the one or more objects automatically, without manual intervention, using user-specified data; and
armotating the one or more objects automatically, without manual intervention, using implicit data of the one or more saving portals.
] 0. The method of claim 1, wherein annotating the one or more objects in accordance with
implicit data further comprises:
identifying sources of the one or more objects; and
providing copyright information of the sources of the one or more objects.
tl. The method of claim 1, wherein annotating the one or more objects in accordance with implicit data further comprises:
retrieving additional information using the user-specified data and impJicil data associated with the one or more objects; and
constructing structured metadata of the one or more objects using the additional information retrieved.
12. The method of claim 1 further comprising:
24

sending one or more objects from the one or more saving portals to a destination, wherein the destination includes ai leas: an item selected from the group consisting of a group mailing Jjst and a group website.
13. A computer program product for collecting infonnation on the Internet, comprising a
medium storing computer programs for execution by one or more computer systems, the
computer program product comprising:
code for parsing contents of a web page to form a plurality of collectable objects; code for selecting one or more objects from the plurality of collectable objects; code for storing the one or more objects to one or more saving portals; code for annotating the one or more objects in accordance with user-specified data; and code for annotating the one or more objects in accordance with implicit data of the one or more saving portals.
14. The computer program product of claim 13, wherein the one or more objects selected from the web page comprise one or more pieces of information selected from the group consisting of text, audio, video, graphics, image, and URL.
15. The computer program product of claim 13, wherein the one or more objects comprise information about a person, including job title, professional association, contact information, and area of expertise.
16. The computer program product of claim 13, wherein the implicit data comprises social data associated with the one or more objects, including reviews, rating, and number of times the one or more objects are viewed.
17. The computer program product of claim 13, wherein the implicit data comprises one or more items selected from the group consisting of
date an object was created; location the object was created; date the object was collected; title of the object; original owner of the object;
25

intermediate owner of the object; and URL to the web page of the original owner.
18. The computer program product of claim 13 further comprising;
code for organizing one or more saving portals according to user-defined parameters to form sets of objects; and
code for linking the sets of objects to additional info/Tnation on the Internet, wherein the additional information includes shopping, news, and map information.
19. The computer program product of claim 13, wherein the code for storing the one or more
objects further comprises:
code for storing the one or more objects on the Internet; and
code for sharing the one or more objects across multiple user devices.
20. The computer program product of claim 19, wherein the code for sharing the one or more
objects comprises:
code for providing access to the one or more objects to multiple user devices, including stationary computing devices and mobile devices.
21. The computer program product of claim 13 further comprising:
code for annotating the one or more objects automatically, without manual intervention, using user-specified data; and
code for annotating the one or more objects automatically, without manual intervention, using implicit data of the one or more saving portals.
22. The computer program product of claim 13, wherein the code for annotating the one or
more objects in accordance with implicit data further comprises:
code for identifying sources of the one or more objects; and
code for providing copyright information of the sources of the one or moie objects,
23. Thecomputerprogramproduct of claim 13, wherein the code for annotating the one or
more objects in accordance with implicit data further comprises:
code for retrieving additional information using the user-specified data and implicit data associated with the one or more objects; and
26

code for constructing structured metadata of the one or more objects using the additional information retrieved.
24. The computer program product of claim 13 further comprising:
code for sending one or more objects from the one or more saving portals to a destination, wherein the destination includes at least an item selected from the group consisting of a group mailing list and a group website.
27

Documents:

http://ipindiaonline.gov.in/patentsearch/GrantedSearch/viewdoc.aspx?id=by+HkzMpDmOs7tO8569bhw==&amp;loc=egcICQiyoj82NGgGrC5ChA==


Patent Number 278360
Indian Patent Application Number 1401/CHENP/2009
PG Journal Number 53/2016
Publication Date 23-Dec-2016
Grant Date 21-Dec-2016
Date of Filing 11-Mar-2009
Name of Patentee Excalibur IP, LLC
Applicant Address 701. First Avenue. Sunnyvale. CA 94089. USA
Inventors:
# Inventor's Name Inventor's Address
1 KARON ANNE WEBER 246 28TH ACENUE, SAN FRANCISCO, CALIFORNIA 94121
2 JONATHAN TREVOR 2814 COZUMEK CIRCLE, SANTA CLARA, CALIFORNIA 95051
3 EDWARD HO 1869 HALF PENCE WAY, SAN JOSE, CALIFORNIA 95132
4 SAMANTHA M. TRIPODI 278 MOULTRIE STREET, SAN FRANCISCO, CALIFORNIA 94110
PCT International Classification Number G06F15/16
PCT International Application Number PCT/US2007/018446
PCT International Filing date 2007-08-20
PCT Conventions:
# PCT Application Number Date of Convention Priority Country
1 11/508,596 2006-08-22 U.S.A.