Title of Invention

A METHOD OF USING A MOBILE DEVICE TO MONITOR OCCURRENCE OF A PLURALITY OF EVENTS IN AN EXTERNAL MEDIA DEVICE

Abstract The present invention relates to a method of using ,a mobile device to monitor the occurrence of a plurality of events in an external media device comprising the steps of collecting information of the occurrence of the plurality of events from the external media device and sending the information to a central location for monitoring. The mobile device Gollects and sends the usage information to an operator network. The usage information can be sent through an SMS, MMS, mail, etc in a standard format. As described in the invention, the mobile dev:ice can collect the information through various methods. The mobile device can obtain the information from the external media device through a short range bearer mechanism. The bearer can be wired or wireless. The mobile device can also gather the information from internal applications being executed on the mobile device, when the mobile device is being used as a remote controller of external media device. The mobile device can collect the information from auxiliary devices such as remote controller as well, where the remote controller is designed to be capable of sending the information to the mobile device. Further, the mobile device can record small clips of audio and/or video samples from the external media device at sampled intervals with an encoding mechanisrT"!. The encoding mechanism should support a media search for the recorded samples. The recorded samples are sent to the operator network to gather the usage information of a program.
Full Text FIELD OF THE INVENTION
The present invention relates to the field of telecommunication. More specifically, the invention proposes a method of using a mobile device to monitor the programs being viewed / heard on an external media device by a user.
DESCRIPTION OF RELATED ART
Surveying people directly through statistical sampling is very time consuming and effort intensive. The cost involved is also high.
Other mechanisms such as "people meters" require installation of special devices in a sample of homes. This again involves cost and also reaches of the person installing such devices.
Indirect mechanisms such as judging viewer-ship based on response to contests etc need participation of users and are applicable only for certain kinds of programs.
As per EU Patent publication titled "Method and devices for obtaining information about the use of a television network" describes a method and system for obtaining usage information of viewing of channels on a television. The system comprises a gateway device that can be connected to the television in a wireless manner. The gateway device collects the usage information from the television. The gateway device then transmits the usage information to a remote station.
The gateway device uses a mobile communications network such as GSM and/or GPRS for transmission of the usage information to the remote station. However, the patent application does not explicitly mention that the gateway device can be a mobile phone.
A US Patent publication titled "Enhanced radio systems and methods describes an enhanced, radio system that can monitor listener usage and habits to provide a ratings service. As described in the patent application, a telephone may also be integrated into the radio. Further, the patent application describes a communication device that can be used to download songs on the enhanced radio system and can report the usage information to the ratings service. The patent application mentions the use of a mobile phone as a link to access remote data. However, the patent application does not explicitly mention that the communication device can be a mobile phone.
A Japanese Patent publication titled "Viewing information collection system and radio communication terminal with television broadcast receiving function" describes a portable telephone having a television broadcast receiving capability. The portable telephone transmits viewing information of a program viewed by its user. The viewing information is sent to a viewing information collection server through a mobile communication network and the Internet.
SUMMARY OF THE INVENTION
The present invention relates to the field of telecommunication. More specifically, the invention proposes a method of using a mobile device to monitor the programs being viewed / heard on an external media device by a user. The mobile device collects and sends the usage information to an operator network. The information can be sent through an SMS, MMS, mail, Data Call etc in a standard format.
As described in the invention, the mobile device can collect the information through various methods. The mobile device can obtain the information from the external media device through a short range bearer mechanism. The bearer mechanism can be wired or wireless. The mobile device can also gather the information frpm internal applications being executed on the mobile device, when the mobile device is being used as a remote controller. The mobile device can collect the information from auxiliary devices such as remote controller as well, when the remote controller is designed to be capable of sending the information to the mobile device. Further, the mobile device can record small clips of audio and/or video samples from the external media device at sampled intervals with an encoding mechanism. The encoding mechanism should support a media search for the recorded samples. The recorded samples are sent to the operator network to gather the usage information of a program.
Accordingly the present invention relates to a method for collecting usage information from the external media devices through software on the device and sending it to mobile.
Accordingly the present invention relates to a method for collecting usage information from auxiliary devices and sending it to mobile.
Accordingly the present invention relates to a method of collecting usage information from internal applications on mobile.
Accordingly the present invention relates to a Method of collecting usage information from audio and video samples recorded from the external media device.
Accordingly the present invention relates to a Method of receiving usage information from the external media device to the mobile device using wireless short range communication or wired communication.
Accordingly the present invention relates to a method described here is for media devices. However it could be enhanced to collect and send information about usage of several other devices at home (microwave, washing machines etc) and work (printers, servers etc.).
Accordingly the present invention relates to a method wherein the media usage information may be sent over the operator network. However, it may also be sent over short range communication to some auxiliary device. The auxiliary device could send this information to servers using some other communication mechanism.
Accordingly the present invention relates to a method wherein the media usage information may be collected by enterprises by hosting servers at community locations and using short range communication mechanisms.
Accordingly the present invention relates to a method wherein the media usage information may be sent immediately or collected over a period of time on the mobile.
Accordingly the present invention relates to a method wherein the usage information may be sent when a request is triggered from the mobile device or at periodic intervals. The usage information may also toe pulled from the network.
Accordingly the present invention relates to a method wherein the decision about which mechanism is to be used can be decided by the end user as a "user setting" on tooth the mobile as well as on the external media device or it could be a factory or network configured setting.
Accordingly the invention explains a method of using a mobile device to monitor the occurrence of a plurality of events in an external media device comprising the steps of:
Collecting information of the occurrence of the plurality of events, from the external media device;
and sending the information to a central location for said monitoring.
The mobile device collects the information from the external media device
«
through a short range bearer mechanism wherein the bearer mechanism can be wired or wireless mechanism. The mobile device collects the information from internal applications being executed on the mobile device. The mobile device collects the information from an auxiliary device associated with the external media device which is capable of collecting information, the communication medium between auxiliary device and mobile device can be short range bearer mechanism wherein the bearer mechanism can be wired or wireless mechanism. The mobile device collects information by means of recorded small clips of audio and/or video samples from the external media device at sampled intervals. The mobile device collects information by.an audio and/or video recording by the auxiliary device attached to the external media device. The mobile device collects the information by triggering the collection .of information through detecting the proximity of the mobile device to the external media device. The mobile device collects information using the auxiliary device which is being used to control the external media device.
These and other objects, features and advantages of the present invention will become more apparent from the ensuing detailed description of the invention taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF ACCOMPANYING FIGURES
Figure 1 depicts Mobile gets information about programs from external media devices.
Figure 2 depicts Mobile gets information from internal applications. Figure 3 depicts Mobile gets information from auxiliary device. Figure 4 depicts Mobile gets audio and/or video samples.
DETAIL DESCRIPTION OF INVENTION
The preferred embodiments of the present invention will now be explained with reference to the accompanying drawings. It should be understood however that the disclosed embodiments are merely exemplary of the invention, which may be embodied in various forms. The following description and drawings are not to be construed as limiting the invention and numerous specific details are described to provide a thorough understanding of the present invention, as the basis for the claims and as a basis for teaching one skilled in the art how to make and/or use the invention. However in certain instances, well-known or conventional details are not described in order not to unnecessarily obscure the present invention in detail.
Since mobile phones are popular in many homes and people also keep them in their vicinity most of the time, the probability of their presence near the user, when the user is using an external media device such as television or radio is very high. Therefore some methods are proposed wherein the programs being viewed/heard by the user can be monitored by the mobile device and usage information sent over the operator network.
The information could be sent through communication methods which could be defined by the operator of the mobile network like SMS, MMS or could be sent over the internet if the mobile has internet connectivity.
The profiles of several users could be accumulated at the network to detect loyalty of viewers to certain programs/channels.
There could be privacy options which can have the user decide whether the user would like such information to be collected and/or sent from his mobile. The user is also given an option to decide subset of information to send.
Several mechanisms are defined for identifying and sending this usage information:
A. The mobile could get the information about the program being viewed from the external media device through a short range bearer mechanism (such as BT, IR, UWB, WLAN) from the external media device. The bearer could also be a wired bearer (such as USB)
B. The mobile could get the information from internal applications. This is possible when the mobile is being used to control the external media device. (Example, if the mobile is being used as a remote control for a set top box, it can get information about the program being viewed on it).
C. The mobile can get the information from' auxiliary devices such as a remote control. For example, if the remote control of the external media device can be made capable of sending information such as channel number viewed, volume level (and other information such as given above). The bearer could also be a wired bearer (such as USB) or a short range wireless bearer (such as BT, IR, UWB, WLAN).
«
The mobile can get small clips of video and audio samples from the external media device through recording at sampled intervals with an encoding mechanism. Such mechanism includes those that enable media search (for example MPEG). Along with meta-information (mentioned above) these samples can be sent to a server and the media samples can be matched through media search algorithms (For example MPEG7 or MPEG21 searching mechanisms).
The information that can be captured includes:
a. Channel information
b. Number of times user changed the channel during viewing/hearing a program
c. Time of broadcast
NOTE: The program need not be a broadcast. It could also be listened/viewed through a DVD, Audio CD, or Could have been listened/viewed through some other device such as a hard disk, or on the mobile itself.
d. Ads watched/listened to
e. Information about interaction of the user with the handheld during
viewing/listening.
f. Information about the user presence in the vicinity of the television during duration of the program. The assumption here is that the user is keeping his mobile on his person or near him.
g. Program settings (muted, audio level, presence of a PIP program being viewed in parallel & information about such a program)
h. Profile of the user watching the program such as age, sex, profession etc.
i. User defined information
A format for packaging above information in a way that can enable parsing,
search, extending and publishing of such data will be defined.
Below is a definition of some modules for such a system:
a. A module which can collect "usage information" referred to here as the "Information Module"
b. A module which will establish communication between the mobile and the external media device referred to here as the "communication module". The communication can be secure or non-secure.
Each external media device will be identified uniquely to the mobile-device to
distinguish between the usage information.
Once the media device is switched ON, the mobile device will first be
connected to the media device through the communication module.
The Information module will then be activated and will start monitoring the
usage of the user. The mechanism to monitor this information will be defined.
i
The Information module will then send "usage information" to the mobile device through the communication module.
The source of usage information will change based on the different scenarios.
Scenario A (Fig 1)
In this scenario, the external media device (TV, Set-Top Box, Radio, Gaming Consoles etc.) will collect the information and send it to the mobile.
Scenario B (Fig 2)
The mobile has the information about media usage available to it through internal applications.
The internal settings of the external media device (including channel ordering on the media device, channel information, program information) are available through these applications to the mobile.
They can be obtained in one of the following ways:
a. The mobile has a sync-up with the external media device and a mechanism to get these settings is defined between the mobile and the external media device.
b. The mobile obtains these settings from the operator network.
If the mobile is used to control the external media device (for example as a remote control) then these "settings" can be combined with the control data (such as time of switching ON/OFF, change from X channel to Y channel) to create the "media usage information".
Another possibility is that the mobile has information only about the usage of TV and can send only the time of usage and the duration. This method can provide some "lite" information , about TV usage pattern instead of complete information about the popularity of particular channels/programs.' In such cases an application on the mobile can keep track of collecting this minimal information from the external media device.
Such information may be captured by sniffing the control signals from the auxiliary device to the external media device and interpreting this.
Yet another possibility is that the mobile records information about media played through applications present on it or connected to it (for example radio on mobile, audio or video files played on mobile). This information along with
some metadata about the media played back can be sent. Scenario C (Fig 3)
In this case the mobile has a sync-up mechanism with the auxiliary device which is being used to control the external media device and the required usage information can be obtained from this device.
It is also possible that the auxiliary device provides only usage information and rest of the processing is done on the mobile.
Scenario D (Fig 4)
The mobile obtains samples of the audio and/or video clips from the program being viewed/heard on the external media device. These samples are encoded (such as in MPEG format) and sent along with metadata such as the time of viewing and profile present on the mobile as "usage information".
At the server end, based on the analysis and matching of these samples, the program that was viewed can be identified.
The samples can be obtained in the following ways:
1. By audio recording from the mobile
2. By video recording from the mobile
3. By audio and/or video recording by an auxiliary device attached to the external media device and sent to the mobile through some wireless transmission technique such as BT, IRDA or by the mobile being attached to the external media device via USB or serial cable
The capture of video could be continuous or as discrete snapshots (images) of the screen.
Sending the information
The mobile device may send the "usage information" through the operator network to:
a. a preconfigured destination
b. user defined destination
The method involved could be by SMS, MMS, E-Mail or a WAP/HTTP connection. An IMS based application could also be used for this.
The usage information could be packaged In a proprietary or standard parsing format such as HTML, XML etc.
A protocol to exchange the media usage information with the server on the operator network will be defined.
The mechanism to package the profile information of the user(s) will also be
defined.
Triggering collection/reception of usage information
Another aspect of this invention involves the detection of the proximity of the mobile handset to the external media device and then triggering the collection/reception of usage information. This could be accomplished by embedding an RFID tag on to the mobile and having it read by a RFID reader on the external media device.
It could also be accomplished by having a reader on the mobile device and a tag on an auxiliary device.
It could also involve the placement of a tag on the mobile device and a general purpose reader placed externally in the vicinity of the external media device.
In each of the above cases, the action of collection/reception of usage information could be triggered on the mobile device only on mutual detection between the mobile device and the external media device.
Although the present invention has been fully described in connection with the preferred embodiments thereof with reference to the accompanying drawings, it is to be noted that various changes and modifications are possible and are apparent to those skilled in the art. Such changes and modifications are to be understood as included within the scope of the present invention as defined by the appended claims unless they depart there from.
Glossary of Terms and their definitions:
Wireless Short Range Communication - Includes BT, IRDA, UWB, WLAN technologies
Media Usage Information, Usage Information, Information - Terms are used interchangeably to mean the information relevant to the programs listened/viewed by the user on the external media device.
Wired Communication - IEEE1394, USB, Serial Port,
Media Encoding Standards - MPEG1, MPEG2, MPEG4
Handheld, Mobile Handset, Mobile,' Mobile Device, Mobile Communication device - Terms used interchangeably for referring to a Wireless Handheld Communication Device



We Claim:
1. A method of using a mobile device to monitor the occurrence of a plurality of events in an external media device comprising the steps of:
Collecting information of the occurrence of the plurality of events from the external media device; and sending the information to a central location for monitoring.
2. The method as claimed in claim 1 wherein, the mobile device collects the information from the external media device through a short range bearer mechanism wherein the bearer mechanism can be wired or wireless mechanism.
3. The method as claimed in claim 1 wherein, the mobile device collects the information from internal applications being executed on the mobile device.
4. The method as claimed in claim 1 wherein, the mobile device collects the information from auxiliary device associated with the external media device which is capable of collecting information. The communication between the mobile device and auxiliary device is through a short range bearer mechanism wherein the bearer mechanism can be wired or wireless mechanism.
5. The method as claimed in claim 1 wherein, the mobile device collects information by means of recorded small clips of audio and/or video samples from the external media device at sampled intervals.
6. The method as claimed in claim 1 wherein, the mobile device collects the information'by an audio and/or video recording through an auxiliary device of the external media device.
7. The method as claimed in claim 1 wherein, the mobile device collects the information by triggering the collection of information by detecting the proximity of the mobile device to the external media device.
8. A method of using a mobile device to monitor the occurrence of a plurality of events in an external media device substantially described particularly with reference to the accompanying drawings.

Documents:

http://ipindiaonline.gov.in/patentsearch/GrantedSearch/viewdoc.aspx?id=ybbaoOVMRvH2fLv/jtFDuQ==&loc=egcICQiyoj82NGgGrC5ChA==


Patent Number 278899
Indian Patent Application Number 1479/CHE/2007
PG Journal Number 01/2017
Publication Date 06-Jan-2017
Grant Date 03-Jan-2017
Date of Filing 09-Jul-2007
Name of Patentee SAMSUNG R&D INSTITUTE INDIA-BANGALORE PRIVATE LIMITED
Applicant Address #2870 ORION BUILDING BAGMANE CONSTELLATION BUSINESS PARK OUTER RING ROAD DODDANEKUNDI CIRCLE MARATHAHALLI POST BANGALORE 560037
Inventors:
# Inventor's Name Inventor's Address
1 GOPI RAMAMURTHY EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
2 GOPI RAMAMURTHY EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
3 AMITABH THAPLIYAL EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
4 GOPI RAMAMURTHY EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
5 KAMAL KUMAR KHUBANI EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
6 BHAGAVATHI SUBRAMANIAN PRAKASH EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
7 IYER VINAY CHANDRAN EMPLOYED AT SAMSUNG INDIA SOFTWARE OPERATIONS PRIVATE LIMITED BAGMANE LAKEVIEW BLOCK 'B' NO 66/1 BAGMANE TECH PARK C V RAMAN NAGAR BYRASANDRA BANGALORE 560093
PCT International Classification Number H04L
PCT International Application Number N/A
PCT International Filing date
PCT Conventions:
# PCT Application Number Date of Convention Priority Country
1 NA