Title of Invention

SYSTEM FOR PROCESSING DATA AND METHOD THEREOF

Abstract

The invention relates to a method of processing data, the method comprising steps of enabling to (210) encrypt first data for a first source, and encrypt second data for a second source, (220) provide the encrypted first and second data to a server that is precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other, (230) perform a computation on the encrypted first and second data to obtain a similarity value between the first and second data so that the first and second data is anonymous to the second and first sources respectively, the similarity value. providing an indication of a similarity between the first and second data. The method may further comprise a step (240) of using the similarity value to obtain a recommendation of a content item for the first or second source. The first or second data may comprises a user profile or user ratings of content items. One of the applications of the method may be in collaborative filtering systems.

Full Text

System for processing data and method thereof The invention relates to a system for processing data, the system comprising a first source having first data, a second source having second data, and a server. The invention further relates to a method of processing data and a server for processing data. An information system comprising a plurality of user devices for storing user data expressing user preferences to media content, purchases, etc. is known. Such an information system typically comprises a server collecting the user data. The user data is analyzed for determining correlations between the user data, and providing a particular service to one or more users. For example, a collaborative filtering technique is a method for content recommendation that combines interests of a large group of users. Memory-based collaborative filtering techniques are based on determining correlations (similarities) between different users, for which ratings of each user are compared to the ratings of each other user. These similarities are used to predict how much a particular user will like a particular piece of content. For the prediction step, various alternatives exist. Apart from determining the similarities between users, one may determine similarities between items, based on rating patterns received from the users. A problem in this context is the protection of the privacy of the users, who don't want to reveal their interests to a server or to other users. It is an object of the present invention to obviate the drawbacks of the prior art system, and provide a system for processing data, where the user privacy is protected. This object is realized in that the system comprises a first source for encrypting first data, and a second source for encrypting second data, a server configured to obtain the encrypted first and second data, the server being precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other, computation means for performing a computation on the encrypted first and second data to obtain a similarity value between the first and second data so that the first and second data is anonymous to the second and first sources respectively, the similarity value providing an indication of a similarity between the first and second data. In one embodiment of the present invention, the similarity value is obtained using a Pearson correlation or a Kappa statistic. In another embodiment, the computation means is realized using a Paillier cryptosystem, or a threshold Paillier cryptosystem using a public key-sharing scheme. The computational steps required for determining the similarity value comprise a calculation of, for example, vector inner products and sums of shares. After the computation, encryption techniques are applied to Hie data to protect them. In a sense, this means that only encrypted information is sent to the server, and all computations are done in the encrypted domain. In a further embodiment of the present invention, the first or second data comprises a user profile of a first or second user respectively, the user profile indicating user preferences of the first or second user to media content items. In another example, the first or second data comprises user ratings of respective content items. An advantage of the invention is that user information is protected. The invention can be used in various kinds of recommendation services, such as music or TV show recommendation, but also medical or financial recommendation applications where the privacy protection may be very important. The objection of the invention is also realized in that the method of processing data comprises steps of enabling to encrypt first data for a first source, and encrypt second data for a second source, provide the encrypted first and second data to a server that is precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other, perform a computation on the encrypted first and second data to obtain a similarity value between the first and second data so that the first and second data is anonymous to the second and first sources respectively, the similarity value providing an indication of a similarity between the first and second data. The method describes the operation of the system of the present invention. In one embodiment, the method further comprises a step of using the similarity value to obtain a recommendation of a content item for the first or second source. For example, suppose we want to predict the score of an item i for active user a: 1. First, we compute the correlation between user a and every other user x. This is done by computing inner products between the rating vector of user a and each other user x, through an exchange via the server. In this way, user a knows the correlation value with each other user x=l,2,...,n, but he does not know who user l,2,...,n is. On the other hand, the server knows who user l,2,..„n is, but he doesn't know the correlation values. 2. Next, we compute a prediction for item i for user a by taking a kind of weighted average of the ratings of user l,2,...,n for this item, where the weights are given by the correlation values. The procedure for this is that user a encrypts the correlation values and sends them to the server, who forwards them to the respective users l,2,...,n. Each user x=l,2,...,n multiplies the encrypted correlation value he receives with the rating he gave for item i, and sends the result back to the server. The server, still not able to decrypt anything at all, then combines the encrypted products of the users l,2,...,n into an encrypted sum, and sends this end result back to user a, who can decrypt it to get the desired result. Claim 6 describes the operation of the system including the first and second sources, and the server. Claim 12 is directed to the operation of the server ensuring the user privacy and enabling the computation of the similarity value in the encrypted domain. Both claims are interrelated and directed to essentially the same invention. These and other aspects of the invention will be farther explained and described with reference to the following drawings: Figure 1 is a functional block diagram of an embodiment of a system according to the present invention; Figure 2 is an embodiment of the method of the present invention. According to an embodiment of the present invention, a system 100 is shown in Figure 1. The system comprises a first device 110 (a first source), and a plurality of second devices 190,191 ... 199 (second sources). A server 150 is coupled to the first device and the second devices. The first device has first data, for example, user ratings of media content, or user preference data with respect to goods on sale, or medical records of a user indicating a prescription to give preference for certain food products, etc. The second device has second data, for example, the second data relate to preferences of a second user. In one example, the first device is a TV set-top box arranged to store user ratings for TV programs. The first device is further arranged to obtain EPG data (Electronic Programme Guide) indicating, e.g., a broadcast time, a channel, a title, etc. of a respective TV program. The first device is arranged to store a user profile storing user ratings for respective TV programs. The user profile may not comprise ratings for all programs in the EPG data. To determine whether a user will like a particular program which the user did not rate, various recommendation techniques can be used. For example, collaborative filtering techniques are used. Then, the first device collaborates with the second device storing the second data comprising a second user profile to find out whether the second profile is similar (using a similarity value) to the first profile and includes a rating of the particular program. If the similarity value between the first and second profiles is higher than a predetermined threshold, the rating included in the second profile is used to determine whether a user of the first device would like that particular program or not (a prediction step). For instance, a kappa statistic or Pearson correlation may be used for determining the similarity measure between the first and second profiles. The similarity may be a distance between two profiles, the correlation or a measure of the number of equal votes between two profiles. For the calculation of predictions, it is necessary that the similarities are high if users have the same taste, and low if they have an opposite taste. For example, the distance calculates the total difference in votes between the users. The distance is zero if the users have exactly the same taste. The distance is high if the users behave totally opposite. Therefore we have to do an adjustment such mat the weights are high if the users vote the same. A simple distance measure is the known Manhattan distance. m one example, if the second profile is sufficiently similar to the first profile (based on the similarity value), all content items (TV programs) not rated in the first profile but in the second profile are found. Said items are recommended to a user associated with the first profile. The recommendation may be based on the ratings of the items in the second profile, prediction methods for calculating predicted ratings of the items for the user of the first profile on the basis of the similarity value between the first and second profile, etc. It should be noted that the similarity value can be used not only in the context of the collaborative filtering techniques (in the content recommendation field) but, generally, for a personalization of media content, a targeted advertising of users, matchmaking services, and other applications. A problem of a user privacy arises because, in the prior art systems, the calculation of the similarity value requires that the first data of the first device and/or the second data of the second device are communicated to the second device and the first device respectively or the server. The first device encrypts the first data, and the second device encrypts the second data. The first and second data are sent to the server. The server is not capable of decrypting the encrypted first and second data. Further, the server ensures that when the second device obtains the encrypted first data, the second device does not identify an identity of the first device. In tarn, the first device cannot identify that the encrypted second data originate from the second device when the first device receives the second data. Thus, the server is precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other. For example, the server stores a database comprising a first identifier of the first device and a second identifier of the second device. When the first device transmits the encrypted first data to the second device via the server, the server strips away the first identifier attached to the encrypted first data, and the server delivers only the encrypted first data without the first identifier to the second device. It should be noted that the computation on the encrypted first and second data may be performed in a number of alternative manners. For example, the first device encrypts the first data and sends the encrypted first data to the second device via the server. The second device calculates encrypted inner products between the first encrypted data and the second data. The second device sends the encrypted inner vector to the first device via the server. The first device decrypts the encrypted inner products, and calculates the similarity value between the first and second data. The first device obtains the similarity but the first device cannot identify the source of the second data. Alternatively, the computations are performed completely on the server that has obtained the encrypted first data and the encrypted second data. In a further alternative, the computations are performed partly on the server and partly by the second device. The first device only decrypts the inner product and obtains the similarity value. Other alternatives can be derived. Figure 2 shows an embodiment of the method of the present invention. la step 210, first data for a first source are encrypted, and second data for a second source are encrypted. In step 220, the encrypted first and second data are provided to a server 150. The server is precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other. In step 230, a computation is performed on the encrypted first and second data to obtain a similarity value between the first and second data so that the first and second data is anonymous to the second and first sources respectively. The similarity value provides an indication of a similarity between the first and second data. Optionally, in step 240 the similarity value is used to obtain a recommendation of a content item for the first or second source. Further embodiments of the steps 210,220, 230 and 240 are discussed in detail in the next paragraphs. Methods exist for the following two problems: 1. Given two parties that each have a secret vector of integers, determine the inner product between the vectors without any of the parties having to reveal the specific information. 2. Given a set of parties that each have a secret number, determine the sum of the numbers without any of the parties having to reveal the number. The first problem is solved, for example, by the Paillier cryptosystem. The second problem is handled by using a key-sharing scheme (also Paillier), where decryption can only be done if a sufficient number of parties cooperate (and then only the sum is revealed, no detailed information). Memory-based collaborative filtering Most memory-based collaborative filtering approaches work by first determining similarities between users, by comparing their jointly rated items. Next, these similarities are used to predict the rating of a user for a particular item, by interpolating between the ratings of the other users for this item. Typically, all computations are performed by the server, upon a user request for a recommendation. Next to the above approach, which is called a user-based approach, one can also follow an item-based approach. Then, first similarities are determined between items, by comparing the ratings they have gotten from the various users, and next the rating of a user for an item is predicted by interpolating between the ratings that this user has given for the other items. Before discussing the formulas underlying both approaches, we first introduce some notation. We assume a set U of users and a set /of items. Whether a user u e i7 has rated item i e /is indicated by a boolean variable bui which equals one if the user has done so and zero otherwise. In the former case, also a rating mi is given, e.g. on a scale from 1 to 5. The set of users that have rated an item / is denoted by Ui, and the set of items rated by a user «is denoted by /«. The user-based approach Such a distance is zero if the users rated their overlapping items identically, and larger otherwise. A simple transformation converts a distance into a measure that is high if users' ratings are similar and low otherwise. Counting measures Counting measures are based on counting the number of items that two users rated (nearly) identically. A simple counting measure is the majority voting measure given by The relation « may here be defined as exact equality, but also nearly matching ratings may be considered sufficiently equal. Another counting measure is given by the weighted kappa statistic [5], which is defined as the ratio between the observed agreement between two users and the maximum possible agreement, where both are corrected for agreement by chance. Prediction formulas The second step in collaborative filtering is to use the similarities to compute a prediction for a certain user-item pair. Also for this step several variants exist. For all formulas, we assume that there are users that have rated the given item; otherwise no prediction can be made. Weighted sums. The first prediction formula we show is given by (5) So, the prediction is the average rating of user w plus a weighted sum of deviations from the averages. In this sum, all users are considered that have rated item t. Alter¬natively, one may restrict them to users that also have a sufficiently high similarity to user u, i.e., we sum over all users in r/ t} for some threshold r. An alternative, somewhat simpler prediction formula is given by (6) Note that if all ratings are positive, then this formula only makes sense if all sim¬ilarity values are non-negative, which may be realized by choosing a non-negative threshold. Another advantage in this case is that the similarities are generally based on more elements, which gives more reliable measures. A further advantage of item-based collaborative filtering is that correlations between items may be more stable than correlations between users. Encryption In the next sections we show how the presented formulas for collaborative filtering can be computed on encrypted ratings. Before doing so, we present the encryption system we use, and the specific properties it possesses that allow for the computation on encrypted data. A public-key cryptosystem The cryptosystem we use is the public-key cryptosystem presented by Paillier. We briefly describe how data is encrypted. First, encryption keys are generated. To this end, two large primes p and q are chosen randomly, and we compute n = pq and X = lcm(p-l;q-l). Furthermore, a generator g is computed from p and q (for details, see P.Paillier. Public-key cryptosystems based on composite degree residuosity classes. Advances in Cryptology-EUROCRYPT'99, Lecture Notes in Computer Science, 1592:223-238,1999). Now, the pair (n;g) forms the public key of the cryptosystem, which is sent to everyone, and X forms the private key, to be used for decryption, which is kept secret. Note that in the above cryptosystem the messages m are integers. However, rational values are possible by multiplying them by a sufficiently large number and rounding off. For instance, if we want to use messages with two decimals, we simply multiply them by 100 and round off. Usually, the range Zn is large enough to allow for this multiplication. with the second devices 190,191,199 (other users v) through the server 150. Furthermore, each user has generated his own key, and has published the public part of it. As we want to compute a prediction for user u, the steps below will use the keys of u. Computing similarities on encrypted data First we take the similarity computation step, for which we start with the Pearson conelation given in (1). Although we already explained how to compute shared among a number 1 of users, and a ciphertext can only be decrypted if more than a threshold t of users cooperate. In this system, the generation of the keys is somewhat more complicated, as well as the decryption mechanism. For the decryption procedure in the threshold cryptosystem, first a subset of at least t+1 users is chosen that will be involved in the decryption. Next, each of these users receives the ciphertext and computes a decryption share, using bis own share of the key. Finally, these decryption shares are combined to compute the original message. As long as at least t +1 users have combined their decryption share, the original message can be reconstructed. The general working of the item-based approach is slightly different than the user-based approach, as first the server determines similarities between items, and next uses them to make predictions. Compared to the known set-up of collaborative filtering, the embodiment of the implementation of the collaborative filtering, according to the present invention, requires a more active role of the devices 110,190,191,199. This means that instead of a (single) server that runs an algorithm in the prior art, we now have a system running a distributed algorithm, where all the nodes are actively involved in parts of the algorithm. The time complexity of the algorithm basically stays the same, except for an additional factor |X| for some similarity measures and prediction formulas, and the fact mat the new set-up allows for parallel computations. Various computer program products may implement the functions of the device and method of the present invention and may be combined in several ways with the hardware or located in different other devices. Variations and modifications of the described embodiment are possible within the scope of the inventive concept. For example, the server 150 in Figure 1 may comprise the computation means to obtain an encrypted inner product between the first data and the second data, or encrypted sums of shares of the first and second data in the similarity value, and the server is coupled to a public-key decryption server for decrypting the encrypted inner product or the sums of shares and obtaining the similarity value. As another example, the general concept of the invention can be mapped in a variety of manners onto the value chain, i.e., on the business models of the interlinked commercial activities by different legal entities that in the end enable to provide a service to the consumer. An embodiment of the invention involves enabling a consumer to supply encrypted data and an identifier, representative of the consumer via a data network, e.g., the Internet The relationship between the identifiers and the encrypted data of various consumers is broken in order to provide privacy. For example, a server substitutes another (e.g., temporary or session-related) identifier before passing on the encrypted data. The encrypted data of a consumer is then processed in the encrypted domain to calculate similarity values, either at a dedicated server or at another consumer, both being unable to decrypt the encrypted data. The use of the verb to comprise' and its conjugations does not exclude the presence of elements or steps other than those defined in a claim. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the system claim enumerating several means, several of these means can be embodied by one and the same item of hardware. A 'computer program' is to be understood to mean any software product stored on a computer-readable medium, such as a floppy-disk, downloadable via a network, such as the Internet, or marketable in any other manner. WE CLAIM: 1. A system (100) for processing data, the system comprising a first source( 110) for encrypting first data, and a second source (190,191, 199) for encrypting second data, a server (150) configured to obtain first and second data from the first and second source, computation means( 110, 150,190, 191,199) for performing a computation on the first and second data to obtain a similarity value between the first and second data, the similarity value providing an indication of a similarity between the first and second data, characterized in that the first source(l 10) is configured for encrypting the first data, and the second source (190,191,199) is configured for encrypting the second data, the server being precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other, the computation means performing the computation on the encrypted first and second data so that the first and second data is anonymous to the second and first sources respectively. 2. The system of claim 1, wherein the second source comprises the computation means to obtain an encrypted inner product between the first data and the second data, and provide the encrypted inner product to the first source via the server, the first source being configured to decrypt the encrypted inner product for obtaining the similarity value. 3. The system of claim 1, wherein the computation means is realized using a Paillier cryptosystem, or a threshold Paillier cryptosystem using a public key-sharing scheme. 4. The system of claim 1, wherein the server comprises the computation means to obtain an encrypted inner product between the first data and the second data, or encrypted sums of shares of the first and the second data in the similarity value, and the server is coupled to a public-key decryption server for decrypting the encrypted inner product or the sums and obtaining the similarity value. 5. The system according to any one of claims 1 to 4, wherein the similarity value is obtained using a Pearson correlation or a Kappa statistic. 6. A method of processing data, the method comprising steps of enabling to (220) provide first and second data for a first and second source respectively, to a server (230) perform a computation on the first and second data to obtain a similarity value between the first and second data, the similarity value providing an indication of a similarity between the first and second data, characterized in that the method comprises step of enabling to (210) encrypt the first data, and encrypt second data, the server being precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other; wherein the computation is performed on the encrypted first and second data, so that the first and second data is anonymous to the second and first sources respectively. 7. The method of claim 6, wherein the first or second data comprises a user profile of a first or second user respectively, the user profile indicating user preferences of the first or second user to media content items. 8. The method of claim 6, wherein the first or second data comprises user ratings of respective content items. 9. The method of claim 6, comprising a step (240) of using the similarity value to obtain a recommendation of a content item for the first or second source. 10. The method of claim 9, wherein the recommendation is performed using a collaborative filtering technique. 11. A server (150) for processing data, the server being configured to obtain first data of a first source (110) and second data of a second source (190,191, 199), and to enable a computation on the first and second data to obtain a similarity value between the first and second data, the similarity value providing an indication of a similarity between the first and second data, characterized in that the first and second data are encrypted first and second data, the server being precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other, the computation being performed on the encrypted first and second data, so that the first and second data is anonymous to the second and first sources respectively. 12. A method of processing data, the method comprising steps of (220) obtaining first data of a first source (110) and second data of a second source (190,191, 199) by a server (150), (230) enabling a computation on the first and second data to obtain a similarity value between the first and second data, the similarity value providing an indication of a similarity between the first and second data, characterized in that the fist and second data are encrypted first and second data, the server being precluded from decrypting the encrypted first and second data, and from revealing identities of the first and second sources to each other, the computation being performed on the encrypted first and second data, so that the first and second data is anonymous to the second and first sources respectively.

Documents:

820-chenp-2006 abstract duplicate.pdf

820-chenp-2006 abstract.pdf

820-chenp-2006 claims duplicate.pdf

820-chenp-2006 claims.pdf

820-CHENP-2006 CORRESPONDENCE OTHERS.pdf

820-chenp-2006 correspondence po.pdf

820-chenp-2006 description (complete) duplicate.pdf

820-chenp-2006 description (complete).pdf

820-chenp-2006 drawing.pdf

820-chenp-2006 form-1.pdf

820-chenp-2006 form-18.pdf

820-chenp-2006 form-26.pdf

820-chenp-2006 form-3.pdf

820-chenp-2006 form-5.pdf

820-chenp-2006 pct search report.pdf

820-chenp-2006 pct.pdf

820-chenp-2006 petition.pdf