Title of Invention	AN IMAGE PROCESSING SYSTEM FOR CONVERTING A THREE COLOR IMAGE DATA SET INTO A FOUR COLOR IMAGE DATA SET
Abstract	An image processing system comprising a display for displaying a three color primary image data set converted into a multiple color primary set which one of the primaries is white. One method converts a three-color images data set comprising CI, C2, and C3 colors in to a four-color image data set comprising CI, C2,C3 and W colors.

Full Text

BACKGROUND [01] In commonly owned United States Patent Applications: (1) United States Patent Application Serial No. 09/916,232 ("the '232 application" ), entitled "ARRANGEMENT OF COLOR PIXELS FOR FULL COLOR IMAGING DEVICES WITH SIMPLIFIED ADDRESSING," filed July 25, 2001; (2) United States Patent Application Serial No. 10/278,353 ("the '353 application"), entitled "IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PDCEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE," filed October 22, 2002; (3) United States Patent Application Serial No. 10/278,352 ("the '352 application"), entitled "IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PDCEL ARRANGEMENTS AND LAYOUTS FOR SUB-PDCEL RENDERING WITH SPLIT BLUE SUB-PIXELS," filed October 22,2002; (4) United States Patent Application Serial No. 10/243,094 ("the '094 application), entitled "IMPROVED FOUR COLOR ARRANGEMENTS AND EMITTERS FOR SUB-PDCEL RENDERING," filed September 13, 2002; (5) United States Patent Application Serial No. 10/278,328 C^e '328 application"), entitled "IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PDCEL ARRANGEMENTS AND LAYOUTS WITH REDUCED BLUE LUMINANCE WELL VISIBILITY," filed October 22, 2002; (6) United States Patent Application Serial No. 10/278,393 ("the '393 application"), entitled "COLOR DISPLAY HAVING HORIZONTAL SUB-PDCEL ARRANGEMENTS AND LAYOUTS," filed October 22, 2002; (7) United States Patent Application Serial No. 01/347,001 ("the '001 application") entitled "IMPROVED SUB-PDCEL ARRANGEMENTS FOR STRIPED DISPLAYS AND METHODS AND SYSTEMS FOR SUB-PDCEL RENDERING SAME," filed January 16,2003, novel sub-pixel arrangements are therein disclosed for improving the cost/performance curves for image display devices and herein incorporated by reference. [02] For certain subpixel repeating groups having an even number of subpixels in a horizontal direction, the foEowing systems and techniques to affect proper dot inversion schemes are disclosed and are herein incorporated by reference: (1) United States Patent Application Serial Number 10/456,839 entitled "IMAGE DEGRADATION CORRECTION IN NOVEL LIQUID CRYSTAL DISPLAYS"; (2) United States Patent Application Serial No. 10/455,925 entitled "DISPLAY PANEL HAVING CROSSOVER CONNECTIONS EFFECTING DOT INVERSION"; (3) United States Patent Application Serial No. 10/455,931 entitled "SYSTEM AND METHOD OF PERFORMING DOT INVERSION WITH STANDARD DRIVERS AND BACKPLANE ON NOVEL DISPLAY PANEL LAYOUTS"; (4) United States Patent Application Serial No. 10/455,927 entitled "SYSTEM AND METHOD FOR COMPENSATING FOR VISUAL EFFECTS UPON PANELS HAVING FIXED PATTERN NOISE WITH REDUCED QUANTIZATION ERROR"; (5) United States Patent Application Serial No. 10/456,806 entitled "DOT INVERSION ON NOVEL DISPLAY PANEL LAYOUTS WITH EXTRA DRIVERS"; and (6) United States Patent Application Serial No. 10/456,838 entitled "LIQUID CRYSTAL DISPLAY BACKPLANE LAYOUTS AND ADDRESSING FOR NON-STANDARD SUBPIXEL ARRANGEMENTS". [03] These improvements are particularly pronounced when coupled with sub-pixel rendering (SPR) systems and methods further disclosed in those applications and in commonly owned United States Patent Applications: (1) United States Patent Application Serial No. 10/051,612 ("the '612 application"), entitled "CONVERSION OF RGB PIXEL FORMAT DATA TO PENTILE MATRIX SUB-PIXEL DATA FORMAT," filed January 16, 2002; (2) United States Patent Application Serial No. 10/150,355 ("the '355 application"), entitled "METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH GAMMA ADJUSTMENT," filed May 17, 2002; (3) United States Patent Application Serial No. 10/215,843 ("the '843 application"), entitled "METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH ADAPTIVE FILTERING," filed August 8, 2002; (4) United States Patent Application Serial No. 10/379,767 entitled "SYSTEMS AND METHODS FOR TEMPORAL SUB-PDCEL RENDERING OF MAGE DATA" filed March 4,2003; (5) United States Patent Application Serial No. 10/379,765 entitled "SYSTEMS AND METHODS FOR MOTION ADAPTIVE FILTERING," filed March 4, 2003; (6) United States Patent Application Serial No. 10/379,766 entitled "SUB-PIXEL RENDERING SYSTEM AND METHOD FOR IMPROVED DISPLAY VIEWING ANGLES" filed March 4, 2003; (7) United States Patent Application Serial No. 10/409,413 entitled 'IMAGE DATA SET WITH EMBEDDED PRE-SUBPKEL RENDERED IMAGE" filed April 7, 2003, which are hereby incorporated herein by reference. BRIEF DESCRIPTION OF THE DRAWINGS [04] The accompanying drawings, which are incorporated in, and constitute a part of this specification illustrate exemplary implementations and embodiments of the invention arui, together with the description, serve to explain principles of the invention. [05] FIG. 1 shows a color space in which four primaries break up the space into various regions. [06] FIG. 2 depicts two color spaces and sample image data points to exemplify in-gamut and out-of-gamut conditions. [07] FIG. 3 shows one embodiment of a gamut conversion system as made in accordance with the principles of the present inventions. DETAILED DESCRIPTION [08] Reference will now be made in detail to implementations and embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts, [09] In the co-pending application entitled "METHOD AND APPARATUS FOR CONVERTING FROM A SOURCE COLOR SPACE TO A TARGET COLOR SPACE", there is described a technique for converting from one color space to another, multi-primary space in which the multi-primary space is broken up into triangles on the CIE chromaticity diagram. The triangles are laid out between adjacent primary colors and the white-point. Normally, in a 4 color multi-primary display, there would be 4 triangles. If, however, W is one of the primary colors, and lies directly underneath the white-point at least one of the triangles collapses into a straight line. However, as will be discussed in greater detail below, for each of the triangles, there are resulting matrices that have non-zero coefficients for the primaries that are not on the corners of the triangle. These coefficients are one solution for W in the RGBW system. [010] One embodiment of the present RGBW conversion system proceeds as if there are 4 primaries, but divides the chromaticity diagram into three triangles. FIG. 1 shows the general situation - with RGBW primaries within the CIE color chart. Of course, it will be appreciated that the present system and techniques will work for any 4-color primary system with W as one of the primaries (e.g. CMYW and the like). With such a system, one possible solution for RGBW arises from the three matrices that each have coefficients for the fourth primary which will linearly interpolate white values from 0 at the primary base of the triangles to 1 at the white-point. It will be appreciated that — although triangles are a natural choice for the regions bounded by W and two of R, G, and B - other regions are possible for purposes of the present invention. It will also be appreciated that there may be more than three non-white primaries. [O1l] An example using the present system will now be described. When characterizing any display, it is common to use a colorimeter to measure the chromaticity of red. (xr>yr) green (xg,yg) blue (Xb,yt>) and the Cffi XYZ co-ordinates of the white-point (Xw.Yw.Zw). The "little z" co-ordinates for red green and blue may be calculated using the formula z=l-x-y. Using standard conversion equations, it is possible to also calculate (xw,yw^w) from the white-point. Plugging these into a matrix conversion equation and expanding the formula to work with the 4-color RGBW system yields(Equation Removed) Equation I [012] This equation will convert RGBW values into CJE XYZ once the "C" coefficients are calculated. To calculate them, it is possible to substitute the white-point (X^YvftZw) in for (X Y Z), substitute the value (1111) for the expected RGBW value, and factor the C values out into a separate vector to yield: (Equation Removed) Equation 2 [013] Alternatively, it might be possible to use different values for [Xw,Yw,Zw] -other than the standard white-point - to change the resulting equation for (1) different backlights of target multi-primary displays; or (2) if the source image data was created under a given assumption about its white point or its measured primaries that differ from the target display. This change in the white point might correct for color differences between those assumptions under which the source image data was created and the display characteristics upon which the source image data will be rendered. [014] It will be noted that the center matrix is a 3x4 matrix and, hence, does not have an inverse. Instead, it is possible to use a numerical solver package to find one of many sets of solutions to the C values. The resulting Cr Cg Cb and Cw values may then be plugged back into Equation 1 to fill in the last unknowns. With these values, Equation 1 may now convert any RGBW value to CEE XYZ, but it may be desired to have an inverse mapping of sorts. It will also be appreciated that any other predetermined value for the RGBW-tuple in Equation 1 could be employed - but the choice of such a known tuple would change the C's found in Equation 2. [015] As the center matrix in Equation 1 is not square and cannot be inverted to create an inverse equation, Equation 3 is such a possible inverse mapping using known values and Equation 1 to solve for the matrix in Equation 3 for each of the triangles in FIG. 1. (Table Removed) Equation 3 [016] Next using the known RGBW co-ordinates for red (1,0,0,0) green (0,1,0,0) and white (1,1,1,1), Equation 1 can be used to find the matching CIE XYZ co-ordinates. A numerical solver can then find a solution for the 3x4 matrix in Equation 3 that will produce these three results. This is the matrix that can convert any CJE XYZ color whose chromaticity is inside the RGW triangle in FIG. 1 into RGBW. The same procedure is performed using the known RGBW co-ordinates for green (0,1,0,0) blue (0,0,1,0) and white (1,1,1,1) to produce a matrix that can convert any color whose chroraaticity is inside triangle GBW in FIG. 1. The same procedure is performed using the known RGBW co-ordinates for blue (0,0,1,0) red (1,0,0,0) and white (1,1,1,1) to produce a matrix that can convert any color whose chromaticity is inside triangle BRW in FIG. 1. [017] These three matrices are calculated once beforehand and combined with other conversion matrices as necessary. For example, if the three-valued input colors are REC 709 RGB values sometimes called sRGB, then the standard conversion matrix for turning sRGB values into CEE XYZ could be combined with each of the RGBW matrices to change them into matrices that directly convert sRGB into RGBW. Once the three matrices are constructed, they are stored as tables in software conversion methods or burned into the ROM of a hardware conversion apparatus. [018] The REC 709 chromaticity values are red (0,64, 0.33) green (0.30, 0.60) and blue (0.15, 0,06). The D65 standard white-point Cffi XYZ value is (0.950468, 0.999999, 1.088970). If these standard recommended values are used as the input values for the above procedure, the resulting matrix for Equation 1 is: (Table Removed) [019] Then the matrix for equation 3 that works in the RGW triangle on FIG. 1 is: (Table Removed) [020] The resulting matrix for equation 3 that works in the GBW triangle of FIG. 1 is: (Table Removed) [021] Finally, the matrix for equation 3 that works in the BRW triangle of Figure 1 is: (Table Removed) [022] This set of matrices will convert Cffi XYZ to RGB W for the special case where the RGBW primaries match the REC 709 and D65 standards. This may serve as useful conversions for testing or for easy implementation purposes. However, for any specific display, it may be desirable to measure the actual chromatic ties and generate matrices specifically calibrated for the class of display. It is to be appreciated that similar analysis may lead to RGBW conversion from other tristimulus color spaces such as YCbCr, as converting these color space formats to an RGB format is well known in the art RGBW Gamut Limits [023] When using the above matrices to convert sRGB to RGBW images, it may be the case that the gamut of RGBW does not have quite the same volume as sRGB. Bora color spaces may have the same gamut in CBE chromaticity, but RGBW is not able to display all those colors at all luminosities. The result is that there are some colors in sRGB that cannot be displayed when converted to RGBW. This is shown in the 2 dimensional diagram of BIG. 2. This figure is a simplified diagram of a slice through the two color-spaces with the differences exaggerated for explanatory purposes. The central hexagonal area represents the colors that can be displayed in RGBW while the outer square is the colors representable by sRGB. It should be noted that both color-spaces are drawn so that white is the same point in both spaces (i.e. normalized at maximum luminance). All the points in FIG. 2 are considered after they are converted to RGBW space, so some of them will be out-of gamut. [024] It is possible to detect when colors are out of gamut in RGBW (or any multiprimary color space, for that matter) by checking for values that are out of bounds. If color components are calculated on the range 0-255, these out-of-gamut values will be larger than 255. One embodiment clamps all the resulting color components to the maximum allowed value. However, this results in a change in the hue of the resulting color. FIG. 2 shows an example of this effect. The point P is a color mat is outside the RGBW gamut and results in out-of-gamut values. If the out-of-gamut values are simply clamped to the maximum allowed values, the resulting color would be color D, It may be more desirable to have the color E as the resulting color which also lies on the edge of the RGBW color gamut but has the same hue as the original color P. [025] To calculate the correct color E the following procedure is used: When an out-of gamut color is detected, the maximum of the four RGBW color components is found. The ratio between the maximum allowed value (usually 255) and the maximum RGBW value is a scale factor that is then used to correct all four of the RGBW components. Scaling all four of the components by the same number preserves hue and results in the correct color E instead of the "simple clamped" color D. [026] It should be noted that although hue is preserved this is still a clamping process, all the colors on the line E-C will all be clamped to the single color E. In some prior art, a scaling factor is calculated that scales all the colors on the line BLACK-C. This scales the color at point C so that it lands at point E aitd scales the color at point P so that it lands at point P'. This kind of gamut scaling has the effect that it changes the color of point Q to Q' — making some colors dimmer than they possibly need to be. The present embodiment does not have this effect — the color at point Q remains bright and is not replaced with the dim color at point Q[027] The above clamping has the advantage of matching the ensemble image statistics that indicate that it is rare to have both high saturation and high luminance. That is to say, that the colors that are out of gamut are not often encountered in natural photographic images. Additionally, the human eye is less able to distinguish differences in luminosity at the higher end of the scale, thus the loss of such differences, quantizing all out of gamut colors to the maximum in gamut color of the same hue is unlikely to be noticed by any but the most sophisticated viewer. [028] The process of calculating the scale factor can be done by using the maximum RGBW value as an index into a table of inverse values. Ordinarily, using a table of inverses results in some errors. However, in this case the range on possible values of the maximum RGBW value makes all the inverse values fall on a "good" section of the 1/x curve and not on the tail where most of the errors are introduced. As a result an apparatus built to this design could be done with an inverse table and a multiplier, saving the complexity of doing a divide. FIG. 3 shows such an apparatus. [029] FIG. 3 shows a section of a gamut pipeline 300. Chroma/luma data (e.g. L,x,y) is converted by 3xn matrix multiplier 302 into RGB and W components — which can result in RGBW values out-of-gamut. If the data is out of gamut, one of the RGB data will be larger than what the display 310 can render. When one or more of these color components are out of range of the display, MAX detector 304 will detect this condition and output the maximum out of range component to the inverse look-up table (LUT) 306. The LUT will output a scale factor that will cause the multipliers 308 to scale the RGBW values back into gamut range. In the case that the original RGB values were in gamut range, MAX unit and inverse LUT are designed to output a scale factor of 1 to leave the image values the same. In another embodiment, another detector would be necessary to detect the in-gamut colors and multiplex them around the multipliers directly to the display. [030] In the above embodiments, reference to functional blocks can be implemented using any combination of hardware and/or software, including components or modules such as one or more memory devices or circuitry. For example, a programmable gate array or like circuitry can be configured to implement such functional blocks. In other examples, a microprocessor operating a program in memory can also implement such functional blocks. [031] While the invention has been described with reference to an exemplary embodiment, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for canrying out this invention, but mat the invention will include all embodiments falling within the scope of the appended claims. WE CLAIM: 1. An image processing system comprising: a display (310) for displaying a three-color image data set comprising CI, C2, and C3 colors converted into a four-color image data set comprising C1, C2, C3 and W colors; a processing circuitry to divide said color space comprising a CI, C2, C3, and W color point into a set of regions bounded by W and two of a group, said group comprising: CI, C2 and C3 and to determine a mapping from image data points in any one of said regions, said image data points comprising CI, C2 and C3 color values, to image data points comprising CI, C2, C3, and W; an out-of-gamut detecting circuitry for detecting image data points that are out-of-gamut; and a scaling circuitry for scaling only the out-of-gamut image data points to produce corresponding color image data points that are within gamut range, the scaling performed according to a scaling factor that is determined according to a ratio between the maximum allowed value and the maximum value of C1, C2, C3, and W. 2. The image processing system as claimed in Claim 1 wherein the three colors CI, C2, and C3 comprise R, G and B. 3. The image processing system as claimed in Claim 1 wherein the regions bounded by W and two of a group, said group comprising CI, C2 and C3 comprises triangles. 4. The image processing system as claimed in Claim 1, wherein the processing circuitry sets the white point in the four-color space to a desired value and calculate intermediate coefficients for the four colors using the desired white point. 5. The image processing system as claimed in Claim 1, wherein the processing circuitry calculates coefficients using the matrix equation as herein described for the values Cr Cg Cb and Cw. 6. The image processing system as claimed in Claim 5, wherein the processing circuitry sets the white point to adjust to different backlighting condition for target displays. 7. The image processing system as claimed in Claim 5, wherein the processing circuitry sets the white point to adjust between difference between the white point of the source image data and the white point of the target display. 8. The image processing system as claimed in Claim 7, wherein the processing circuitry calculates the mapping to four color space from said intermediate coefficients with the matrix as herein described. 9. The image processing system as claimed in Claim 1, wherein the processing circuitry detects four color image data points that are out-of-gamut and effect a change in only the out-of-gamut coefficients to produce a color image data point that is within gamut range. 10. The image processing system as claimed in Claim 9, wherein the processing circuitry tests each color component of the image data point to see if the color component is out of range. 11.The image processing system as claimed in Claim 10, wherein the processing circuitry clamps the out-of-range color components to the maximum value allowed for the given component. 12. The image processing system as claimed in Claim 11, wherein the processing circuitry scales the color components of the out-of-gamut image data point with a ratio between the maximum allowed value and the maximum coefficients of the out-of-gamut image data point. 13. The image processing system as claimed in Claim 1, wherein the out-of-gamut detecting circuitry comprises a MAX detector (304) to detect one or more out of range color components and output the maximum out of range component. 14. The image processing system as claimed in Claim 1 wherein the scaling circuitry comprises inverse look-up table LUT (306) to scale only the color components of the out-of-gamut second colored image data, the scaling performed according to a ratio between the maximum allowed value and the maximum coefficient of said out-of-gamut second colored image data.

Documents:

1007-delnp-2006-2-Abstract-(18-04-2013).pdf

1007-delnp-2006-2-Claims-(18-04-2013).pdf

1007-delnp-2006-2-Correspondence Others-(18-04-2013).pdf

1007-delnp-2006-2-GPA-(18-04-2013).pdf

1007-DELNP-2006-Abstract-(22-04-2009).pdf

1007-delnp-2006-abstract.pdf

1007-DELNP-2006-Claims (13-11-2009).pdf

1007-DELNP-2006-Claims-(22-04-2009).pdf

1007-delnp-2006-claims.pdf

1007-delnp-2006-Correspondence Others-(01-04-2013).pdf

1007-delnp-2006-Correspondence Others-(22-04-2013).pdf

1007-DELNP-2006-Correspondence Others-(23-02-2012).pdf

1007-DELNP-2006-Correspondence-Others (13-11-2009).pdf

1007-delnp-2006-correspondence-others 1.pdf

1007-DELNP-2006-Correspondence-Others-(16-01-2009).pdf

1007-DELNP-2006-Correspondence-Others-(22-04-2009).pdf

1007-delnp-2006-correspondence-others.pdf

1007-delnp-2006-description (complete).pdf

1007-DELNP-2006-Drawings-(22-04-2009).pdf

1007-delnp-2006-drawings.pdf

1007-DELNP-2006-Form-1-(22-04-2009).pdf

1007-delnp-2006-form-1.pdf

1007-DELNP-2006-Form-18-(16-01-2009).pdf

1007-delnp-2006-form-18.pdf

1007-DELNP-2006-Form-2-(22-04-2009).pdf

1007-delnp-2006-Form-2-(22-04-2013).pdf

1007-delnp-2006-form-2.pdf

1007-DELNP-2006-Form-26 (13-11-2009).pdf

1007-DELNP-2006-Form-26-(22-04-2009).pdf

1007-DELNP-2006-Form-3 (13-11-2009).pdf

1007-DELNP-2006-Form-3-(22-04-2009).pdf

1007-DELNP-2006-Form-3-(23-02-2012).pdf

1007-delnp-2006-form-3.pdf

1007-delnp-2006-form-5.pdf

1007-DELNP-2006-Others-Document-(22-04-2009).pdf

1007-DELNP-2006-Petition-137-(22-04-2009).pdf

1007-DELNP-2006-Petition-138-(22-04-2009).pdf