US 7113152 B2
A device, system and a method for displaying image data of a plurality of colors, the device comprising a light source (50) for producing light having at least four primary colors, a controller (56, 58) for determining a combination of at least four primary colors according to the image data (72) for production by the light source and a viewing screen (60) for displaying the image data the combination from the controller. The present invention is not limited to combinations of colors which are produced from only three primary colors, such as red, green and blue.
1. A method of producing a color image comprising:
projecting polychromatic light from a light source onto a first side of a color wheel having at least four non-white and non-black color filters;
rotating said color wheel such that the polychromatic light from said light source is sequentially filtered by transmission through said at least four color filters to sequentially produce at a second side of said color wheel, opposite said first side, light of at least four colors, each of said at least four colors having a different chromaticity from the others of the at least four colors in accordance with a data signal; and
spatially modulating said light of at least in accordance with a data signal four colors in accordance with a data signal to produce said color image.
2. The method of
3. The method of
4. The method of
5. The method of
6. The method of
7. The method of
8. The method of
9. The method of
receiving image data representing said color image in terms of said at least four colors; and
generating a formatted data signal including a sequence of color data arrays, each array including data representing at least part of said image data corresponding to one of said at least four colors.
10. The method of
This application is a National Phase Application of PCT International Application No. PCT/IL01/00527, International Filing Date Jun. 7, 2001, claiming priority of U.S. patent application Ser. No. 09/710,895, filed Nov. 14, 2000 and U.S. Provisional Patent Application No. 60/209,771, filed Jun. 7, 2000.
An embodiment of the present invention relates to a device, system and a method for electronic true color display, and in particular, to such a device, system and method in which an expanded color space is available for display through an electronic display device such as a monitor of a computational device, for example.
The perception of color by human vision involves the impact of light of different wavelengths in the visible spectrum (400 nm–780 nm) on the human eye, and the processing of the resultant signals by the human brain. For example, in order for an individual to perceive an object as “red”, light in the range of wavelengths of about 580–780 nm must be reflected from the object onto the retina of the eye of the individual. Depending upon the spectral distribution of the light and assuming normal color vision, the individual perceives different colors from a wide range of such colors.
In addition, the individual perceives various characteristics of the color. The color itself is also termed the “hue.” In addition, saturation determines the intensity of the color, such that a color shade which is saturated is perceived as highly vivid, while a pastel version of the same color is less saturated. The combination of hue and saturation forms the chrominance of the color. As perceived by the individual, color also has brightness, which is the apparent or perceived energy of the color, such that the color “black” is actually the absence of brightness for any color.
Although color is a complex combination of physical and physiological phenomena, as previously described, color matches to some viewable colors can be obtained with combinations of only three colors. Typically certain spectra of red, green and blue are used. These three colors may be termed additive primaries. By combining different amounts of each color, a wide gamut of colors can be produced. Unfortunately, this spectra still falls short of the complete gamut of colors which are visible to the human eye (see for example www.barco.com as of Sep. 28, 2000). Not every color can be expressed as a mixture of three primary colors in combination. Instead, certain colors can only be adequately represented mathematically if the value for one or more primary colors is negative. While such negative values are theoretically possible, physical devices cannot produce them.
An international standards body, CIE (Commission Internationale de l'Eclairage), has defined a special set of imaginary primaries, for which all colors can be represented by positive values. The primaries are imaginary in the sense that they are a mathematical creation, which cannot be produced by a physical device. Nevertheless, the system is very useful for the presentation of color, as is described below.
The system is defined by the color matching functions, X(λ),Y(λ) and Z(λ), which define the response of the primaries to a monochromatic excitation of wavelength, λ. Furthermore, Y(λ) is chosen to be identical to the brightness sensitivity of the color sensors in the human eye. Using these primaries, each color can be represented by three positive values XYZ, where Y is proportional to the brightness of the excitation. From the XYZ values a normalized set xyz is created, by dividing each of the values by X+Y+Z. In the new set x+y+z=1. If two of the three values are provided, the third value may be derived from these values. Thus, a color may be represented by a set of two values (for example, x and y) on a chromaticity diagram as shown in Background Art
The chromaticity diagram in
The electronic reproduction of color, for example by an electronic display device such as a computer monitor, is currently performed by using three primaries: typically spectra of red, green and blue. These systems cannot display the fall range of colors which are available to the human eye. The reason for the inability of such devices to display the full range of colors perceived by the human eye is that some colors are presented by negative values of one or more of the primaries, which cannot be realized by a physical light source. Certain background art devices and systems use a fourth “color”, which is actually light passed through a neutral filter, or “white light”, and which is used for controlling brightness of the displayed color, as described for example with regard to U.S. Pat. No. 5,233,385. However, the use of the neutral filter does not affect the ultimate gamut of colors which can be displayed.
Electronic display devices which operate according to the three-primary red, green, blue system include such devices as computer monitors, televisions, computational presentation devices, electronic outdoor color displays and other such devices. The mechanism for color display may use various devices, such as Cathode Ray Tubes (CRT), Liquid Crystal Displays (LCD), plasma display devices, Light Emitting Diodes (LED) and three-color projection devices for presentations and display of video data on a large screen, for example.
As an example of the operation of such a device, CRT displays contain pixels with three different phosphors, emitting red, green and blue light upon excitation. In currently available displays, the video signal sent to the display specifies the three RGB color coordinates (or some functions of these coordinates) for each of the pixels. Each coordinate represents the strength of excitation of the relevant phosphor. An individual viewing the display integrates the light coming from neighboring colored pixels to get a sensation of the required color. The process of integration is automatically performed, without individual awareness of the process, and occurs through a combination of the physiological activity of the eye itself and of processing of signals from the eye by the brain.
The red, green and blue emissions of the phosphors define three points in the xy plane. The points marked 14, 16 and 18 in
Part of this problem could be alleviated by using lasers or other spectrally narrow light, since the emission of the phosphors is spectrally wide, thereby causing the triangle of values lying within the gamut of produced colors to be even smaller. A similar problem is found with LCD display devices which operate with “white” light passed through color filters, and which must also have a wide spectrum for the filters in order for enough light to pass through the filter. However, the problem of the restricted gamut for display of colors cannot be solved by using monochromatic light sources, such as lasers; although the triangle created is much larger, large parts of the gamut of the human eye still cannot be displayed with only three primary colors, regardless of the type of light source.
A more useful solution would enable a wider range of colors to be displayed by the electronic display device, for example by a television or a computer monitor. Such a solution would be efficient and would be suitable for both large electronic display devices and more small, portable devices. Attempts to define such a solution can be found, for example, in PCT Application Nos. WO 97/42770 and WO 95/10160, which both describe methods for processing image data for display with four or more primary colors. However, neither of the Applications teaches or suggests a device which is capable of such a display of four or more primary colors.
U.S. Pat. Nos. 4,800,375 and 6,097,367 both describe attempts to provide such devices. However, neither disclosed device is a suitable solution to this problem, as both devices have significant disadvantages. For example, U.S. Pat. No. 4,800,375 describes a flat, backlighted screen, in which the light source and controller form a single unit. However, since each pixel has a different color, increasing the number of primary colors both increases the cost of production, since additional light source/controller units must be added for each color, and also decreases the resolution of the screen. Similar problems are also found with the disclosed device of U.S. Pat. No. 6,097,367, which is based on LED (light emitting diodes). Thus, these disclosed background art devices suffer from significant drawbacks, particularly with regard to the decreased resolution of the displayed image as the number of primary colors which form the image is increased.
Therefore, there is an unmet need for, and it would be highly useful to have, a device, system and a method for providing an expanded color spectrum for the electronic display and reproduction of color, which would operate efficiently and which would be suitable for display devices of different sizes, and which would not result in decreased resolution of the displayed image as the number of primary colors is increased.
An embodiment of the present invention provides a device, system and a method for displaying an expanded gamut of colors. The present invention is suitable for various types of electronic display devices, such as televisions and monitor devices (“monitors”) for computational devices, for example. An embodiment of the present invention operates by using more than three primary colors. As previously described, the term “primary color” specifically does not include light from a white or polychromatic light source after only being passed through a neutral filter. Thus, unlike background art systems and devices, the present invention is not limited to combinations of colors which are produced from only three primary colors, such as red, green and blue for example.
According one embodiment of to the present invention, there is provided a device for displaying image data of a plurality of colors, the device comprising: (a) a light source for producing light having at least four primary colors; (b) a controller for determining a combination of at least one of the at least four primary colors according to the image data for production by the light source, such that the controller is separate from the light source; and (c) a viewing screen for displaying the image data according to the combination from the controller.
According to another embodiment of the present invention, there is provided a system for displaying image data of a plurality of colors, the system comprising: (a) a light source for producing light having at least four primary colors; (b) a converter for converting the image data to a combination of at least one of the at least four primary colors to form a map; (c) a controller for controlling a production of the combination from the light source, wherein the controller is separate from the light source; and (d) a viewing screen for displaying the image data from the combination from the light source as controlled by the controller.
According to yet another embodiment of the present invention, in a device for displaying image data of a plurality of colors, the device comprising a light source for producing light having at least four primary colors and a viewing screen for displaying the image, the light being projected onto the viewing screen, there is provided a method for creating the image for displaying, the method comprising the steps of: (a) producing light by the light source of at least four primary colors; (b) determining a path for light of each primary color according to the image data; and (c) projecting the light of each primary color according to the path onto the viewing screen to form the image.
In another embodiment of the present invention, a set of primaries or filters is chosen so that a spectral reconstruction of certain set of colors is obtained. In order to increase the accuracy of colors represented by a set of primaries, and to increase the likelihood that different human observers will perceive certain colors accurately, a set of primaries may be created based on a spectral match rather than a calorimetric match, and such a set of primaries may be used in a display system according to an embodiment of the present invention. A target set of spectra to be reproduced are chosen, and a set of 1 primaries are chosen which optimally reproduce the set of target spectra.
Various embodiments of the present invention provide for the conversion of source data (e.g., RGB or YCC-type data) to data suitable for a display using at least four primaries. A graph or plot is created which includes the n-primaries used in the display and in addition includes one or more middle points. The middle point or points define triangles with adjacent pairs of primaries. The source data is mapped to one of the triangles, and a solution is found for the constant levels for the relevant pair of primaries and the relevant middle point. The constant levels for the primaries not participating in the triangle may be found. These constant levels may be used to control the levels of the primaries in the display.
In one embodiment of the present invention, a set of filters is chosen to gain the widest spectral coverage possible while maintaining white balance, efficiency and brightness. A set of filters is chosen so that at least three of the filters include certain frequencies located near the corners of the chromaticity horseshoe. In one embodiment, a set of at least three primaries is chosen, such that at the filters for at least three primaries in the set have the following characteristics: one filter does not pass wavelengths substantially below 600 nm, another does not pass wavelengths substantially above 450 nm, and the third is a narrow band-pass filter with a central frequency in the range of approximately 500–550 nm, whose total width does not substantially exceed 100 nm. Additional primaries may be chosen.
Hereinafter, the term “neutral” refers to light having a spectral distribution, which does not differ substantially from that of a white light source, as obtained for example by passing light from such a white source through a neutral density filter.
The invention is herein described, by way of example only, with reference to the accompanying drawings, wherein:
In the following description, various aspects of the present invention will be described. For purposes of explanation, specific configurations and details are set forth in order to provide a thorough understanding of the present invention. However, it will also be apparent to one skilled in the art that the present invention may be practiced without the specific details presented herein. Furthermore, well known features may be omitted or simplified in order not to obscure the present invention.
An embodiment of the present invention provides a device, system and a method for displaying an expanded gamut of colors. The present invention is suitable for various types of electronic display devices, for example televisions and monitor devices (“monitors”) for computational devices. An embodiment of the present invention operates by using more than three primary colors. As previously described, the term “primary color” specifically does not include light from a white or polychromatic light source after only being passed through a neutral filter. Thus, unlike background art systems and devices, the present invention is not limited to combinations of colors which are produced from only three primary colors, such as red, green and blue for example.
According to preferred embodiments of the present invention, light from six primary colors is used, although of course any number of primary colors is operative with the present invention, as long as at least four such primary colors are included. The use of six primary colors is preferred since the gamut which is covered by the resulting hexagon is much larger than the triangle 20 which is produced by RGB phosphors, for example, yet can still be efficiently produced as part of an electronic color display, as explained in greater detail with regard to the preferred embodiment below. As shown as a hexagon 22 with regard to
With regard to the type of light source, or device for producing light for each primary color, different types of sources and/or mechanisms could optionally be used with the present invention. Optionally and preferably, in order to obtain the best coverage of the gamut, the light for each primary color should preferably be monochromatic. Of course, lasers could optionally be used as the source of light for the primary colors for the present invention. Monochromatic excitation can also optionally be produced by passing white light through a narrow spectral filter. However, as the spectral bandwidth of the excitation is limited, the brightness of the resultant light becomes lower (assuming that the brightness of the source stays the same). On the other hand, as the spectrum of the primary excitation becomes wider, the resultant color gamut for the electronic color display becomes more restricted. Therefore, the interplay between the purity and the brightness of the primaries should be considered, assuming that lasers are not used as the source of monochromatic light.
In addition, various display mechanisms are optionally used with the present invention, which also affect the choice of light source and/or device for production of the primary colors. The preferred display mechanism is projection of light onto the viewing screen, for an optical projection system. Projection displays can work simultaneously, in which light of all colors illuminates the viewing screen at the same time; or sequentially, in which light of the different colors illuminates the screen one after another. For the latter type of display, the vision system of the human eye perceives combined colors through temporal integration, as the sequential display of colors is performed sufficiently rapidly.
Display systems of the second type are based on spatially modulating colored light and projecting it on a display screen. The spatial modulation can optionally be performed by using a liquid crystal spatial modulator, in which case a source of polarized light should be used, or alternatively, for example, by a digital micro-mirror device (DMD) such as that produced by Texas Instruments (USA), which allows the use of non-polarized light. Of course other types of devices for performing spatial modulation are optionally used, and are encompassed by the scope of the present invention.
The spatial modulation can optionally be performed with analog or binary levels or gradations, according to the type of modulator device which is used. Nematic liquid crystal modulators, for example by CRL Opto (United Kingdom), or Kopin Inc. (USA), allow for analog “gray levels”, while Ferroelectric liquid crystal modulators, such as from Micropix Technologies (United Kingdom) or LightCaster™ from Displaytech (USA), and DMD are binary devices. If a binary modulator device is used for spatial modulation, “gray levels” are achieved by controlling the duration of the illumination, and/or the intensity of the light, incident on the spatial modulator.
Light production mechanisms based on optical projection are preferred over those mechanisms which are based on light emission at the screen or other portion of the display device. Examples of light emission mechanisms include CRT, field emission and plasma displays, in which the phosphors at the screen or other device actually emit the light; LED screens in which small electro-luminescent diodes emit the light; and flat LCD screens in which each of the pixels has an individual color filter. In these systems, physically small emitters of different primary colors, which therefore produce a small, focused point of colored light, are placed in close vicinity. The eye then automatically integrates the emitted light from neighboring pixels to obtain the color sensation.
However, these light emission systems suffer from a number of disadvantages. First, the addition of primary colors decreases the resolution of the display, unlike for optical projection mechanisms, in which the addition of primary colors does not affect the resolution of the display. Second, adaptation of the pixel matrix is required in order for the display screen to be able to display more than three colors. For CRT and LED mechanisms, special phosphors and diodes, respectively, must be developed. For LCD displays, the set of color filters must be adapted, in order to provide four or more primary colors through these filters. All of these adaptations require the addition of extra units, such as extra phosphors or extra diodes, which therefore increases the cost of the system in order to be able to display more colors. By contrast, as described in greater detail below, the adaptations which are required for optical projection systems are relatively minor, and do not result in increased cost for the system. Thus, optical projection systems are preferred over light emission systems.
The principles and operation of a device, system and method according to the present invention may be better understood wit reference to the drawings and the accompanying description.
Referring now to the drawings,
As shown in
Optionally and more preferably, for the preferred projection embodiment of system 36, light source 38 projects light of at least four colors, without being able to control the location of the projected light onto viewing screen 40. Controller 42 then determines the relative location of light of each color as projected onto viewing screen 40, for example with a spatial light modulator and/or another system of mirrors and/or lenses, as described in greater detail below with regard to
In order for controller 42 to be able to determine the correct light for being displayed at each portion of viewing screen 40, controller 42 optionally and more preferably receives data from a data input 44, which may optionally be digital or analog. Most preferably, controller 42 also receives instructions and/or commands from a converter 46, which lies between data input 44 and controller 42. Converter 46 converts the data from data input 44 into a format which is suitable for controller 42, and also includes any necessary instructions and/or commands for enabling controller 42 to be able to understand the data. Optionally, converter 46 may also convert the data from an analog signal to digital data, such that controller 42 is only required to receive digital data.
A system 48 is based on passing white light from a source 50 through appropriate color filters 52 to form colored light of a defined spectral range. As previously described, preferably system 48 features six such colored filters 52, which as shown may optionally be configured in a color filter wheel 54. In this example, the combination of light source 50 and color filters 52 can be considered to form at least part of the light source of
This colored light then illuminates a spatially modulated mask 56, also known as an SLM (spatial light modulator) which determines the particular color for being displayed at each portion of the image (typically according to each pixel), by determining whether light of that color is permitted to pass for illuminating that pixel. The colored light for this image is then projected by a projection lens 58 onto a viewing screen 60. Viewing screen 60 displays the resultant colored image to the user (not shown). Spatially modulated mask 56, and more preferably the combination of spatially modulated mask 56 and projection lens 58, can be considered to be an example of the controller from
Spatially modulated mask 56 is optionally either a binary modulation type or a continuous modulation type.
Examples of the continuous modulation type include, but are not limited to, polarization rotation devices such as LCD (liquid crystal device), electro-optical modulator and magneto-optical modulator. In these devices, the polarization of the impinging light is rotated. In this context, LCD features an organized structure of anisotropic molecules, for which the axis of anisotropy is rotated by the application of voltage, thereby rotating the polarization. For the electro-optical modulator, anisotropic crystals are featured, which change the rotation of the polarization of the light radiation, due to a change of the refractive index along the different axes, as a result of the applied voltage. The electro-optical modulator can be applied for a continuous, non-binary implementation or for a binary implementation. Magneto-optical modulators are devices in which a magnetic field is used to rotate the polarization, by changing the electro-optical properties of the crystal.
Examples of the binary modulation type include, but are not limited to, DMD, FLC, quantum well modulator and electro-optical modulator. DMD (digital micro-mirror device) is an array of mirrors, each of which has two positions, either reflecting light toward a viewing screen 60, or reflecting light away from viewing screen 60. FLC (ferroelectric liquid crystal) features liquid crystals, which have only two bi-stable orientation states, thereby changing the polarization of the light radiation to one of two states (effectively “on” and “off”). A quantum well modulator is a device in which voltage is applied in a quantum well, which then changes transmission and reflection properties for light by changing the states of the electrons in the well, to one of two levels according to the applied voltage. The electrons are changed from being absorptive to being transmissive.
In order for the light to be directed through the appropriate filter 52, preferably the light is focused by a condenser lens 62, optionally implemented as two such lenses 62 for the purposes of illustration only and without any intention of being limiting. The focused light is then directed through one of the filters on filter wheel 54. Filter wheel 54 holds at least four color filters 52, the transmission spectra of which is designed to give a coverage of a major portion of the gamut of the eye. A motor 64 optionally and preferably rotates filter wheel 54 in front of light source 50, so in each turn spatially modulated mask 56 is illuminated by all colors in filter wheel 54 sequentially. Preferably, the rate of rotation is at the frame frequency, which is the frequency at which the full-color image on viewing screen 60 is refreshed. Typical frame frequencies (rotation frequencies) are in the range of 30–85 Hz.
More preferably, the loading of the data into spatially modulated mask 56 is synchronized by a timing system 66, according to the rotation of filter wheel 54. The light beam is spatially modulated by spatially modulated mask 56, so that the apparent brightness of each primary color varies at different portions of viewing screen 60, typically according to each pixel of the image. Each position 68 on viewing screen 60 is preferably associated with a certain pixel 70 in spatially modulated mask 56. The brightness of that position is determined by the relevant data pixel in the image. The values for the pixels of the image are optionally and preferably retrieved from an image data file 72. The human viewer integrates the sequential stream of the primary images to obtain a full color image with a wide gamut of colors when viewing the image as projected onto viewing screen 60.
An implementation using liquid crystal modulators requires the use of polarized light. For reflecting devices, such as Liquid Crystal Over Silicon (LCOS) devices, the same polarizer, usually a polarizing cube beam splitter, can be used for polarizing the incident light and for analyzing the reflected light. For transmission devices, such as active matrix LCD based on thin-film-transistor technology (TFT) as provided by Epson, Kopin (USA) and other vendors, for which light passes through the pixilated matrix, linear polarizers are placed before and after spatially modulated mask 56. The exemplary but preferred implementation shown in
An exemplary description of the flow of data and data handling is also shown with regard to
The analog image data is optionally and more preferably transformed into digital data for the purpose of the present invention, for example in order to correct for various effects caused by the video/graphics card interface to obtain digital RGB (three-color) image data 72. Examples of effects for which such correction may optionally and preferably be desired include but are not limited to, effects of analog to digital (A/D) conversion and video decoding, the effect of de-gamma conversion, and the effect of converting from interlace to non-interlace signals. According to preferred embodiments of the present invention, the data is only presented in one field, and not in two or more fields as for the interlaced video of the background art. Therefore, the data is preferably subjected to a transformation such that the data is not interlaced before being sent to the frame buffer, as described in greater detail below.
Digital RGB data can also optionally and more preferably be obtained directly from digital graphic cards, available from ATI, Number Nine Revolution and other vendors.
In any case, the digital RGB image data or YCC type-data is then manipulated in a multi-color transformation module 74, as described in greater detail below, into a color format which includes data for each color of color filters 52, with N-bits of data per color (for example, 7 colors, of which one is white, and 8 bits per color).
The resulting 7 color channels are more preferably subjected to a gamma correction process for the response of spatially modulated mask 56 by a gamma correction module 76. Gamma-correction module 76 performs a non-linear transformation, known as a “de-gamma” process, for each of the data channels. The transformation is preferably non-linear since the incoming data is typically non-linear in order to correct for such effects of components within the system on the signal as the cable to viewing screen 60 (not shown), such that the output of the transformation is preferably linear. Preferably, this transformation is performed by applying several look-up tables (one or more for each channel), which contain the output values corresponding to all possible input values. The use of such look-up tables provides for a standardized, corrected, linear output which can be more precisely displayed with the system of the present invention.
The corrected data is then loaded into a frame buffer and format module 78 which arranges the stream of data in a format consistent with the electronic requirements of spatially modulated mask 56. Frame buffer and format module 78 is a memory device for holding the data of the image. Typically, the data is held in the same geometrical arrangement as the pixels of the image, and of spatially modulated mask 56.
For the system described above, the frame buffer itself, of frame buffer and format module 78, is preferably divided into bit planes. Each bit plane is a planar array of bits, in which each bit corresponds to one pixel on spatially modulated mask 56. Each bit plane actually represents at least a part of the data for each color, such that if a pixel is to have a component which includes a particular primary color, that pixel is represented by a particular bit on the appropriate bit plane which features that primary color. The bit planes are arranged one below the other to form a three-dimensional arrangement of the data, from the most significant to the least significant bit. There are m×N bit planes (m is the number of bits/color channel, N is the number of color channels).
Timing system 66 can be considered to be an example of at least a portion of the converter of
The data is usually presented as 8 bits (256 levels) per each of the seven primary colors. The various “gray levels” of the illumination can be achieved in different ways depending on the type of spatially modulated mask 56 which is used. For “analog” modulators, such as nematic LC modulators for example, the gray level is determined by the amount of the optical axis rotation, controlled by the voltage applied to the device. Each frame requires seven “updates”, or changes to the configuration, of spatially modulated mask 56, with one update for each of the primary colors of color filters 52. For a frame refresh rate of 50 Hz for viewing screen 60, this corresponds to an update rate of 350 Hz. The eight bit planes corresponding to the relevant color are retrieved from the frame buffer itself, of frame buffer and format module 78, and are optionally and preferably transformed into analog signals. These analog signals are then amplified and applied to spatially modulated mask 56.
For the “binary” type of spatially modulated mask 56, such as digital micro-mirror devices (DMD) by Texas Instruments or Ferroelectric Liquid Crystal (FLC) SLM by MicroPix, Displaytech and other vendors, gray levels are achieved by pulse width modulation (PWM) of the light, a technique which is well known in the art. In order to perform pulse width modulation of the light, m bit planes, shown here for m=8 planes, for each primary color are loaded into spatially modulated mask 56 during the period for displaying the relevant color. For a frame rate of 50 Hz and a 7 color display, the time for each color to be displayed is 20 ms/7=2.85 ms (20 ms= 1/50 Hz). During this time, 8 bit planes should be loaded into spatially modulated mask 56, resulting in an update rate of 2.8 kHz. However, if PWM is applied to the light, the least significant bit plane should be presented on spatially modulated mask 56 for only 11.2 microseconds.
To extend the display period and therefore to avoid such a rapid refresh or change rate for spatially modulated mask 56, optionally and preferably PWM is not applied to the light. Instead, the illumination time is preferably divided uniformly between the bit planes. The different bit values are then optionally and more preferably created by changing the brightness of light incident on spatially modulated mask 56. The brightness of the incident light is optionally and most preferably altered by using a continuously varying neutral density (ND) filter, as described in greater detail below.
The timing sequence for operation of color filter wheel 82 is depicted in
The light intensity which passes through the ND filter, during the period of the ith bit (msb=0 bit, lsb=m−1 bit) is given by:
Other optional implementations for varying the brightness of the light are also possible and are encompassed within the scope of the present invention. For example, a varying wheel of neutral density filters could optionally be placed after the color filter wheel. This ND filter wheel would rotate synchronously with the color filter wheel, so that the ND filter wheel completes seven turns during one turn of the color wheel.
Another optional implementation would use an electronically controlled LC or Electro-optic light intensity modulator after the color filter wheel. Such a device controls the brightness of the filtered light through an electronic (digital) control. One example of such a device is the LC modulator from CRL Opto (United Kingdom). As another option, an electronic shutter system could be placed as an aperture controlling the amount of light arriving to the SLM, or passing from the SLM to the screen.
The intensity of the light source could also optionally be altered, by modulating it in time. For example, the light source could optionally be implemented as a flash lamp, which emits light in bursts or “fashes.” The light then decays with time, such that the brightness of the light decreases over time. This decrease enables the intensity or brightness of the light to be altered without a neutral density filter. Alternatively, in a similar system with a flash lamp, the lamp could optionally also emit flashes of light with a high repetition rate, such that the number of pulses per unit of time would determine the brightness of the emitted light.
The spectra of
However, most electronic image data is typically given in an RGB or RGB related format, according to some function of the RGB format, or in another format such as YCC-type data. In an exemplary embodiment, the use of such data requires the data to be transformed into a format which is suitable for a display including at least four primaries. Optional methods for such data transformation is described with respect to
As explained with regard to the exemplary method in the flowchart of
The XYZ matrix can be inverted if the three primary vectors do not lie on the same plane. If one of the parameters (aw, a1, a2) is negative, the input point lies outside the gamut, in step 5. In this case the negative value can be set to zero. These steps produce the resultant seven color (six color plus white light for brightness) data.
The parameters a1 and a2 represent constants for the two non-white primaries defining the outside leg of the relevant triangle. The constants a1 and a2 represent the levels at which the primaries corresponding to these constants should be displayed to reproduce the color represented by the input point (x0, y0). Each of the six primaries p1–p6 contribute to the white source defined by (xw, yw) according to certain pre-defined levels, as the white source is formed from certain proportions of each of these primaries. To determine the constants a3, a4, a5, and a6, which determine the levels of the four primaries not part of the relevant triangle, the contribution level of the primaries corresponding to these constants to the white source (xw, yw) are multiplied by the constant aw. For example, if the primary corresponding to constant a3 contributes 0.25 (on a 0–1 scale) to the white source, 0.25 is multiplied by aw, to determine a3. Since, in one embodiment, the two non-white primaries forming the relevant triangle also contribute to the white source, an additional two levels are determined for these primaries based on their contribution to the white source and on the level aw, and these two levels are added to a1 and a2 to calculate the contribution of these two constants towards producing the input point color corresponding to the input point (x0, y0).
In another embodiment, one white source (xw, yw) may be chosen for the purpose of forming triangular spectral regions with the six non-white primaries placed along the periphery of the horseshoe, and another set of sources w1–w6 (one for each pair of adjacent non-white primaries) may be used to calculate the contribution of the non-white primaries towards reproducing the color represented by the input point. The sources w1–w6 need not be substantially white. In alternate embodiments the color or colors used as central points need not be white or substantially white.
First, the input point (x0, y0) representing the target color is mapped on the space 600, and the relevant triangle, defined by the white source (xw, yw) and two non-white primaries is found, as described above. Next, a second source wβ from w1–w6 is referred to, the relevant source being that formed from the six non-white primaries, with the exclusion of the two non-white primaries firming the outside leg of the relevant triangle. Preferably, the second source wβ and the two non-white primaries forming the outside leg of the relevant triangle form a second triangle which substantially overlaps the relevant triangle. This relevant source wβ is used along with the two relevant non-white primaries in an additive linear combination similar to that described above:
The parameters (awβ, a1, a2) of the combination are given by:
The additive linear combination is solved for the constants awβ, a1, and a2.
The parameters a1 and a2 represent constants for the two non-white primaries defining the outside leg of the relevant triangle. The constants a1 and a2 are the levels at which these constants may be displayed (e.g., projected onto a screen or displayed via an LCD) to reproduce the color represented by the input point (x0, y0). Each of the remaining four non-white primaries (the six non-white primaries not including the two relevant non-white primaries) contribute to the relevant source wβ from w1–w6 according to certain pre-defined levels, as the relevant source is formed from certain proportions of each of these remaining primaries. Thus, to determine the constants a3, a4, a5, and a6, the contribution levels of the primaries corresponding to these constants to the relevant source wβ are multiplied by the constant awβ. Since, in such an embodiment, the two non-white primaries forming the relevant triangle do not contribute to the relevant source, no additional calculation needs to be performed to calculate the contribution of these two constants.
While, in the above description, the methods are described with respect to six primaries, the above described methods may be used to transform a color point to a color system including any number of primary colors. Furthermore, in alternate embodiments, other sets of steps may be used to calculate the levels for a set of primaries using a set of triangular regions formed by pairs of the primaries and central points.
The set of steps above is preferably carried out by a processor or data converter which is part of a display system according to an exemplary embodiment of the present invention. Such a processor or data converter may be any conventional data processing device, such as a microprocessor, “computer on a chip,” or graphics processor.
The method described above is only one possible way to transform the RGB data to a format suitable for a display with at least four colors. In particular, regarding the detailed procedure, it is not essential to include white light points among the color points. The procedure only requires the definition of a set of triangles, which are based on the existing primaries and any set of additional colors, which preferably can be composed from the other primaries. For example, the source or white color point could be replaced with a definition of the source or white point as being composed of equal amounts of each of the six primaries.
As shown with regard to
Next, a plurality of SLM (spatial light modulators) 110 is used. Each SLM 110 is then used to modulate each of the beams according to the data of the image which is to be produced. The beams may optionally be combined before projection, but preferably are projected on a display screen 112, as shown. For the latter implementation, the beams are combined at display screen 112. The integration of beams is performed on display screen 112 simultaneously.
Optionally and more preferably, each SLM 110 has an associated imaging lens 114 for focussing the beam on display screen 112 as the beam passes through SLM 110. Each imaging lens 114 is preferably positioned away from the axis of the beam of light after passing through SLM 110, such that that combined beams of light appear to be in registration on display screen 112. Alternatively, mirrors could optionally be used for placing the beams of light in registration, and/or the angle of each SLM 110 could optionally be adjusted in order to adjust the angle of the beam of light as it exits each SLM 110.
According to another embodiment, the light from the white light source is split into a plurality of beams. The beam splitting can optionally be performed by dispersing the light through a prism/grid and collecting the relevant parts of the spectrum. Alternatively, the white light can be split without dispersion into a plurality of beams, after which each beam is filtered to create each of the relevant colors. Also alternatively, a suitable arrangement of dichroic mirrors/filters may optionally be used.
A similar implementation is optionally and preferably based on seven CRT (cathode ray-tubes) with suitable phosphors or black-and-white CRT with suitable filters that are projected onto a screen and combined there in registration as in three-primary CRT (cathode-ray tube) projectors (for example, Reality 800 series of products from Barco Inc.).
In one embodiment of the present invention, a set of filters is chosen to gain the widest chromatic coverage possible while maintaining white balance, efficiency and brightness.
In one embodiment of the present invention, a set of filters is chosen based on the principle that, to obtain a wide coverage of the chromatic gamut, for each of the corners 604, 605 and 606 of the horseshoe 600, at least one primary should be chosen to fall near a corner 604, 605 or 606. In one embodiment of the present invention, a set of at least three primaries is chosen, such that at the filters for at least three primaries in the set have the following characteristics: one filter does not pass wavelengths substantially below 600 nm, another does not pass wavelengths substantially above 450 nm, and the third is a narrow band-pass filter with a central wavelength in the range of approximately 500–550 nm, whose total width does not substantially exceed 100 nm. Additional primaries may be chosen to increase the number of colors which can be represented, beyond the triangle created by the three filters, to increase the brightness and efficiency, and to allow for white balance.
In alternate embodiments, other combinations of primaries and filters may be used which include the three primaries from the ranges discussed above. For example, the three primary colors from the ranges discussed above may be used in combination with only one addition primary color from outside these ranges.
In one embodiment of the present invention, a set of primaries and filters is chosen so that a spectral reconstruction of certain set of colors is obtained. When reproducing “real” or “natural” colors for human viewing using a finite set of primaries, a certain target color to be reproduced may be reproduced by different sets of levels or combinations of the set of primaries. Many different spectra may be represented by the same target color coordinates, a phenomenon named metamerism. Representing a target color using a set of primaries based on an “average” human observer's reaction to a set of primary colors is inaccurate, as an actual human observer is unlikely to perceive the representation of the target color as matching the actual target color.
In the prior art, the spectra of primary colors for display and other systems (such as printing systems) has been chosen based on a calorimetric match. In a calorimetric match, a series of human subjects are shown a color patch created using a combination of three of primaries. Each subject is shown two patches; a target color patch and a patch created from a mix of three primaries. The level of each primary is adjusted until the subject reports that the target patch and primary patch are identical. The primary levels are recorded, and the process is repeated for a series of other target colors. For each target color, the levels across the set of human subjects are averaged. The resulting set of averaged levels is used as a model for reproducing the target colors. Forming color via calorimetric analysis results in inaccuracies in people's perceptions of colors produced by the resulting displays, as each person perceives color differently. A person viewing a display using primaries produced through colorimetric matching is unlikely to perceive colors as do the “average” humans used to create the primary spectra, and thus is likely to perceive different colors than intended.
In order to increase the accuracy of colors represented by a set of primaries, and to increase the likelihood that different human observers will perceive certain colors accurately, one embodiment of the system and method of the present invention is used to choose and define a set of primaries based on a spectral match rather than a colorimetric match, such a set of primaries may be used in a display system according to an embodiment of the present invention. A set of primary colors are chosen so that they most accurately reproduce a set of actual spectrum samples.
In one embodiment, to choose a set of 1 primaries for use, for example, in a display system, a target set of spectra to be reproduced are chosen, and a set of 1 primaries are chosen which optimally reproduce the set of target spectra. While the set of 1 primaries are used to reproduce a broad set of visible spectra, it is desired that the target set of spectra in particular be reproduced as accurately as possible. The set of target spectra may be chosen for use with a certain application; for example, color film reproduction.
For example, in order choose a set of 1 primaries (where, for example, 1=6) for use with a color display optimized to reproduce the color spectra of a certain type of color film, a set of m sample spectra produced by the color film itself are selected, and 1 primaries are created which optimally produce the desired color spectra. In color film, light is passed through layers of cyan, magenta and yellow dyes. The concentrations of the dyes determine the transmission spectrum of the film. The concentrations are measured as red, green and blue densities for the cyan, magenta and yellow dyes, respectively. The concentrations are varied according to the exposure of the film; i.e., according to the color spectra failing on the film during exposure. In one embodiment, a set of sample transmission spectra which are typical for films are chosen, and a set of 1 filters or primaries are selected such that for each of the given sample transmission spectra, a color can be produced which substantially simulates the sample spectrum. Preferably, each sample spectra is associated with the dye densities producing the spectrum, allowing for source data corresponding to the dye densities to be easily converted to primary levels in a display system.
The m sample spectra may be chosen based on certain constraints, or with certain goals in mind. For example, the sample spectra may include colors such as “memory colors,” colors which may be easily perceived by human observers as incorrectly reproduced. Memory colors may include, for example, skin tones or the color of grass. If a display inaccurately reproduces skin tones, a human observer is more likely to notice the inaccuracy than if a display inaccurately reproduces, for example, the colors of a set of balloons. The sample spectra may include samples from photographs or films of actual objects. The sample spectra may include a broad range of hues with different saturation and brightness levels for each hue.
To determine the spectra of the primaries and the number of the primaries, the m target spectra chosen are sampled at a certain number n of sample wavelengths. The measured spectra are sampled at certain wavelengths at the desired resolution. For example, the spectra may be sampled across the range 400–700 nm with a 10 nm resolution, giving 31 sample points for each spectrum. Each continuous sample spectrum is thus converted to a vector in an n—dimensional space; in the example given n=31. Each of the m vectors S i(λ), i=1. . . m and λ=1. . . n (n=31 in the example) is an ordered set of n numbers each preferably between 0 and 1. Each number represents the sampled spectral value at the corresponding wavelength λ across the range of 400–700 nm. The spectra of all patches are arranged in an m×n matrix Siλ???? preferably m>>n where m is the number of spectra sampled and n is the number of sample points for each spectrum.
To find a set of 1 primaries which can reproduce the sample spectra with some accuracy, the set of n basis vectors Ψ l(λ) l<<n, preferably l<<n, is found which span the same sub-space which is spanned by the m sample vectors, such that ∥S i(λ)−Σlαil Ψ l(λ)∥ is near zero for all m vectors. Here ∥x∥ is the norm of the vector x. Each basis vector is a spectrum having n sample points which may be used to create, for example, a primary color or a filter for a primary color. A primary or filter may correspond to a basis vector, in that a basis vector may provide a spectral model for forming a primary or filter. The basis vector may be modified in any number of ways to create a spectrum for a filter; for example, the basis vector may be rotated, or its constants may be transformed according to various methods.
The m sample vectors may be converted to the n basis vectors using various methods. In an exemplary embodiment, a subset of 1 basis vectors from the n basis vectors is chosen, such that the subset includes those basis vectors most contributing to reproducing the m sample spectra. Preferably, a process similar to factor analysis is used to eliminate any negative values, and the resulting 1 basis vectors are rotated. Also preferably, further requirements are that the coefficients 0≦αil≦1, and that 0≦Ψ l(λ)≦1 for all i, 1 and λ.
In one embodiment, the known singular value decomposition (SVD) method is used. Preferably, the m×n matrix S=Siλ matrix, preferably m>>n, is decomposed into three matrixes, such as S=VWU, where V is an m×n matrix W is an m×n diagonal matrix, and U is an m×n orthogonal matrix.
The decomposition may be written as:
which can be written in vector representation as:
Thus the sample vectors S i(λ) are linear combinations of n basis vectors U k(λ), k=1 . . . n.
The rows of U include the n basis vectors. W includes the weights of the basis vectors, the contribution each of the n basis vectors makes to the solution. The diagonal of W includes n constants, preferably between 0 and 1, representing the relative amount each of the n basis vectors makes to the solution. V contains the weighted decomposition coefficients.
Preferably, less than n primaries are to be determined. If there is dependence (or near dependence) between the m original sample vectors in such a way that the sub-space spanned by the m original sample vectors has lower dimensionality, some of the weights on the diagonal of W are zero or near zero. By eliminating certain rows of U including basis vectors corresponding to these low weights, a basis of lower dimensionality is obtained. The decision as to which weights are small enough is based on the required accuracy of the eventual reconstruction. Therefore, a reduced set of 1 basis vectors, 1<n, which contribute most to the solution or which are most relevant to the reconstruction of the sample colors are identified, preferably based on the set of constants in the matrix W. The 1 highest constants are identified, and the 1 basis vectors corresponding to these constants are used. Alternately, the number of basis vectors used may be determined by determining which basis vectors contribute a certain percentage to the solution. For example the 1 basis vectors which contribute to 90% of the solution may be identified. In alternate embodiments the number of basis vectors need not be reduced.
The basis vectors Ψ l(λ) are orthogonal, and therefore they may include negative numbers. Since the filters producing the primaries transmit light in proportions between 0 (no light transmitted) and 1 (complete transmission), the basis vectors preferably include only positive numbers, preferably between 0 and 1.
In one embodiment, a process similar to factor analysis is used to convert the set or the reduced set of basis vectors Ψ l(λ) to a set of basis vectors which are not-orthogonal and include positive numbers, preferably between 0 and 1. Preferably, the basis vectors are rotated, using known vector transformations, to determine a set of basis vectors such that 0≦Ψ l(λ)≦1 and that for any S i(λ)≈Σlαil Ψ l(λ) the coefficients 0≦αil≦1.
A set of primary color spectra, and filters for those spectra, may be created from the resulting basis vectors. Preferably, for each basis vector, a curve is created from the n levels in the vector. Various methods may be used to create such a curve, such as interpolation. Such a curve is used to produce a filter passing a range of wavelengths corresponding to or substantially corresponding to the curve. This filter may be used in a display system according to an embodiment of the present invention to produce a primary color corresponding to the basis vector.
In alternate embodiments, other methods of determining basis vectors, such as component analysis (PCA), may be used. In one embodiment using PCA, m vectors S i are gathered in the n-dimensional space, and the covariance matrix C is calculated, such as:
The covariance matrix is an n×n symmetric matrix. The eigenvalues and the eigenvectors of the covariance matrix are then found. The eigenvalues are the weights of each eigenvector in the basis. The basis vectors are orthogonal, and can be rotated so that a new basis is constructed which fulfils the requirements.
In alternate embodiments other series of steps may be used to convert a set of sample spectra to a set of primaries which may be used to produce those sample spectra.
A display according to an embodiment of the present invention accepts source data, such as RGB, CYM or YCC-type values, and converts the source data into primary levels for display. If a set of primaries has been created by referring to a set of sample spectra, as described above, and each spectrum of the set of sample spectra corresponds to certain source data values, such as dye concentrations or other values (RGB, YCC, etc.), the conversion of the source data into primary levels may involve reference to the set of data created during the selection of the primaries. When converting a set of m sample spectra to a set of 1 primaries, each sample spectrum may have been associated with a set of color values such as dye concentrations or primary values (e.g., a set of RGB or YCC-type levels). If the source data corresponds directly or easily to the set of color values, the color values used in the original conversion may be used to convert the source data to estimated primary levels which, in turn, may be used via interpolation to calculate the actual primary levels for the source data.
For example, source data may be RGB values from a source film or YCC values transformed to RGB values, and the primaries used in the display may have been created based on a set of samples defined by the RGB or YCC values. The RGB values represent the densities of the cyan magenta and yellow dyes, respectively, used to create the source film. To convert source data to a set of constants used to display primaries in an imaging system or monitor according to one embodiment of the present invention, first the transmission spectrum of the film is evaluated from the RGB values in the source data. A spectrum is constructed from the filter transmission spectra, and possibly in addition taking account of the required illumination. A set of constants is generated which allow the set of primaries to approximate the constructed spectrum. Preferably, a colorimetric difference between the spectra estimated from the source data and the spectra reconstructed using the primaries is calculated, and, if necessary, a correction is performed.
Various methods may be used to recreate the source spectrum from the source data A physical model for the transmission of the source film may be calculated, if the absorptions of the dyes are known along with the relationship between the density and the concentration of the dyes. For example, a model for recreating source spectrum from source data may be:
In an alternate embodiment, the transmission spectra may be evaluated by interpolation in a look-up-table. When determining the primaries, a set of spectra is measured to determine the filters, and RGB (or other source data) values have been associated with each spectrum, a spectrum may be found for each value of RGB by interpolating between spectra in the known set of sample spectra. In further embodiments, other methods may be used to produce transmission spectra.
After the transmission spectrum resulting from the source data is evaluated, the projected spectrum may be calculated from the light projected through the “virtual” film S(λ)T(λ), where S(λ) is a light source spectrum, possibly corrected by the optics of the projector. This projected spectrum may be calculated based on the reconstructed transmission data. The projected spectrum may be expressed as a function of the l-filters used with the by the l-primary monitor, allowing for the constants for the filters to be solved. Thus:
Alternately, to transform source data into a set of primary constants αi, the sets of primary constants created during the primary creation calculations may be used, and the resulting values interpolated. In one embodiment, when defining a set of primaries for use with a display system, a set of sample spectra associated with source data such as RGB values are created. While calculating the spectra for the primaries, each of the sample spectra are associated with a set of constants which may be used in conjunction with the resulting primaries to approximate the sample spectra. These constants may be placed in a look-up-table and indexed by the source data (e.g., RGB data) used to create the spectra. During the operation of a display system using the primaries, to convert source data to a set of primary constants, the look-up-table is referenced to find sets of constants close to the solution. Interpolation is performed on these sets of constants to produce a set of constants allowing the primaries to approximate the target spectrum.
Color correction on the resulting set of constants may be performed to obtain a better color match. The color correction involves a comparison between color coordinates of the projected spectrum based on the input data to that of the spectrum to be produced from the l-filter monitor. For given source values the color coordinates of light projected through the film can be evaluated, as shown above. In a similar manner, the color coordinates of the l-filter monitor can be evaluated. To correct any discrepancies between the source produced spectra and the primary produced spectra, and various methods may be used. For example, a colorimetric difference between the source and primary spectra may be calculated and the appropriate correction performed.
Conversion of source data to constants for use with primaries is preferably carried out by a processor or data converter which is part of a display system according to an exemplary embodiment of the present invention. Such a processor or data converter may be any conventional data processing device, such as a microprocessor, “computer on a chip,” or graphics processor.
While the invention has been described with respect to a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of the invention may be made.