Deinterlacing
615267
223514235
2008-07-04T11:51:14Z
58.94.80.159
/* Where deinterlacing is done */ fix list numbering
'''Deinterlacing''' is the process of converting [[interlaced]] video, like common [[analog television]] signals, into a non-interlaced form.
== Background ==
[[Video]] and [[Film]] consist of a series of images played in rapid succession. Each of these images is known as a [[frame]]. Unlike a film frame, which is a single entity, a video frame is composed of multiple scan lines.
All existing analog television systems and many digital systems arrange scan lines of one frame into two [[field (video)|fields]]. One field contains all even lines, another field contains all odd lines. The fields are then displayed in succession with a rate twice faster than the nominal frame rate. For instance, [[PAL]] and [[SECAM]] systems have rate of 25 frames/s or 50 fields/s, while the [[NTSC]] system delivers the rate of 30 frames/s or 60 fields/s. The process of producing half-resolution fields at double the frame rate is known as ''interlacing''.
Interlaced scanning produces visual defects called ''interlace artifacts'' or ''combing'', which occur when objects in the image move around. Interlace artifacts are not noticeable on a traditional CRT-based TV set, because scan lines overlap and also because of tube phosphors afterglow.
Modern [[LCD]] and [[plasma]] displays work differently than CRT displays. There is no afterglow, so after a field is shown, the screen goes dark. Also, the scan lines do not overlap. New technology is perfect for use in computer displays, but when employed in television it makes individual fields noticeable, producing ''jaggies'' and ''ghosting''.
To combat interlace artifacts, all LCD and plasma consumer television sets have built-in circuitry that converts interlaced video into [[Progressive scan|progressive]] video. Progressive video consists of full frames and does not exhibit interlace artifacts.
The process of converting interlaced video into progressive is called ''de-interlacing''. If done poorly, de-interlacing can introduce image degradation.
==Basic concept==
In a typical [[cathode ray tube|CRT]] television, the interlaced display draws only half of the lines on the screen for each [[Frame (film)|frame]], alternately drawing the odd and even lines for each frame. This reduces [[flicker (screen)|flicker]] by taking advantage of the [[persistence of vision]] effect, producing a [[refresh rate]] of double the frame rate without the overhead of either transmitting each frame twice or holding it in a buffer so it can be redrawn.
When displaying [[video]] on a [[Display device|display]] that can support a high enough refresh rate such that flicker isn't perceivable, interlaced video can be ''deinterlaced'' for better viewing; likewise when a display cannot interlace but must draw the entire screen each time, the video must be deinterlaced before it can be displayed. All current displays except for [[CRT]] screens require deinterlacing. Though in principle there is no reason why LCD, DLP or Plasma displays should not display two fields sequentially, the requirement that half of the pixels remain black would result in a halving of brightness, even assuming that the response time of the technology could be made fast enough.
Deinterlacing requires the display to buffer one or more fields and recombine them into a single frame. In theory this would be as simple as capturing one field and combining it with the next field to be received, producing a single frame. However the originally recorded signal was produced as a series of fields, and any motion of the subjects during the short period between the fields is encoded into the display. When combined into a single frame, the slight differences between the two fields due to this motion results in a "tearing" effect where alternate lines are slightly displaced from each other.
Modern deinterlacing systems therefore buffer several fields and use techniques like [[edge detection]] in an attempt to find the motion between the fields. This is then used to interpolate the missing lines from the original field, reducing the "tearing" effects.
==Deinterlacing methods==
There are various methods to deinterlace video, each producing different problems or [[Artifact (observational)|artifacts]] of their own. Some methods are much cleaner in artifacts than other methods. All are indeed not equal.
Most de-interlacing techniques can be broken up into three different groups all using their own exact techniques. The first group are called '' Field Combination De-interlacers'', because they take the even and odd fields and combine them into one image or frame which is then displayed. The second group are called ''Field Extension De-interlacers'' because each field (with only half the lines) is extended to the entire screen to make a frame. The third type use a combination of both and fall under the banner of ''Motion Compensation'' and a number of other names.
=== Field Combination Deinterlacing ===
* [[Weaving]] is done by adding consecutive fields together. This is fine when the image hasn't changed between fields, but any change will result in artifacts known as "[[mouse teeth]]" or "tearing", when the pixels in one frame do not line up with the pixels in the other, forming a jagged edge. This technique retains full vertical resolution at the expense of half the temporal resolution.(Motion)
[[Image:Weaving.jpg|center]]
* [[Blending]] is done by ''blending'', or ''averaging'' consecutive fields to be displayed as one frame. The mouse teeth are avoided because both of the images are on top of each other. This instead leaves an artifact known as ghosting. The image loses vertical resolution and temporal resolution. This is often combined with a vertical resize so that the output has no numerical loss in vertical resolution. The problem with this is that there is a quality loss, because the image has been downsized then upsized. This loss in detail makes the image look softer. Blending also loses half the temporal resolution since two motion fields are combined into one frame.
[[Image:Blending.jpg|center]]
* [[Selective blending]], or ''smart blending'' or ''motion adaptive blending'', is a combination of weaving and blending. As areas that haven't changed from frame to frame don't need any processing, the frames are weaved and only the areas that need it are blended. This retains full vertical resolution, half the temporal resolution, and has fewer artifacts than weaving or blending because of the combination of them both.
* [[Telecine#Reverse telecine .28a.k.a. IVTC.2Finverse telecine.29|Inverse Telecine]]: [[Telecine]] is used to convert a motion picture source at 24 frames per second to interlaced TV video in countries that use NTSC video system at 30 frames per second. Countries which use PAL at 25 frames per second do not use Telecine since motion picture sources are speed up 4% to achieve the needed 25 frames per second. If Telecine was used then it is possible to reverse the algorithm to obtain the original non-interlaced footage (which has a slower frame rate). In order for this to work, the exact telecine pattern must be known or guessed. Unlike most other deinterlacing methods, when it works, inverse telecine can perfectly recover the original progressive video stream.
* [http://neuron2.net/telecide.html Telecide]-style algorithms: If the interlaced footage was generated from progressive frames at a slower frame rate (e.g. "cartoon pulldown"), then the exact original frames can be recovered by copying the missing field from a matching previous/next frame. In cases where there is no match (e.g. brief cartoon sequences with an elevated frame rate), then the filter falls back on another deinterlacing method such as blending or line-doubling. This means that the worst case for Telecide is occasional frames with ghosting or reduced resolution. By contrast, when more sophisticated motion-detection algorithms fail, they can introduce pixel artifacts that are unfaithful to the original material. For [[telecine]] video, [[decimation (signal processing)|decimation]] can be applied as a post-process to reduce the frame rate, and this combination is generally more robust than a simple inverse telecine (which fails when differently interlaced footage is spliced together).
=== Field Extension Deinterlacing ===
* [[Half-sizing]] displays each interlaced frame on its own, resulting in a video with half the vertical resolution of the original, unscaled. While this method retains all vertical resolution and all temporal resolution it is understandably not used for regular viewing because of its false aspect ratio.
[[Image:Halfsizing.jpg|center]]
* [[Line doubler|Line doubling]] takes the lines of each interlaced field (consisting of only even or odd lines) and doubles them, filling the entire frame. This results in the video having a frame rate identical to the field rate, but each frame having half the vertical resolution, or resolution equal to that of each field that the frame was made from. Line doubling prevents mouse teeth but it causes a noticeable reduction in picture quality since each frame displayed is doubled and really only at the original half field resolution. This is noticed mostly on stationary objects since they bob up and down. This technique is also called bob de-interlacing for this reason. Line doublers retain all vertical and temporal resolution at the expense of bobbing artifacts on stationary and slower moving objects.
[[Image:Doubler.jpg|center]]
=== Motion Compensation ===
The best deinterlacers combine all of the methods mentioned above, both field combination and frame extension. This technique is often called [[motion compensation]]. Deinterlacers that use this technique are often superior because they can use information from many fields, as opposed to just one or two. For example, if two fields had a person's head moving to the left, then if weaving was applied, mouse teeth would appear. If blending was applied, ghosting would appear. Selective blending would also create ghosting. Both of the frame extension methods would have no artifacts and would be the best selection for this motion section of the scene. Advanced motion compensation (ideally) would in addition see that the face in both fields is the same, just transposed, and would combine the face (through some advanced method) to get full detail in both output frames. Doublers as above don't provide combined field resolution in this form. This technology would need to be combined with a scene change detection [[algorithm]], otherwise it will attempt to find motion between two completely different scenes. In the areas that it cannot find a motion match, it could fall back on selective blending. If frame rate was to be preserved it could fall back on doubling.
The best de-interlacers, (In the case of NTSC) also determine whether video material source was from film by checking for a [[3:2 pulldown]] Telecine sequence. They automatically do a reverse [[telecine]] instead of the above deinterlacing techniques in this case. This operation is more automatic on modern deinterlacers than it used to be.
==Interlacing in HDTV==
Interlaced video requires the necessarily imperfect process of deinterlacing, and many experts hold that that casts doubt on the wisdom of the choice of 1080i (interlaced) as a standard in HDTV television and video (along with 720p (progressive)). The EBU European Broadcasting Union has argued against the use of interlaced video in production, recommending the use of 1080p/50fps (frames per second) as a future production standard for easier conversion to other formats.[1]
Standard Film Movies at 24fps are transmitted in these HDTV formats as is done in standard definition. Movies are speed up 4% to make 25 frames per second. Each frame is split into odd and even lines to make two fields at 50 cycles a second. There is no need for de-interlacing thanks to 2:1 pull down. However, many feel this approach is still more difficult and complicated than true progressive scan broadcast and especially so for the United States and other NTSC based countries where Telecine techniques must be used for frame rate conversions.
Modern televisions and computers are more capable of displaying video in its source resolution and frame rate than were older systems. Most movies on [[Blue ray disc]]s have preserved the original non interlaced 24fps motion film rate and allow output in this non interlaced format directly to HDTV's. No conversions are necessary. At present (2008)[[Blue Ray]] does not support 1080p at 50fps, but does support 720p at 50fps and all interlaced formats.
Some 1080i HDV camcorders offer progressive mode with cinema-like frame rate of 24 or 25 frames per second, using technique similar to traditional telecine in NTSC countries and 25 frames in PAL countries. Progressive frames are packaged within interlaced signal and can be reproduced by standard consumer television equipment.
All Deinterlacing is often called line doubling in many cases. There is confusion when this is referred to as interpolation, which uses spatial filtering to generate extra lines and hence reduce the visibility of pixelation on any type of display.[2] The terminology 'line doubler' is used more frequently in high end consumer electronics, while 'deinterlacing' is used more frequently in the computer and digital video arena. However, both are essentially the same thing in most cases
==Where deinterlacing is done==
Deinterlacing can be done (if it needs to be) at various points in the chain from filming to watching. When it is done affects the quality of the deinterlace, because the quality of the deinterlacer can vary.
#If it is done in the filming studios, it should be done very well. The people doing it are professionals, and have minimal time constraints. They should also have access to expensive and powerful deinterlacers.
#If it is done at the time of broadcasting, the quality of the deinterlace can vary. It should be organised by professionals, who have a reasonable budget and powerful processors. On the other hand, it needs to be done in real time, so the effort that the deinterlacer can put in is limited by time.
#If it is copied onto a computer and processed there, the quality can also vary immensely, yet (theoretically) a high quality level should be possible, because there are no restrictions on time and there are some very good, free, deinterlacers. However, many people who do this do not know much about deinterlacing, and when making a choice about which deinterlacer and settings to use, will make a random decision. This often causes poor results for video based content as many people are unaware that video has double the temporal resolution of film. To top it off, many codecs/players do not allow selecting deinterlacing method, but some do.<ref>{{cite web|url=http://www.elurauser.com/articles/watching_interlaced_video.jsp|title=Watching interlaced video on a computer}}</ref>
#If done by an embedded electronic device, the quality varies depending on the overall quality of the device. High-quality electronic devices also have high-quality deinterlacers.
==See also==
*[[Interlace]]
*[[HDTV Blur]]
*[[Refresh Rate]]
*[[HDTV]]
== References ==
{{reflist}}
== External links ==
* [http://www.algolith.com/en/products/intellectual-property/de-interlacing/index.html Algolith Deinterlacing Technology]
* [http://www.theprojectorpros.com/learn.php?s=learn&p=theater_pulldown_deinterlacing 3:2 Pulldown and Deinterlacing] (theprojectorpros.com)
* [http://planetmath.org/encyclopedia/WideraInterlaceAndDeinterlace.html Stream Interlace and Deinterlace] (planetmath.org)
* [http://www.ebu.ch/en/technical/trev/trev_301-editorial.html 'Format wars'] – EBU document (with nice animation demonstrating interlace too)
* [http://www.hometheaterhifi.com/volume_7_4/dvd-benchmark-part-5-progressive-10-2000.html DVD progressive scanning] – Deinterlacing and film-to-video conversion with respect to DVDs
* [http://scanline.ca/deinterlacing/ Frequently asked questions about deinterlacing]
* [http://www.100fps.com/ 100fps] Facts, solutions and examples of Deinterlacing.
{{VideoProcessing}}
[[Category:Video processing]]
[[de:Deinterlacing]]
[[fr:Désentrelacement]]
[[ko:디인터레이스]]
[[ru:Деинтерлейсинг]]
[[zh:去交錯]]