logo

English

How video compression works 3/5 - Color and motion

by digipine posted Nov 02, 2017
?

Shortcut

PrevPrev Article

NextNext Article

Larger Font Smaller Font Up Down Go comment Print Attachment
?

Shortcut

PrevPrev Article

NextNext Article

Larger Font Smaller Font Up Down Go comment Print Attachment

Color and motion

Working with color
Color images are typically represented using several "color planes." For example, an RGB color image contains a red color plane, a green color plane, and a blue color plane. When overlaid and mixed, the three planes make up the full color image. To compress a color image, the still-image compression techniques described earlier can be applied to each color plane in turn.
Imaging and video applications often use a color scheme in which the color planes do not correspond to specific colors. Instead, one color plane contains luminance information (the overall brightness of each pixel in the color image) and two more color planes contain color (chrominance) information that when combined with luminance can be used to derive the specific levels of the red, green, and blue components of each image pixel.

Such a color scheme is convenient because the human eye is more sensitive to luminance than to color, so the chrominance planes can often be stored and/or encoded at a lower image resolution than the luminance information. Specifically, video compression algorithms typically encode the chrominance planes with half the horizontal resolution and half the vertical resolution of the luminance plane. Thus, for every 16-pixel by 16-pixel region in the luminance plane, each chrominance plane contains one 8-pixel by 8-pixel block. In typical video compression algorithms, a "macro block" is a 16x16 region in the video frame that contains four 8x8 luminance blocks and the two corresponding 8x8 chrominance blocks.

Adding Motion to the Mix
Video compression algorithms share many of the compression techniques used in still-image compression. A key difference, however, is that video compression can take advantage of the similarities between successive video frames to achieve even better compression ratios. Using the techniques described earlier, still-image compression algorithms such as JPEG can achieve good image quality at a compression ratio of about 10:1. The most advanced still-image codecs may achieve good image quality at compression ratios as high as 30:1. In contrast, video compression algorithms can provide good video quality at ratios of up to 200:1. This increased efficiency is accomplished with the addition of video-specific compression techniques such as motion estimation and motion compensation.

For each macro block in the current frame, motion estimation attempts to find a region in a previously encoded frame (called a "reference frame") that is a close match. The spatial offset between the current block and selected block from the reference frame is called a "motion vector," as shown in Figure 4. The encoder computes the pixel-by-pixel difference between the selected block from the reference frame and the current block and transmits this "prediction error" along with the motion vector. Most video compression standards allow motion-based prediction to be bypassed if the encoder fails to find a good match for the macro block. In this case, the macro block itself is encoded instead of the prediction error.

4450c0883ad219313b3b1e4ed811c8c2.gif

 



Note that the reference frame isn't always the previously displayed frame in the sequence of video frames. Video compression algorithms commonly encode frames in a different order from the order in which they are displayed. The encoder may skip several frames ahead and encode a future video frame, then skip backward and encode the next frame in the display sequence. This is done so that motion estimation can be performed backward in time, using the encoded future frame as a reference frame. Video compression algorithms also commonly allow the use of two reference frames—one previously displayed frame and one previously encoded future frame.

Video compression algorithms periodically encode one video frame using still-image coding techniques only, without relying on previously encoded frames. These frames are called "intra frames" or "I-frames." If a frame in the compressed bit stream is corrupted by errors, the video decoder can "restart" at the next I-frame, which doesn't require a reference frame for reconstruction.

As shown in Figure 5, frames that are encoded using only a previously displayed reference frame are called "P-frames," and frames that are encoded using both future and previously displayed reference frames are called "B-frames." A typical sequence of frames is illustrated in Figure 5[d]. 

c308bb11080215bacf0105c88c8562c9.gif

 

  

One factor that complicates motion estimation is that the displacement of an object from the reference frame to the current frame may be a non-integer number of pixels. For example, suppose that an object has moved 22.5 pixels to the right and 17.25 pixels upward. To handle such situations, modern video compression standards allow motion vectors to have non-integer values; motion vector resolutions of one-half or one-quarter of a pixel are common. To support searching for block matches at partial-pixel displacements, the encoder must use interpolation to estimate the reference frame's pixel values at non-integer locations. 

TAG •

List of Articles
No. Subject Author Date Views
67 TI사의 DSP 종류 digipine 2017.11.02 766
66 How video compression works 1/5 file digipine 2017.11.02 1596
65 How video compression works 2/5 - Quantization, coding, and prediction file digipine 2017.11.02 5829
» How video compression works 3/5 - Color and motion file digipine 2017.11.02 1595
63 How video compression works 4/5 - Encoder secrets and motion compensation digipine 2017.11.02 340
62 How video compression works 5/5 - Deblocking, deringing, and color space conversion file digipine 2017.11.02 23695
61 임베디드 무선랜 개발 iwconfig wpa_supplicant digipine 2017.11.02 775
60 Linux Wi-Fi Setup Tools and Commands digipine 2017.11.02 15447
59 서보 모터 (Servo-motor) 의 내부 구조와 회전 원리 file digipine 2017.11.02 807
58 서보모터의 기초와 제어 file digipine 2017.11.02 422
57 차세대 비휘발성 메모리 기술동향 file digipine 2017.11.02 247
56 반도체 장비/공정 기술 용어집 digipine 2017.11.02 1888
55 반도체 전공정 후공정 설명 digipine 2017.11.02 4304
54 SECS 프로토콜 개요 digipine 2017.11.03 893
53 RFID와 USN 에 대해서 digipine 2017.11.03 226
52 DaVinci 에 대한 소개글 digipine 2017.11.03 112
51 L4 장비의 핵심 로드 밸런싱(Load Balancing) digipine 2017.11.03 946
50 네트웍 용어중 bps, cps, BPS, pps 의 차이점 digipine 2017.11.03 1577
49 UC 환경을 위한 종합 네트워크 FMC digipine 2017.11.03 202
48 CISCO Router 설정 팁 - QOS 1 digipine 2017.11.03 1816
Board Pagination Prev 1 2 3 ... 4 Next
/ 4