Advanced Video Coding and Systems

This book presents an overview of the state of the art in video coding technology. Specifically, it introduces the tools of the AVS2 standard, describing how AVS2 can help to achieve a significant improvement in coding efficiency for future video networks and applications by incorporating smarter coding tools such as scene video coding. Features: introduces the basic concepts in video coding, and presents a short history of video coding technology and standards; reviews the coding framework, main coding tools, and syntax structure of AVS2; describes the key technologies used in the AVS2 standard, including prediction coding, transform coding, entropy coding, and loop-filters; examines efficient tools for scene video coding and surveillance video, and the details of a promising intelligent video coding system; discusses optimization technologies in video coding systems; provides a review of image, video, and 3D content quality assessment algorithms; surveys the hot research topics in video compression. Preface 5 Acknowledgments 7 Contents 8 1 Introduction 13 1.1 Introduction 13 1.2 History of Video Coding Technology 14 1.3 History of Video Coding Standard 18 1.3.1 ITU-T VCEG 19 1.3.2 ISO/IEC MPEG 20 1.3.3 Joint Activities Between MPEG and VCEG 21 1.3.4 AVS 21 1.3.5 IEEE P1857 23 1.3.6 SEMPT and VC-1 23 1.3.7 Google VPx [Wikimedia.org] 24 1.3.8 Timeline of Video Coding Standards 25 1.4 About This Book 25 References 27 2 Video Coding Basic Principle 29 2.1 Color Spaces 29 2.1.1 Color Perception 29 2.1.2 RGB, XYZ, and YUV Color Spaces 31 2.2 Video Formats 34 2.2.1 Analog Video and Digital Video 34 2.2.2 YCbCr Sampling Formats 37 2.3 Video Coding Tools 39 2.3.1 Prediction Coding 39 2.3.2 Transform Coding 41 2.3.3 Entropy Coding 42 2.3.4 In-Loop Filtering 42 2.4 Quality Measurement 43 2.5 Summary 44 References 44 3 An Overview of AVS2 Standard 47 3.1 Introduction 47 3.2 Coding Tools 49 3.2.1 Intra Prediction 49 3.2.2 Inter Prediction 50 3.2.3 Motion Vector Prediction and Coding 52 3.2.4 Transform 53 3.2.5 Entropy Coding 53 3.2.6 In-Loop Filtering 55 3.3 Scene Video Coding 55 3.3.1 Sequence and Picture 57 3.3.2 Slice and Coding Unit 60 3.4 Summary 60 References 61 4 Prediction Coding 62 4.1 Related Works 62 4.1.1 Theoretical Basis for Prediction Coding 63 4.1.2 Optimal Predictors 65 4.1.3 Gain of the Prediction Coding 66 4.2 Intraprediction 69 4.2.1 Luma Prediction 69 4.2.2 Chroma Prediction 74 4.2.3 Prediction Mode Coding 77 4.3 Interprediction 78 4.3.1 Prediction Partition 78 4.3.2 Motion Vector Prediction and Motion Vector Coding 78 4.3.3 Multiple Hypothesis Prediction 80 4.3.4 Sub Pixel Interpolation 82 4.4 Reference Picture Management 85 4.5 Summary 88 References 88 5 Transform and Quantization 90 5.1 Related Works 90 5.1.1 Transform Coding 90 5.1.2 Transform and Quantization 92 5.1.3 Recent Development of Transform Design 93 5.2 Transform and Quantization in AVS1 96 5.3 Transform and Quantization in AVS2 97 5.3.1 Square and Non-square Transform 98 5.3.2 Secondary Transform 101 5.3.3 Quantization in AVS2 102 5.4 Summary 103 References 103 6 Entropy Coding 105 6.1 Concepts of Entropy Coding 105 6.2 Context-Based 2D Variable Length Coding 106 6.2.1 Overview of C2DVLC 107 6.2.2 Context Modeling in C2DVLC 108 6.2.3 Exponential-Golomb Codes 110 6.3 Context-Based Binary Arithmetic Coding 110 6.3.1 Overview of CBAC 110 6.3.2 Symbol Binarization and Binary Arithmetic Coder 111 6.3.3 CBAC in AVS1 114 6.3.4 CBAC in AVS2 117 6.4 Summary 122 References 122 7 In-Loop Filter 124 7.1 Concepts of Compression Artifacts 124 7.2 Deblocking Filter 126 7.2.1 Overview of Deblocking Filter 126 7.2.2 Deblocking Filter in AVS2 127 7.3 Sample Adaptive Offset 131 7.3.1 Overview of Sample Adaptive Offset 131 7.3.2 Sample Processing 132 7.4 Adaptive Loop Filter 135 7.4.1 Filter Shape and Coefficient Derivation 137 7.4.2 Region-Based Adaptive Merge 139 7.4.3 Virtual Boundary Processing 140 7.5 Summary 142 References 142 8 Scene Video Coding 144 8.1 The Redundancy Features of Surveillance Video 144 8.2 Model-Based Coding 146 8.3 Background Picture Model-Based Video Coding 151 8.3.1 General Background Picture Modeling 151 8.3.2 Background Models for Video Coding 152 8.3.3 Low Cost Background Model for Video Coding 156 8.4 Surveillance Coding in AVS 160 8.4.1 Video Codec Architecture 160 8.4.2 Modeled Background Picture-Based Coding 162 8.4.3 Performance of AVS/AVS2 Surveillance Coding 164 References 166 9 Video Coding Optimization and Application System 170 9.1 Video Coding Optimization 170 9.1.1 Low-Complexity Intra Optimization 170 9.1.2 Hierarchical Coding Structure 172 9.1.3 Adaptive Larangian Multiplier Selection 176 9.1.4 Perceptual Coding Based on Divisive Normalization 178 9.2 Video Coding Application System 179 9.2.1 File Format for IEEE 1857 Video and IEEE 1857.2 Audio 181 9.2.2 RTP Format for IEEE 1857 Video and IEEE 1857.2 Audio 183 9.2.3 Summary 185 References 185 10 Intelligent Video System 186 10.1 Introduction 186 10.2 Intelligent Video Analysis System 188 10.2.1 Framework of Intelligent Video Analysis System 188 10.2.2 Features in Video Analysis System 190 10.3 Intelligent Video Coding System 191 10.3.1 Motivation of Intelligent Video Coding System 191 10.3.2 An Example Solution of Intelligent Video Coding System---IEEE 1857 193 10.4 Summary 198 References 198 11 Image and Video Quality Assessment 199 11.1 Image Quality Assessment 199 11.1.1 Image Quality Assessment Databases 200 11.1.2 Full Reference Image Quality Assessment 201 11.1.3 Reduced Reference Image Quality Assessment 205 11.1.4 No Reference Image Quality Assessment 206 11.2 Video Quality Assessment 207 11.2.1 Video Quality Assessment Database 207 11.2.2 Video Quality Assessment 208 11.3 3D Quality Assessment 214 11.4 Summary 215 References 215 12 Hot Research Topics in Video Coding and Systems 218 12.1 Introduction 218 12.2 Perceptual Coding 218 12.2.1 Quality Assessment 219 12.2.2 Perceptual Video Coding 223 12.2.3 Primitive-Based Sparse Coding 227 12.3 Internet Media-Oriented Compression 228 12.3.1 Cloud-Based Compression 228 12.3.2 Image and Video Set Compression 230 12.3.3 Visual Object-Based Coding 231 12.4 Future Challenges 232 12.4.1 Quality of Service-Based Video Compression 232 12.4.2 Video Compression in Cloud 233 12.4.3 High Definition Video Coding 233 12.4.4 Screen Content Coding 234 12.4.5 Compact Representation of Feature Descriptors 234 12.5 Summary 235 References 235 Glossary 239 Index 242 This Comprehensive And Accessible Text/reference Presents An Overview Of The State Of The Art In Video Coding Technology. Specifically, The Book Introduces The Tools Of The Avs2 Standard, Describing How Avs2 Can Help To Achieve A Significant Improvement In Coding Efficiency For Future Video Networks And Applications By Incorporating Smarter Coding Tools Such As Scene Video Coding. Topics And Features: Introduces The Basic Concepts In Video Coding, And Presents A Short History Of Video Coding Technology And Standards Reviews The Coding Framework, Main Coding Tools, And Syntax Structure Of Avs2 Describes The Key Technologies Used In The Avs2 Standard, Including Prediction Coding, Transform Coding, Entropy Coding, And Loop-filters Examines Efficient Tools For Scene Video Coding And Surveillance Video, And The Details Of A Promising Intelligent Video Coding System Discusses Optimization Technologies In Video Coding Systems For Reducing Complexity, Improving Performance, And Organizing Compressed Streams Provides A Review Of Image, Video, And 3d Content Quality Assessment Algorithms Surveys The Hot Research Topics In Video Compression, Including Perceptual Video Compression, And Internet Media-oriented Compression This Invaluable Work Provides Practical Guidance For Engineers On Implementing The Avs2 Standard, And Will Also Prove Helpful To Students Wishing To Better Understand The Relevant Techniques. Additionally, The Book Offers Suggestions For Researchers Interested In Developing Smart Video Coding And Processing Frameworks For Target Problems. Introduction -- Video Coding Basic Principle -- An Overview Of Avs2 Standard -- Prediction Coding -- Transform And Quantization -- Entropy Coding -- In-loop Filter -- Scene Video Coding -- Video Coding Optimization And Application System -- Intelligent Video System -- Image And Video Quality Assessment -- Hot Research Topics In Video Coding And Systems. By Wen Gao, Siwei Ma. "This comprehensive and accessible text/reference presents an overview of the state of the art in video coding technology. Specifically, the book introduces the tools of the AVS2 standard, describing how AVS2 can help to achieve a significant improvement in coding efficiency for future video networks and applications by incorporating smarter coding tools such as scene video coding. Topics and features: Introduces the basic concepts in video coding, and presents a short history of video coding technology and standards; Reviews the coding framework, main coding tools, and syntax structure of AVS2; Describes the key technologies used in the AVS2 standard, including prediction coding, transform coding, entropy coding, and loop-filters; Examines efficient tools for scene video coding and surveillance video, and the details of a promising intelligent video coding system; Discusses optimization technologies in video coding systems for reducing complexity, improving performance, and organizing compressed streams; Provides a review of image, video, and 3D content quality assessment algorithms; Surveys the hot research topics in video compression, including perceptual video compression, and Internet media-oriented compression. This invaluable work provides practical guidance for engineers on implementing the AVS2 standard, and will also prove helpful to students wishing to better understand the relevant techniques. Additionally, the book offers suggestions for researchers interested in developing smart video coding and processing frameworks for target problems"--Jacket