Pro Processing for Images and Computer Vision with OpenCV : Solutions for Media Artists and Creative Coders

Apply the Processing language to tasks involved in computer vision--tasks such as edge and corner detection, recognition of motion between frames in a video, recognition of objects, matching of feature points and shapes in different frames for tracking purposes, and more. You will manipulate images through creative effects, geometric transformation, blending of multiple images, and so forth. Examples are provided. __Pro Processing for Images and Computer Vision with OpenCV__ is a step-by-step training tool that guides you through a series of worked examples in linear order. Each chapter begins with a basic demonstration, including the code to recreate it on your own system. Then comes a creative challenge by which to engage and develop mastery of the chapter's topic. The book also includes hints and tips relating to visual arts, interaction design, and industrial best practices.This book is intended for any developer of artistic and otherwise visual applications, such as in augmented reality and digital effects, with a need to manipulate images, and to recognize and manipulate objects within those images. The book is specifically targeted at those making use of the Processing language that is common in artistic fields, and to Java programmers because of Processing's easy integration into the Java programming environment. **What You'll Learn**Make use of OpenCV, the open source library for computer vision in the Processing environment Capture live video streams and examine them frame-by-frame for objects in motion Recognize shapes and objects through techniques of detecting lines, edges, corners, and more Transform images by scaling, translating, rotating, and additionally through various distortion effects Apply techniques such as background subtraction to isolate motion of objects in live video streams Detect and track human faces and other objects by matching feature points in different images or video frames **Who This Book Is For**Media artists, designers, and creative coders Contents at a Glance 4 Contents 5 About the Author 10 About the Technical Reviewer 11 Acknowledgments 12 Chapter 1: Getting Started with Processing and OpenCV 13 Processing 13 OpenCV 14 Processing Installation 15 Install Processing 15 Run Processing 17 OpenCV Installation 19 macOS 21 Windows 29 Linux 40 Test Run 46 Hello World 46 Matrix Example 48 Conclusion 49 Chapter 2: Image Sources and Representations 50 Digital Image Fundamentals 50 Images in Processing 51 Import an External Image 51 Create an Image in Processing 54 Graphics and Images 55 BufferedImage in Processing 58 Moving Images in Processing 59 Digital Movies 60 Live Video Captures 62 Matrices and Images in OpenCV 64 Image Conversion Between Processing and OpenCV 69 From Processing to OpenCV 71 From OpenCV to Processing 73 Conclusion 81 Chapter 3: Pixel-Based Manipulations 82 Visual Properties 82 Position 83 Size 83 Shape 84 Orientation 84 Color 84 Value 85 Pixel Color Manipulation 85 Color Change with Pixel Position 86 Color Change with Pixel Distance 90 Color Change with Trigonometric Functions 93 Randomness 97 Drawing with Existing Images 101 Blending Multiple Images 108 Conclusion 111 Chapter 4: Geometry and Transformation 112 Image Transformation 112 Image Orientation 115 Image Resizing 119 Affine Transform 121 Perspective Transform 126 Linear vs. Polar Coordinates 129 Three-Dimensional Space 131 General Pixel Mapping 141 Conclusion 143 Chapter 5: Identification of Structure 144 Image Preparation 144 Conversion to Grayscale 144 Conversion to a Black-and-White Image 146 Morphological Operations 148 Blur Operations 151 Edge Detection 155 Line Detection 157 Circle Detection 163 Contours Processing 166 Finding the Contours 167 Bounding Box 172 Minimum Area Rectangle 173 Convex Hull 175 Polygon Approximation 176 Testing a Point in Contour 178 Checking Intersection 180 Shape Detection 183 Conclusion 186 Chapter 6: Understanding Motion 187 Effects with Moving Images 187 Mosaic Effect 188 Slit-Scan Effect 189 Scrolling Effect 190 Visualization in 3D 193 Frame Differencing 196 Background Removal 201 Optical Flow 206 Motion History 215 Conclusion 228 Chapter 7: Feature Detection and Matching 229 Corner Detection 229 Sparse Optical Flow 232 Identify the Feature Points 232 Improve the Accuracy 234 Calculate the Optical Flow 236 Visualize the Flow Information 239 Feature Detection 245 Feature Matching 250 Face Detection 265 People Detection 270 Conclusion 271 Chapter 8: Application Deployment and Conclusion 272 Developing Libraries in Processing 272 Install the Eclipse Software 273 Prepare the OpenCV and Processing Libraries 274 Build the CVImage Library 276 Exporting Applications from Processing 287 Using System Commands in Processing 289 Optimizing Tracking with the Kalman Filter 293 Other OpenCV Modules 296 Conclusion 296 Index 297 Apply the Processing language to tasks involved in computer vision--tasks such as edge and corner detection, recognition of motion between frames in a video, recognition of objects, matching of feature points and shapes in different frames for tracking purposes, and more. You will manipulate images through creative effects, geometric transformation, blending of multiple images, and so forth. Examples are provided. Pro Processing for Images and Computer Vision with OpenCV is a step-by-step training tool that guides you through a series of worked examples in linear order. Each chapter begins with a basic demonstration, including the code to recreate it on your own system. Then comes a creative challenge by which to engage and develop mastery of the chapter’s topic. The book also includes hints and tips relating to visual arts, interaction design, and industrial best practices. This book is intended for any developer of artistic and otherwise visual applications, such as in augmented reality and digital effects, with a need to manipulate images, and to recognize and manipulate objects within those images. The book is specifically targeted at those making use of the Processing language that is common in artistic fields, and to Java programmers because of Processing’s easy integration into the Java programming environment. What You'll Learn Make use of OpenCV, the open source library for computer vision in the Processing environment Capture live video streams and examine them frame-by-frame for objects in motion Recognize shapes and objects through techniques of detecting lines, edges, corners, and more Transform images by scaling, translating, rotating, and additionally through various distortion effects Apply techniques such as background subtraction to isolate motion of objects in live video streams Detect and track human faces and other objects by matching feature points in different images or video frames Who This Book Is For Media artists, designers, and creative coders Apply the Processing language to tasks involved in computer vision--tasks such as edge and corner detection, recognition of motion between frames in a video, recognition of objects, matching of feature points and shapes in different frames for tracking purposes, and more. You will manipulate images through creative effects, geometric transformation, blending of multiple images, and so forth. Examples are provided. Pro Processing for Images and Computer Vision with OpenCV is a step-by-step training tool that guides you through a series of worked examples in linear order. Each chapter begins with a basic demonstration, including the code to recreate it on your own system. Then comes a creative challenge by which to engage and develop mastery of the chapter’s topic. The book also includes hints and tips relating to visual arts, interaction design, and industrial best practices. This book is intended for any developer of artistic and otherwise visual applications, such as in augmented reality and digital effects, with a need to manipulate images, and to recognize and manipulate objects within those images. The book is specifically targeted at those making use of the Processing language that is common in artistic fields, and to Java programmers because of Processing’s easy integration into the Java programming environment--Publisher's website