Inside The Python Virtual Machine

Inside the Python Virtual Machine provides a guided tour under the covers of the Python interpreter for the curious pythonista. It attempts to show the user what happens from the moment the user executes a piece of Python code to the point when the interpreter returns the result of executing the piece of code.This book will provide the readers with an understanding of the various processes that go into compiling and executing a python program removing most of the mystery surrounding how the python interpreter executes source code. The books starts out with a description of the compilation phase with emphasis on the less generic parts of the compilation phase. It then proceeds to discuss python objects and their implementation in CPython. This is followed by a discussion of various objects types that are central to the interpreter such as frame objects and code objects. The process of evaluating code objects by the interpreter loop is also discussed as well as how to extend the Python programming language with your own constructs. Table of Contents Introduction The View From 30,000ft Compiling Python Source Code From Source To Parse Tree Python tokens From Parse Tree To Abstract Syntax Tree Building The Symbol Table From AST To Code Objects Python Objects PyObject Under the cover of Types Type Object Case Studies Minting type instances Objects and their attributes Method Resolution Order (MRO) Code Objects Exploring code objects Code Objects within other code objects Code Objects in the VM Frames Objects Allocating Frame Objects Interpreter and Thread States The Interpreter state The Thread state Intermezzo: The abstract.c Module The evaluation loop, ceval.c Putting names in place The parts of the machine The Evaluation loop A sampling of opcodes The Block Stack A Short Note on Exception Handling From Class code to bytecode Generators: Behind the scenes. The Generator object Running a generator