Practical Amazon EC2, SQS, Kinesis, and S3 : A Hands-On Approach to AWS

Provide solutions to all your Amazon EC2, SQS, Kinesis, and S3 problems, including implementation using the AWS Management Console, AWS CLI, and AWS SDK (Java). You'll find recipes on implementation and configuration of Amazon EC2, SQS, Kinesis, and S3 along with the code snippets and AWS CLI commands. __Practical Amazon EC2, SQS, Kinesis, and S3__ uses focused examples that include only the details you need to get things done. You'll see production use cases of Amazon EC2, SQS, Kinesis, and S3 and how to implement cloud watch in projects for these services. Learn how to raise an alarm on Amazon EC2, SQS, Kinesis, and S3 as part of a continuous monitoring system designed to increase performance and avoid side effects in your services. **What You'll Learn** * Manage Amazon EC2, SQS, Kinesis, and S3 using the AWS Management Console * Use the AWS CLI * Employ the AWS Java SDK * Configure alarms on Amazon EC2, SQS, Kinesis, and S3 **Who This Book Is For** Software developers and architects, system engineers, and project managers Contents at a Glance 5 Contents 6 About the Author 14 About the Technical Reviewer 15 Acknowledgments 16 Introduction 17 Chapter 1: Getting Started with AWS 19 What Is Amazon Web Services? 19 Sign Up for Amazon Web Services 20 Create User and Groups 29 Create Key Pairs 35 Install AWS CLI 37 Download SSH Client 39 Setup Eclipse 39 Summary 40 Chapter 2: Hands-on Elastic Compute Cloud 41 Introduction to EC2 41 Features of EC2 42 Operating System 42 Elasticity 42 Fault Tolerance and Latency 42 Pricing 42 Security 43 Service Commitment 43 EC2 Instance Types 43 Managing EC2 Using Management Console 43 1. Create a Security Group 45 2. Create a Key Pair 47 3. Create an EC2 Instance 48 4. Verify by Connecting to EC2 Instance 53 5. Connect to EC2 Instance 54 Managing EC2 Using AWS CLI 59 Security Group 59 1. Create a Security Group 59 2. Attach an Inbound Rule to Security Group 59 3. List the Security Group 60 4. Delete Security Group 61 Key Pair 62 1. Create a Key Pair 62 2. List a Key Pair 62 3. Delete a Key Pair 63 4. Import a Key Pair 64 EC2 Instance 64 1. Describe Images 65 2. Select an Instance Type 65 3. Launch EC2 66 4. List EC2 Instances 68 5. Get Instance Status 68 6. Assign Instance Tags 69 7. Start-Stop-Terminate Instance 71 Managing EC2 Using AWS SDK (Java) 73 Create AWSCredentials Object 73 1. Default Credential Provider 74 2. Specify Credential Provider or Provider Chain 74 3. Provide Access Key and Secret Key Explicitly 75 Security Groups 75 1. Create a Security Group 75 2. Attach an Inbound Rule to Security Group 76 3. List a Security Group 77 4. Delete a Security Group 78 Key Pair 80 1. Create a Key Pair 80 2. List a Key Pair 81 3. Delete a Key Pair 82 4. Import a Key Pair 83 EC2 Instance 84 1. Get the AMI ID 84 2. Select an Instance Type 85 3. Launch EC2 86 4. List EC2 Instances 90 5. Get an Instance Status 93 6. Instance Tags 95 7. Start-Stop-Terminate Instance 98 Monitoring Using CloudWatch 101 Create an Alarm Using the EC2 Management Console 101 Create an Alarm Using the CloudWatch Management Console 103 Summary 106 Chapter 3: Hands-on Simple Queue Service (SQS) 107 What Is Messaging Queuing Service? 107 Introduction of AWS SQS 108 1. Standard Queue 108 2. FIFO Queue 109 Features of SQS 109 Using AWS Management Console 109 1. Create Queue 110 2. Queue Listing 112 3. Configure Queue Permission 113 4. Configure Dead Letter Queue 116 5. Send Message 120 6. Receive Message 123 7. Delete Message 127 8. Purge Queue 128 9. Delete Queue 129 Using AWS CLI 129 create-queue 130 get-queue-url 131 add-permission 131 remove-permission 132 set-queue-attributes 133 get-queue-attributes 134 list-queues 134 list-dead-letter-source-queues 135 send-message 135 send-message-batch 137 receive-message 138 delete-message 139 delete-message-batch 139 change-message-visibility 140 change-message-visibility-batch 141 purge-queue 142 delete-queue 142 Using AWS SDK—Java 143 Create Queue 143 Create Queue with Attributes 144 Get Queue URL 145 Add Permissions 146 Remove Permissions 147 Set Queue Attributes 148 Get Queue Attributes 150 List Queues 151 List Dead Letter Source Queues 152 Send Message 152 Send Message with Add Message Attributes 153 Send Message with Set Message Attributes 154 Send Message with Timer 156 Send Message Batch 156 Receive Message with Acknowledgement 158 Receive Message with Change Visibility 160 Receive Message with Change Visibility Batch 162 Purge Queue 164 Delete Queue 164 Monitor Using CloudWatch 165 Summary 173 Chapter 4: Hands-on Kinesis 174 Introduction to AWS Kinesis Stream and Firehose 174 Features 175 Real-Time Data Streaming and Processing 175 Durability and Elasticity 175 Managed Service 175 Concurrent Consumers 175 Using AWS Management Console 175 Create Streams 175 Edit Shards 179 Configure Data Retention Period 181 Configure Shard Level Metrics 182 Configure Tags 183 Delete Stream 185 Using AWS CLI 186 create-stream 186 describe-stream 186 list-streams 189 increase-stream-retention-period 190 decrease-stream-retention-period 191 enable-enhanced-monitoring 192 disable-enhanced-monitoring 193 put-record 194 put-records 195 get-shard-iterator 196 get-records 197 merge-shards 198 split-shard 199 add-tags-to-stream 201 list-tags-for-stream 202 remove-tags-from-stream 203 delete-stream 203 Using AWS SDK—Java 204 Create AmazonKinesisClient 204 Create Stream 205 Describe Stream 205 List Stream 209 Increase Stream Retention Period 211 Decrease Stream Retention Period 212 Enable Enhanced Monitoring 214 Disable Enhanced Monitoring 214 Put Record 215 Put Records 217 Get Records 218 Merge Shards 221 Split Shard 224 Add Tags to Stream 226 List Tags for Stream 227 Remove Tags from Stream 228 Delete Stream 229 Monitor Using CloudWatch 230 Summary 238 Chapter 5: Hands-on Simple Storage Service (S3) 239 Introduction to AWS S3 239 Features 240 Scalability 240 Availability 240 Cost Efficiency 240 Static Web Hosting 241 Using AWS Management Console 241 Create Bucket 241 Bucket Permissions 244 Static Web Site Hosting 247 Logging 249 Events 249 Versioning 251 Life Cycle 252 Cross-Region Replication 254 Tags 256 Requester Pays 257 Transfer Acceleration 258 Empty Bucket 258 Delete Bucket 259 Create Folder 260 Public Folder 262 Deleting Folders 262 Uploading Objects 263 Deleting Objects 267 Using AWS CLI 267 Create Bucket 268 Bucket Permissions 271 Static Website Hosting 273 Logging 275 Events 277 Versioning 279 Life Cycle 280 Cross-Region Replication 283 Tags 285 Requester Pays 286 Transferring Acceleration 286 Emptying Buckets 287 Deleting Buckets 287 Creating Folders 288 Deleting Folders 289 Uploading Objects 289 Deleting Objects 291 Using AWS SDK - Java 291 Creating Amazon S3 Client 291 Creating Buckets 291 Listing Buckets 293 Configuring Bucket ACL 294 Bucket Web Site Configuration 295 Bucket Logging Configuration 297 Bucket Event Notification Configuration 297 Bucket Versioning Configuration 301 Bucket Life Cycle Configuration 303 Bucket Replication Configuration 307 Bucket Tagging Configuration 309 Configuring Requester Pay 310 Bucket Transfer Accelerate Configuration 311 Creating Folders 312 Uploading Objects 313 Listing Objects 314 Deleting Objects 315 Emptying Buckets 315 Deleting Buckets 315 Monitoring Using CloudWatch 316 Summary 323 Index 324 Front Matter....Pages i-xxii Getting Started with AWS....Pages 1-22 Hands-on Elastic Compute Cloud....Pages 23-88 Hands-on Simple Queue Service (SQS)....Pages 89-155 Hands-on Kinesis....Pages 157-221 Hands-on Simple Storage Service (S3)....Pages 223-307 Back Matter....Pages 309-312