Elasticsearch 7. 0 Cookbook : Over 100 Recipes for Fast, Scalable, and Reliable Search for Your Enterprise, 4th Edition

Search, analyze, and manage data effectively with Elasticsearch 7 Key Features Extend Elasticsearch functionalities and learn how to deploy on Elastic Cloud Deploy and manage simple Elasticsearch nodes as well as complex cluster topologies Explore the capabilities of Elasticsearch 7 with easy-to-follow recipes Book Description Elasticsearch is a Lucene-based distributed search server that allows users to index and search unstructured content with petabytes of data. With this book, you'll be guided through comprehensive recipes on what's new in Elasticsearch 7, and see how to create and run complex queries and analytics. Packed with recipes on performing index mapping, aggregation, and scripting using Elasticsearch, this fourth edition of Elasticsearch Cookbook will get you acquainted with numerous solutions and quick techniques for performing both every day and uncommon tasks such as deploying Elasticsearch nodes, integrating other tools to Elasticsearch, and creating different visualizations. You will install Kibana to monitor a cluster and also extend it using a variety of plugins. Finally, you will integrate your Java, Scala, Python, and big data applications such as Apache Spark and Pig with Elasticsearch, and create efficient data applications powered by enhanced functionalities and custom plugins. By the end of this book, you will have gained in-depth knowledge of implementing Elasticsearch architecture, and you'll be able to manage, search, and store data efficiently and effectively using Elasticsearch. What you will learn Create an efficient architecture with Elasticsearch Optimize search results by executing analytics aggregations Build complex queries by managing indices and documents Monitor the performance of your cluster and nodes Design advanced mapping to take full control of index steps Integrate Elasticsearch in Java, Scala, Python, and big data applications Install Kibana to monitor clusters and extend it for plugins Who this book is for If you’re a software engineer, big data infrastructure engineer, or Elasticsearch developer, you'll find this book useful. This Elasticsearch book will also help data professionals working in the e-commerce and FMCG industry who use Elastic for metrics evaluation and search analytics to get deeper insights for better business decisions. Prior experience with Elasticsearch will help you get the most out of this book. Cover Title Page Copyright and Credits About Packt Contributors Table of Contents Preface Chapter 1: Getting Started Technical requirements Downloading and installing Elasticsearch Getting ready How to do it... How it works... There's more... See also Setting up networking Getting ready How to do it... How it works... See also Setting up a node Getting ready How to do it... How it works... See also Setting up Linux systems Getting ready How to do it... How it works... Setting up different node types Getting ready How to do it... How it works... There's more... Setting up a coordinator node Getting ready How to do it... How it works... Setting up an ingestion node Getting ready How to do it... How it works... There's more... Installing plugins in Elasticsearch Getting ready How to do it... How it works... There's more... See also Removing a plugin Getting ready How to do it... How it works... Changing logging settings Getting ready How to do it... How it works... Setting up a node via Docker Getting ready How to do it... How it works... There's more... See also Deploying on Elasticsearch Cloud Enterprise Getting ready How to do it... How it works... See also Chapter 2: Managing Mapping Using explicit mapping creation Getting ready How to do it... How it works... There's more... See also Mapping base types Getting ready How to do it... How it works... There's more... See also Mapping arrays Getting ready How to do it... How it works... Mapping an object Getting ready How to do it... How it works... See also Mapping a document Getting ready How to do it... How it works... See also Using dynamic templates in document mapping Getting ready How to do it... How it works... There's more... See also Managing nested objects Getting ready How to do it... How it works... There's more... See also Managing a child document with a join field Getting ready How to do it... How it works... There's more... See also Adding a field with multiple mappings Getting ready How to do it... How it works... There's more... See also Mapping a GeoPoint field Getting ready How to do it... How it works... There's more... Mapping a GeoShape field Getting ready How to do it... How it works... See also Mapping an IP field Getting ready How to do it... How it works... Mapping an alias field Getting ready How to do it... How it works... Mapping a Percolator field Getting ready How to do it... How it works... Mapping feature and feature vector fields Getting ready How to do it... How it works... Adding metadata to a mapping Getting ready How to do it... How it works... Specifying different analyzers Getting ready How to do it... How it works... See also Mapping a completion field Getting ready How to do it... How it works... See also Chapter 3: Basic Operations Creating an index Getting ready How to do it... How it works... There's more... See also Deleting an index Getting ready How to do it... How it works... See also Opening or closing an index Getting ready How to do it... How it works... See also Putting a mapping in an index Getting ready How to do it... How it works... There's more... See also Getting a mapping Getting ready How to do it... How it works... See also Reindexing an index Getting ready How to do it... How it works... See also Refreshing an index Getting ready How to do it... How it works... See also Flushing an index Getting ready How to do it... How it works... See also ForceMerge an index Getting ready How to do it... How it works... There's more... See also Shrinking an index Getting ready How to do it... How it works... There's more... See also Checking if an index exists Getting ready How to do it... How it works... Managing index settings Getting ready How to do it... How it works... There's more... See also Using index aliases Getting ready How to do it... How it works... There's more... Rolling over an index Getting ready How to do it... How it works... See also Indexing a document Getting ready How to do it... How it works... There's more... See also Getting a document Getting ready How to do it... How it works... There's more... See also Deleting a document Getting ready How to do it... How it works... See also Updating a document Getting ready How to do it... How it works... See also Speeding up atomic operations (bulk operations) Getting ready How to do it... How it works... Speeding up GET operations (multi GET) Getting ready How to do it... How it works... See also... Chapter 4: Exploring Search Capabilities Technical requirements Executing a search Getting ready How to do it... How it works... There's more... See also Sorting results Getting ready How to do it... How it works... There's more... See also Highlighting results Getting ready How to do it... How it works... See also Executing a scrolling query Getting ready How to do it... How it works... There's more... See also Using the search_after functionality Getting ready How to do it... How it works... See also Returning inner hits in results Getting ready How to do it... How it works... See also Suggesting a correct query Getting ready How to do it... How it works... See also Counting matched results Getting ready How to do it... How it works... There's more... See also Explaining a query Getting ready How to do it... How it works... Query profiling Getting ready How to do it... How it works... Deleting by query Getting ready How to do it... How it works... There's more... See also Updating by query Getting ready How to do it... How it works... There's more... See also Matching all the documents Getting ready How to do it... How it works... See also Using a Boolean query Getting ready How to do it... How it works... There's more... Using the search template Getting ready How to do it... How it works... See also Chapter 5: Text and Numeric Queries Using a term query Getting ready How to do it... How it works... There's more... Using a terms query Getting ready How to do it... How it works... There's more... See also Using a prefix query Getting ready How to do it... How it works... There's more... See also Using a wildcard query Getting ready How to do it... How it works... See also Using a regexp query Getting ready How to do it... How it works... See also Using span queries Getting ready How to do it... How it works... See also Using a match query Getting ready How to do it... How it works... See also Using a query string query Getting ready How to do it... How it works... There's more... See also Using a simple query string query Getting ready How to do it... How it works... See also Using the range query Getting ready How to do it... How it works... There's more... The common terms query Getting ready How to do it... How it works... See also Using an IDs query Getting ready How to do it... How it works... See also Using the function score query Getting ready How to do it... How it works... See also Using the exists query Getting ready How to do it... How it works... Chapter 6: Relationship and Geo Queries Using the has_child query Getting ready How to do it... How it works... There's more... See also Using the has_parent query Getting ready How to do it... How it works... See also Using nested queries Getting ready How to do it... How it works... See also Using the geo_bounding_box query Getting ready How to do it... How it works... See also Using the geo_polygon query Getting ready How to do it... How it works... See also Using the geo_distance query Getting ready How to do it... How it works... See also Chapter 7: Aggregations Executing an aggregation Getting ready How to do it... How it works... See also Executing stats aggregations Getting ready How to do it... How it works... See also Executing terms aggregation Getting ready How to do it... How it works... There's more... See also Executing significant terms aggregation Getting ready How to do it... How it works... Executing range aggregations Getting ready How to do it... How it works... There's more... See also Executing histogram aggregations Getting ready How to do it... How it works... There's more... See also Executing date histogram aggregations Getting ready How to do it... How it works... There's more... See also Executing filter aggregations Getting ready How to do it... How it works... There's more... See also Executing filters aggregations Getting ready How to do it... How it works... Executing global aggregations Getting ready How to do it... How it works... Executing geo distance aggregations Getting ready How to do it... How it works... See also Executing children aggregations Getting ready How to do it... How it works... Executing nested aggregations Getting ready How to do it... How it works... There's more... Executing top hit aggregations Getting ready How to do it... How it works... See also Executing a matrix stats aggregation Getting ready How to do it... How it works... Executing geo bounds aggregations Getting ready How to do it... How it works... See also Executing geo centroid aggregations Getting ready How to do it... How it works... See also Executing pipeline aggregations Getting ready How to do it... How it works... See also Chapter 8: Scripting in Elasticsearch Painless scripting Getting ready How to do it... How it works... There's more... See also Installing additional script plugins Getting ready How to do it... How it works... There's more... Managing scripts Getting ready How to do it... How it works... There's more... See also Sorting data using scripts Getting ready How to do it... How it works... There's more... Computing return fields with scripting Getting ready How to do it... How it works... See also Filtering a search using scripting Getting ready How to do it... How it works... See also Using scripting in aggregations Getting ready How to do it... How it works... Updating a document using scripts Getting ready How to do it... How it works... There's more... Reindexing with a script Getting ready How to do it... How it works... Chapter 9: Managing Clusters Controlling the cluster health using an API Getting ready How to do it... How it works... There's more... See also Controlling the cluster state using an API Getting ready How to do it... How it works... There's more... See also Getting cluster node information using an API Getting ready How to do it... How it works... There's more... See also Getting node statistics via the API Getting ready How to do it... How it works... There's more... Using the task management API Getting ready How to do it... How it works... There's more... See also Using the hot threads API Getting ready How to do it... How it works... Managing the shard allocation Getting ready How to do it... How it works... There's more... See also Monitoring segments with the segment API Getting ready How to do it... How it works... See also Cleaning the cache Getting ready How to do it... How it works... Chapter 10: Backups and Restoring Data Managing repositories Getting ready How to do it... How it works... There's more... See also Executing a snapshot Getting ready How to do it... How it works... There's more... Restoring a snapshot Getting ready How to do it... How it works... Setting up an NFS share for backups Getting ready How to do it... How it works... Reindexing from a remote cluster Getting ready How to do it... How it works... See also Chapter 11: User Interfaces Installing and using Cerebro Getting ready How to do it... How it works... There's more... Installing and using Elasticsearch HQ Getting ready How to do it... How it works... Installing Kibana Getting ready How to do it... How it works... See also Managing Kibana discovery Getting ready How to do it... How it works... Visualizing data with Kibana Getting ready How to do it... How it works... Using Kibana Dev tools Getting ready How to do it... How it works... There's more... Chapter 12: Using the Ingest Module Pipeline definition Getting ready How to do it... How it works... There's more... See also Inserting an ingest pipeline Getting ready How to do it... How it works... Getting an ingest pipeline Getting ready How to do it... How it works... There's more... Deleting an ingest pipeline Getting ready How to do it... How it works... Simulating an ingest pipeline Getting ready How to do it... How it works... There's more... Built-in processors Getting ready How to do it... How it works... See also Grok processor Getting ready How to do it... How it works... See also Using the ingest attachment plugin Getting ready How to do it... How it works... Using the ingest GeoIP plugin Getting ready How to do it... How it works... See also Chapter 13: Java Integration Creating a standard Java HTTP client Getting ready How to do it... How it works... See also Creating an HTTP Elasticsearch client Getting ready How to do it... How it works... See also Creating a high-level REST client Getting ready How to do it... How it works... See also Managing indices Getting ready How to do it... How it works... See also Managing mappings Getting ready How to do it... How it works... There's more... See also Managing documents Getting ready How to do it... How it works... See also Managing bulk actions Getting ready How to do it... How it works... Building a query Getting ready How to do it... How it works... There's more... Executing a standard search Getting ready How to do it... How it works... See also Executing a search with aggregations Getting ready How to do it... How it works... See also Executing a scroll search Getting ready How to do it... How it works... See also Integrating with DeepLearning4j Getting ready How to do it... How it works... See also Chapter 14: Scala Integration Creating a client in Scala Getting ready How to do it... How it works... See also Managing indices Getting ready How to do it... How it works... See also Managing mappings Getting ready How to do it... How it works... See also Managing documents Getting ready How to do it... How it works... There's more... See also Executing a standard search Getting ready How to do it... How it works... See also Executing a search with aggregations Getting ready How to do it... How it works... See also Integrating with DeepLearning.scala Getting ready How to do it... How it works... See also Chapter 15: Python Integration Creating a client Getting ready How to do it... How it works... See also Managing indices Getting ready How to do it... How it works... There's more... See also Managing mappings include the mapping Getting ready How to do it... How it works... See also Managing documents Getting ready How to do it... How it works... See also Executing a standard search Getting ready How to do it... How it works... See also Executing a search with aggregations Getting ready How to do it... How it works... See also Integrating with NumPy and scikit-learn Getting ready How to do it... How it works... See also Chapter 16: Plugin Development Creating a plugin Getting ready How to do it... How it works... There's more... Creating an analyzer plugin Getting ready How to do it... How it works... There's more... Creating a REST plugin Getting ready How to do it... How it works... See also Creating a cluster action Getting ready How to do it... How it works... See also Creating an ingest plugin Getting ready How to do it... How it works... Chapter 17: Big Data Integration Installing Apache Spark Getting ready How to do it... How it works... There's more... Indexing data using Apache Spark Getting ready How to do it... How it works... See also Indexing data with meta using Apache Spark Getting ready How to do it... How it works... There's more... Reading data with Apache Spark Getting ready How to do it... How it works... Reading data using Spark SQL Getting ready How to do it... How it works... Indexing data with Apache Pig Getting ready How to do it... How it works... Using Elasticsearch with Alpakka Getting ready How to do it... How it works... See also Using Elasticsearch with MongoDB Getting ready How to do it... How it works... See also Another Book You May Enjoy Index Search, analyze, and manage data effectively with Elasticsearch 7 Key FeaturesExtend Elasticsearch functionalities and learn how to deploy on Elastic CloudDeploy and manage simple Elasticsearch nodes as well as complex cluster topologiesExplore the capabilities of Elasticsearch 7 with easy-to-follow recipesBook DescriptionElasticsearch is a Lucene-based distributed search server that allows users to index and search unstructured content with petabytes of data. With this book, you'll be guided through comprehensive recipes on what's new in Elasticsearch 7, and see how to create and run complex queries and analytics. Packed with recipes on performing index mapping, aggregation, and scripting using Elasticsearch, this fourth edition of Elasticsearch Cookbook will get you acquainted with numerous solutions and quick techniques for performing both every day and uncommon tasks such as deploying Elasticsearch nodes, integrating other tools to Elasticsearch, and creating different visualizations. You will install Kibana to monitor a cluster and also extend it using a variety of plugins. Finally, you will integrate your Java, Scala, Python, and big data applications such as Apache Spark and Pig with Elasticsearch, and create efficient data applications powered by enhanced functionalities and custom plugins. By the end of this book, you will have gained in-depth knowledge of implementing Elasticsearch architecture, and you'll be able to manage, search, and store data efficiently and effectively using Elasticsearch. What you will learnCreate an efficient architecture with ElasticsearchOptimize search results by executing analytics aggregationsBuild complex queries by managing indices and documentsMonitor the performance of your cluster and nodesDesign advanced mapping to take full control of index stepsIntegrate Elasticsearch in Java, Scala, Python, and big data applicationsInstall Kibana to monitor clusters and extend it for pluginsWho this book is forIf youre a software engineer, big data infrastructure engineer, or Elasticsearch developer, you'll find this book useful. This Elasticsearch book will also help data professionals working in the e-commerce and FMCG industry who use Elastic for metrics evaluation and search analytics to get deeper insights for better business decisions. Prior experience with Elasticsearch will help you get the most out of this book. Table of ContentsGetting startedManaging MappingBasic OperationsExploring Search CapabilitiesText and Numeric QueriesRelationship and Geo QueriesAggregationsScripting in ElasticsearchManaging ClusterBackup and RestoreUser InterfacesUsing the Ingest moduleJava IntegrationScala IntegrationPython IntegrationPlugin DevelopmentBig Data Integration BSearch, analyze, and manage data effectively with Elasticsearch 7/b h4Key Features/h4 ulliExtend Elasticsearch functionalities and learn how to deploy on Elastic Cloud /li liDeploy and manage simple Elasticsearch nodes as well as complex cluster topologies /li liExplore the capabilities of Elasticsearch 7 with easy-to-follow recipes/li/ul h4Book Description/h4 Elasticsearch is a Lucene-based distributed search server that allows users to index and search unstructured content with petabytes of data. With this book, you'll be guided through comprehensive recipes on what's new in Elasticsearch 7, and see how to create and run complex queries and analytics.