Performance Evaluation and Benchmarking for the Era of Artificial Intelligence : 10th TPC Technology Conference, TPCTC 2018, Rio De Janeiro, Brazil, August 27–31, 2018, Revised Selected Papers

This book constitutes the thoroughly refereed post-conference proceedings of the 10th TPC Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2018, held in conjunction with the 44th International Conference on Very Large Databases (VLDB 2018) in August 2018. The 10 papers presented were carefully reviewed and selected from numerous submissions. The TPC encourages researchers and industry experts to present and debate novel ideas and methodologies in performance evaluation, measurement, and characterization. Front Matter ....Pages I-XIII Industry Panel on Defining Industry Standards for Benchmarking Artificial Intelligence (Raghunath Nambiar, Shahram Ghandeharizadeh, Gary Little, Christoph Boden, Ajay Dholakia)....Pages 1-6 UniBench: A Benchmark for Multi-model Database Management Systems (Chao Zhang, Jiaheng Lu, Pengfei Xu, Yuxing Chen)....Pages 7-23 PolyBench: The First Benchmark for Polystores (Jeyhun Karimov, Tilmann Rabl, Volker Markl)....Pages 24-41 Benchmarking Distributed Data Processing Systems for Machine Learning Workloads (Christoph Boden, Tilmann Rabl, Sebastian Schelter, Volker Markl)....Pages 42-57 Characterizing the Performance and Resilience of HCI Clusters with the TPCx-HCI Benchmark (H. Reza Taheri, Gary Little, Bhavik Desai, Andrew Bond, Doug Johnson, Greg Kopczynski)....Pages 58-70 Requirements for an Enterprise AI Benchmark (Cedric Bourrasset, France Boillod-Cerneux, Ludovic Sauge, Myrtille Deldossi, Francois Wellenreiter, Rajesh Bordawekar et al.)....Pages 71-81 Towards Evaluation of Tensorflow Performance in a Distributed Compute Environment (Miro Hodak, Ajay Dholakia)....Pages 82-93 A Comparison of Two Cache Augmented SQL Architectures (Shahram Ghandeharizadeh, Hieu Nguyen)....Pages 94-109 Benchmarking and Performance Analysis of Event Sequence Queries on Relational Database (Yuto Hayamizu, Ryoji Kawamichi, Kazuo Goda, Masaru Kitsuregawa)....Pages 110-125 Data Consistency Properties of Document Store as a Service (DSaaS): Using MongoDB Atlas as an Example (Chenhao Huang, Michael Cahill, Alan Fekete, Uwe Röhm)....Pages 126-139 Lessons Learned from the Industry’s First TPC Benchmark DS (TPC-DS) (Manan Trivedi, Zhenqiang Chen)....Pages 140-154 Back Matter ....Pages 155-155