Middleware Systems Research Group

University of Toronto, Canada

• << Publications

Specifying Big Data Benchmarks

Abstract

First Workshop, WBDB 2012, San Jose, CA, USA, May 8-9, 2012, and Second Workshop, WBDB 2012, Pune, India, December 17-18, 2012, Revised Selected Papers

Punctuated by the rapid growth in the use of the Internet, both in the number of devices connected globally and the amount of data per device, the world has been in the midst of an extraordinary information explosion over the past decade. As a consequence, society is experiencing a rate of change in dealing with information that is faster than at any other point throughout history. The data originating from social media, enterprise applications, and computer devices in general, commonly referred to as big data, continue to grow exponentially establishing enormous potential for extracting very detailed information. With new systems, techniques, and algorithms being developed that can deal with these new database characteristics, emerges the need for a standardized methodology for their performance evaluation.

This sparked the idea among a small group of industry and academic experts to establish a series of workshops explicitly with the intention of defining a set of benchmarks for providing objective measures of the effectiveness of hardware and software systems dealing with big data applications. The First Workshop on Big Data Benchmarking (WBDB 2012), held during May 8–9, 2012, in San Jose, CA, was attended by over 60 invitees representing 45 different organizations, including industry and academia. Following the successful First Workshop on Big Data Benchmarking, the second workshop (WBDB 2012.in) was held in Pune, India, on December 16–17, 2012. The topics discussed at the workshops can be grouped into four topic areas: (1) Benchmark Context; (2) Benchmark Design Principles for a Big Data Benchmark; (3) Objectives of Big Data Benchmarking; and (4) Big Data Benchmark Design. In this book, the most mature and interesting contributions from the First and Second Workshop on Big Data Benchmarking were collected.

Download

Tags: big data, benchmarking, wbdb