MiDataSets (multiple inputs) for MiBench benchmark to enable more realistic benchmarking and iterative optimizations

"Grigori Fursin" <gfursin@gmail.com>
19 Mar 2007 15:39:29 -0400

          From comp.compilers

Related articles
MiDataSets (multiple inputs) for MiBench benchmark to enable more real gfursin@gmail.com (Grigori Fursin) (2007-03-19)
| List of all articles for this month |

From: "Grigori Fursin" <gfursin@gmail.com>
Newsgroups: comp.compilers
Date: 19 Mar 2007 15:39:29 -0400
Organization: Compilers Central
Keywords: benchmarks, optimize
Posted-Date: 19 Mar 2007 15:39:29 EDT

Dear all,


In case someone is interested, we are developing a set of inputs
(MiDataSets) for the MiBench benchmark. Iterative optimization is now
a popular technique to obtain performance or code size improvements
over the default settings in a compiler. However, in most of the
research projects, the best configuration is found for one arbitrary
dataset and it is assumed that this configuration will work well with
any other dataset that a program uses. We created 20 different
datasets per program for free MiBench benchmark to evaluate this
assumption and analyze the behavior of various programs with multiple
datasets. We hope that this will enable more realistic benchmarking,
practical iterative optimizations (iterative compilation), and can
help to automatically improve optimization heuristics of different
compilers.


More information can be found at the MiDataSets development website:
http://midatasets.sourceforge.net


We just made a pre-release of the 1st version of MiDataSets and we
made an effort to include only copyright free inputs from the
Internet. However, mistakes are possible - in such cases, please
contact me to resolve the issue or remove the input.


Any suggestions and comments are welcome!
Yours,
Grigori Fursin


=====================================================
Grigori Fursin, PhD
INRIA Futurs, France
http://fursin.net/research


Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.