Re: Paper: Multi-Language Benchmark Generation via L-Systems

Fernando Magno Quintao Pereira <pronesto@gmail.com>
Tue, 23 Dec 2025 13:12:59 -0300

          From comp.compilers
Related articles
Paper: Multi-Language Benchmark Generation via L-Systems johnl@taugh.com (John R Levine) (2025-12-22)
Re: Paper: Multi-Language Benchmark Generation via L-Systems pronesto@gmail.com (Fernando Magno Quintao Pereira) (2025-12-23)
| List of all articles for this month |
From: Fernando Magno Quintao Pereira <pronesto@gmail.com>
Newsgroups: comp.compilers
Date: Tue, 23 Dec 2025 13:12:59 -0300
Organization: Compilers Central
References: 25-12-002
Injection-Info: gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="26728"; mail-complaints-to="abuse@iecc.com"
Keywords: benchmarks, paper
Posted-Date: 23 Dec 2025 15:15:03 EST
In-Reply-To: 25-12-002

Hi John,


Thank you very much for posting about our paper on comp.compilers. We
truly appreciate it.


One of the goals of BenchGen is to support benchmarking for new
programming languages, as well as new compilers or interpreters for
well-established languages. If anyone is interested in benchmarking a
new language, we would be very happy to help set it up within
BenchGen. The system currently supports languages with at least one
data structure. When data structures are not available, simple scalars
can be used instead. It also supports three basic forms of control
flow: function calls, if-then-else constructs, and loops.


Below are a few experiments we have conducted using BenchGen:


A comparison between C, C++, Julia, Go, Zig, V, and Odin:
https://github.com/lac-dcc/BenchGen/wiki/Adding-a-New-Programming-Language-to-BenchGen


A comparison between gcc and clang:
https://github.com/lac-dcc/BenchGen/wiki/Comparing-gcc-and-clang


A comparison between different versions of gcc:
https://github.com/lac-dcc/BenchGen/wiki/Comparing-gcc-versions


A comparison between different GLib data structures:
https://github.com/lac-dcc/BenchGen/wiki/Comparing-GLib-data-structures


A study of the impact of profile-guided optimizations:
https://github.com/lac-dcc/BenchGen/wiki/Experiment-with-Profile-Guided-Optimization-(PGO)


An analysis of the asymptotic behavior of the Clang and GCC front end,
middle end, and back end:
https://github.com/lac-dcc/BenchGen/wiki/Asymptotic-Behavior-of-CLANG-and-GCC-Compilers


Notice that BenchGen is still evolving, and we are open to changes in
the methodology to generate programs.


Best regards,


Fernando


On Tue, Dec 23, 2025 at 12:57 AM John R Levine <johnl@taugh.com> wrote:
>
> The authors built a system that uses a production grammar to create
> largish benchmark programs which they then used to evaluate compiler
> performance and (occasionally) look for bugs. ...


> https://arxiv.org/abs/2512.17616

Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.