Evaluation & Competitions of Solvers
Course Description:
This course will focus on the difficulties met in assessing the
performance of different solvers (software) on current computers. In
a first part, the most relevant notions of computer architecture will
be recalled (memory hierarchy, cores, SMP/NUMA architectures, ...). Then,
some issues regarding the input format of the benchmarks and their
selection will be presented. The experience gathered during the SAT,
PB and CSP competitions will be shared in the third part. At last,
different ranking methods used during the SAT competitions will be
discussed.
Resume:
Olivier Roussel is associate professor in computer science at
University of Artois, France. He has organized many competitions
(Pseudo-Boolean, SAT and CSP) and is the author of runsolver, a tool
to control the resources used by a solver.
Daniel Le Berre is professor in computer science at University of
Artois, France. He initiated the SAT competitive events in 2002, and
took part of them in various roles (co-organizer, technical advisor)
until 2011. As one of the authors of Sat4j, an open source Boolean
satisfaction and optimization library, he also participated as
competitor to many competitive events.