Trace number 3438878

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.1 4999.99

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1521_s.cnf
MD5SUM4e35cb9894b1ca841d462da2d6957cc5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63882
Number of clauses123981
Sum of the clauses size369562
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22381
Number of clauses of size 3121600
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438878-1307636988/watcher-3438878-1307636988 -o /tmp/evaluation-result-3438878-1307636988/solver-3438878-1307636988 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438878-1307636988.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.42 7.94 7.84 4/176 27618
/proc/meminfo: memFree=32134836/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=19708 CPUtime=0 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 2171 0 0 0 0 0 0 0 22 0 1 0 875298469 20180992 2110 33554432000 4194304 4394578 140736985826368 18446744073709551615 4280333 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 4927 2117 244 49 0 2068 0

[startup+0.011836 s]
/proc/loadavg: 7.42 7.94 7.84 4/176 27618
/proc/meminfo: memFree=32134836/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=22180 CPUtime=0 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 2648 0 0 0 0 0 0 0 22 0 1 0 875298469 22712320 2587 33554432000 4194304 4394578 140736985826368 18446744073709551615 274473628357 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 5545 2587 247 49 0 2686 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 22180

[startup+0.100875 s]
/proc/loadavg: 7.42 7.94 7.84 4/176 27618
/proc/meminfo: memFree=32134836/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=37200 CPUtime=0.09 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 6020 0 0 0 9 0 0 0 22 0 1 0 875298469 38092800 5958 33554432000 4194304 4394578 140736985826368 18446744073709551615 4267384 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 9300 5961 253 49 0 6441 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 37200

[startup+0.30087 s]
/proc/loadavg: 7.42 7.94 7.84 4/176 27618
/proc/meminfo: memFree=32134836/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=49432 CPUtime=0.29 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 9709 0 0 0 26 3 0 0 23 0 1 0 875298469 50618368 9404 33554432000 4194304 4394578 140736985826368 18446744073709551615 274473992087 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 12358 9404 255 49 0 9499 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 49432

[startup+0.70084 s]
/proc/loadavg: 7.42 7.94 7.84 4/176 27618
/proc/meminfo: memFree=32134836/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=62736 CPUtime=0.69 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 14250 0 0 0 63 6 0 0 25 0 1 0 875298469 64241664 12990 33554432000 4194304 4394578 140736985826368 18446744073709551615 4285768 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 15684 12990 265 49 0 12825 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 62736

[startup+1.50066 s]
/proc/loadavg: 7.42 7.94 7.84 4/178 27620
/proc/meminfo: memFree=32074728/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=72212 CPUtime=1.49 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 16573 0 0 0 143 6 0 0 25 0 1 0 875298469 73945088 15313 33554432000 4194304 4394578 140736985826368 18446744073709551615 274473622881 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 18053 15313 267 49 0 15194 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 72212

[startup+3.10042 s]
/proc/loadavg: 7.42 7.94 7.84 4/178 27620
/proc/meminfo: memFree=32064312/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=79340 CPUtime=3.09 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 18333 0 0 0 303 6 0 0 25 0 1 0 875298469 81244160 17073 33554432000 4194304 4394578 140736985826368 18446744073709551615 4285588 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 19835 17073 267 49 0 16976 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 79340

[startup+6.30073 s]
/proc/loadavg: 6.99 7.84 7.81 4/178 27620
/proc/meminfo: memFree=32052364/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=89248 CPUtime=6.29 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 20843 0 0 0 622 7 0 0 25 0 1 0 875298469 91389952 19583 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 22312 19583 267 49 0 19453 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 89248

[startup+12.7006 s]
/proc/loadavg: 6.59 7.75 7.78 4/178 27620
/proc/meminfo: memFree=32037016/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=102972 CPUtime=12.69 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 24110 0 0 0 1261 8 0 0 25 0 1 0 875298469 105443328 22850 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 25743 22850 267 49 0 22884 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 102972

[startup+25.5004 s]
/proc/loadavg: 5.57 7.46 7.69 4/178 27621
/proc/meminfo: memFree=32008368/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=129124 CPUtime=25.49 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 30531 0 0 0 2540 9 0 0 25 0 1 0 875298469 132222976 29271 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298370 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 32281 29271 267 49 0 29422 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 129124

[startup+51.101 s]
/proc/loadavg: 4.35 7.03 7.54 4/178 27621
/proc/meminfo: memFree=31959680/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=177760 CPUtime=51.09 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 42355 0 0 0 5098 11 0 0 25 0 1 0 875298469 182026240 41095 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 44440 41095 267 49 0 41581 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 177760

[startup+102.307 s]
/proc/loadavg: 3.02 6.25 7.24 4/178 27623
/proc/meminfo: memFree=31875680/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=262608 CPUtime=102.3 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 62619 0 0 0 10215 15 0 0 25 0 1 0 875298469 268910592 61359 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 65652 61359 267 49 0 62793 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 262608

[startup+162.3 s]
/proc/loadavg: 2.37 5.47 6.91 4/178 27624
/proc/meminfo: memFree=31797892/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=343608 CPUtime=162.29 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 82031 0 0 0 16211 18 0 0 25 0 1 0 875298469 351854592 80771 33554432000 4194304 4394578 140736985826368 18446744073709551615 4346169 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 85902 80771 267 49 0 83043 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 343608

[startup+222.301 s]
/proc/loadavg: 2.13 4.84 6.60 4/178 27626
/proc/meminfo: memFree=31707816/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=437956 CPUtime=222.29 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 104192 0 0 0 22207 22 0 0 25 0 1 0 875298469 448466944 102932 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298373 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 109489 102941 267 49 0 106630 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 437956

[startup+282.3 s]
/proc/loadavg: 2.05 4.32 6.31 3/178 27667
/proc/meminfo: memFree=31661372/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=494512 CPUtime=282.3 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 117441 0 0 0 28205 25 0 0 25 0 1 0 875298469 506380288 116181 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 123628 116181 267 49 0 120769 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 494512

[startup+342.301 s]
/proc/loadavg: 2.02 3.89 6.04 3/178 27668
/proc/meminfo: memFree=31591604/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=565860 CPUtime=342.29 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 134275 0 0 0 34202 27 0 0 25 0 1 0 875298469 579440640 133015 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 141465 133015 267 49 0 138606 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 565860

[startup+402.301 s]
/proc/loadavg: 2.08 3.56 5.79 3/178 27670
/proc/meminfo: memFree=31546392/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=612552 CPUtime=402.3 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 145358 0 0 0 40200 30 0 0 25 0 1 0 875298469 627253248 144098 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298298 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 153138 144098 267 49 0 150279 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 612552

[startup+462.301 s]
/proc/loadavg: 2.06 3.29 5.55 3/178 27671
/proc/meminfo: memFree=31480484/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=680616 CPUtime=462.3 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 161313 0 0 0 46197 33 0 0 25 0 1 0 875298469 696950784 160053 33554432000 4194304 4394578 140736985826368 18446744073709551615 4327678 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 170154 160053 267 49 0 167295 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 680616

[startup+522.301 s]
/proc/loadavg: 2.02 3.05 5.33 3/178 27673
/proc/meminfo: memFree=31445200/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=722840 CPUtime=522.3 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 169951 0 0 0 52195 35 0 0 25 0 1 0 875298469 740188160 168691 33554432000 4194304 4394578 140736985826368 18446744073709551615 4285734 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 180710 168691 267 49 0 177851 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 722840

[startup+582.3 s]
/proc/loadavg: 2.01 2.86 5.12 3/178 27675
/proc/meminfo: memFree=31398616/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=771120 CPUtime=582.3 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 181526 0 0 0 58193 37 0 0 25 0 1 0 875298469 789626880 180266 33554432000 4194304 4394578 140736985826368 18446744073709551615 4296807 0 0 4096 6 0 0 0 17 2 0 0 0
/proc/27616/statm: 192780 180266 267 49 0 189921 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 771120

[startup+642.301 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.00 2.00 2.04 3/178 27779
/proc/meminfo: memFree=30473400/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1852024 CPUtime=4062.39 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 410892 0 0 0 406145 94 0 0 25 0 1 0 875298469 1896472576 408861 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298340 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 463006 408861 267 49 0 460147 0
Current children cumulated CPU time (s) 4062.39
Current children cumulated vsize (KiB) 1852024

[startup+4122.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/178 27781
/proc/meminfo: memFree=30462292/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1864576 CPUtime=4122.38 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 413616 0 0 0 412143 95 0 0 25 0 1 0 875298469 1909325824 411585 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 466144 411585 267 49 0 463285 0
Current children cumulated CPU time (s) 4122.38
Current children cumulated vsize (KiB) 1864576

[startup+4182.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/178 27783
/proc/meminfo: memFree=30456416/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1871588 CPUtime=4182.39 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 415124 0 0 0 418143 96 0 0 25 0 1 0 875298469 1916506112 413093 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298976 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 467897 413093 267 49 0 465038 0
Current children cumulated CPU time (s) 4182.39
Current children cumulated vsize (KiB) 1871588

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.02 3/178 27784
/proc/meminfo: memFree=30450044/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1878968 CPUtime=4242.39 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 416702 0 0 0 424142 97 0 0 25 0 1 0 875298469 1924063232 414671 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298751 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 469742 414671 267 49 0 466883 0
Current children cumulated CPU time (s) 4242.39
Current children cumulated vsize (KiB) 1878968

[startup+4302.3 s]
/proc/loadavg: 2.00 2.00 2.02 3/178 27786
/proc/meminfo: memFree=30443392/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1886160 CPUtime=4302.39 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 418256 0 0 0 430142 97 0 0 25 0 1 0 875298469 1931427840 416225 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298656 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 471540 416225 267 49 0 468681 0
Current children cumulated CPU time (s) 4302.39
Current children cumulated vsize (KiB) 1886160

[startup+4362.3 s]
/proc/loadavg: 2.00 2.00 2.01 3/178 27787
/proc/meminfo: memFree=30438744/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1891644 CPUtime=4362.39 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 419427 0 0 0 436141 98 0 0 25 0 1 0 875298469 1937043456 417396 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 472911 417396 267 49 0 470052 0
Current children cumulated CPU time (s) 4362.39
Current children cumulated vsize (KiB) 1891644

[startup+4422.3 s]
/proc/loadavg: 2.08 2.03 2.02 3/178 27789
/proc/meminfo: memFree=30433080/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1897900 CPUtime=4422.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 420819 0 0 0 442141 99 0 0 25 0 1 0 875298469 1943449600 418788 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298350 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 474475 418788 267 49 0 471616 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 1897900

[startup+4482.3 s]
/proc/loadavg: 2.03 2.02 2.01 3/178 27791
/proc/meminfo: memFree=30417028/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1917876 CPUtime=4482.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 424995 0 0 0 448140 100 0 0 25 0 1 0 875298469 1963905024 422964 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298942 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 479469 422964 267 49 0 476610 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 1917876

[startup+4542.3 s]
/proc/loadavg: 2.01 2.02 2.01 3/178 27792
/proc/meminfo: memFree=30393652/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1944336 CPUtime=4542.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 430601 0 0 0 454139 101 0 0 25 0 1 0 875298469 1991000064 428570 33554432000 4194304 4394578 140736985826368 18446744073709551615 4308934 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 486084 428570 267 49 0 483225 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 1944336

[startup+4602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 27794
/proc/meminfo: memFree=30384892/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1954104 CPUtime=4602.41 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 432723 0 0 0 460139 102 0 0 25 0 1 0 875298469 2001002496 430692 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298896 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 488526 430692 267 49 0 485667 0
Current children cumulated CPU time (s) 4602.41
Current children cumulated vsize (KiB) 1954104

[startup+4662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27795
/proc/meminfo: memFree=30378264/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1961940 CPUtime=4662.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 434386 0 0 0 466137 103 0 0 25 0 1 0 875298469 2009026560 432355 33554432000 4194304 4394578 140736985826368 18446744073709551615 4296720 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 490485 432355 267 49 0 487626 0
Current children cumulated CPU time (s) 4662.4
Current children cumulated vsize (KiB) 1961940

[startup+4722.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27797
/proc/meminfo: memFree=30371228/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1970464 CPUtime=4722.41 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 436156 0 0 0 472137 104 0 0 25 0 1 0 875298469 2017755136 434125 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 492616 434125 267 49 0 489757 0
Current children cumulated CPU time (s) 4722.41
Current children cumulated vsize (KiB) 1970464

[startup+4782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27799
/proc/meminfo: memFree=30358144/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1986036 CPUtime=4782.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 439422 0 0 0 478136 104 0 0 25 0 1 0 875298469 2033700864 437391 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 496509 437391 267 49 0 493650 0
Current children cumulated CPU time (s) 4782.4
Current children cumulated vsize (KiB) 1986036

[startup+4842.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27800
/proc/meminfo: memFree=30352012/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1992564 CPUtime=4842.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 440876 0 0 0 484135 105 0 0 25 0 1 0 875298469 2040385536 438845 33554432000 4194304 4394578 140736985826368 18446744073709551615 4346323 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 498141 438845 267 49 0 495282 0
Current children cumulated CPU time (s) 4842.4
Current children cumulated vsize (KiB) 1992564

[startup+4902.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27802
/proc/meminfo: memFree=30348844/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=1996408 CPUtime=4902.41 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 441711 0 0 0 490135 106 0 0 25 0 1 0 875298469 2044321792 439680 33554432000 4194304 4394578 140736985826368 18446744073709551615 4274000 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 499102 439680 267 49 0 496243 0
Current children cumulated CPU time (s) 4902.41
Current children cumulated vsize (KiB) 1996408

[startup+4962.3 s]
/proc/loadavg: 2.11 2.03 2.01 3/178 27803
/proc/meminfo: memFree=30339604/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=2006620 CPUtime=4962.4 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 443936 0 0 0 496134 106 0 0 25 0 1 0 875298469 2054778880 441905 33554432000 4194304 4394578 140736985826368 18446744073709551615 4298721 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 501655 441905 267 49 0 498796 0
Current children cumulated CPU time (s) 4962.4
Current children cumulated vsize (KiB) 2006620



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 27804
/proc/meminfo: memFree=30334964/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=2012128 CPUtime=5000.01 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 445106 0 0 0 499894 107 0 0 25 0 1 0 875298469 2060419072 443075 33554432000 4194304 4394578 140736985826368 18446744073709551615 274473992087 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 503032 443075 267 49 0 500173 0
Current children cumulated CPU time (s) 5000.01
Current children cumulated vsize (KiB) 2012128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 27804
/proc/meminfo: memFree=30334964/32950928 swapFree=67079488/67111528
[pid=27616] ppid=27613 vsize=2012128 CPUtime=5000.01 cores=0,2,4,6
/proc/27616/stat : 27616 (SApperloT2010) R 27613 27616 27203 0 -1 4202496 445106 0 0 0 499894 107 0 0 25 0 1 0 875298469 2060419072 443075 33554432000 4194304 4394578 140736985826368 18446744073709551615 274473992087 0 0 4096 6 0 0 0 17 0 0 0 0
/proc/27616/statm: 503032 443075 267 49 0 500173 0
Current children cumulated CPU time (s) 5000.01
Current children cumulated vsize (KiB) 2012128

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.99
CPU time (s): 5000.1
CPU user time (s): 4998.95
CPU system time (s): 1.15382
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 2012128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4998.95
system time used= 1.15382
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 445106
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 53
involuntary context switches= 27541

runsolver used 8.13576 second user time and 16.5525 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-09 18:29:48
IDJOB=3438878
IDBENCH=83191
IDSOLVER=1933
FILE ID=node125/3438878-1307636988
RUNJOBID= node125-1307636988-27591
PBS_JOBID= 13549397
Free space on /tmp= 74060 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1521_s.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438878-1307636988/watcher-3438878-1307636988 -o /tmp/evaluation-result-3438878-1307636988/solver-3438878-1307636988 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438878-1307636988.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4e35cb9894b1ca841d462da2d6957cc5
RANDOM SEED=1231585013

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      32135700 kB
Buffers:        199348 kB
Cached:         384228 kB
SwapCached:       3400 kB
Active:         316128 kB
Inactive:       303696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      32135700 kB
SwapTotal:    67111528 kB
SwapFree:     67079488 kB
Dirty:            2772 kB
Writeback:           0 kB
AnonPages:       34324 kB
Mapped:          13740 kB
Slab:           129928 kB
PageTables:       5036 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   193176 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74060 MiB
End job on node125 at 2011-06-09 19:53:10