Trace number 3372409

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587f (fixed)? (TO) 5000.17 5000.1

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
MD5SUMfce318b20c1a474ab81b77594d3f6f99
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark510.889
Satisfiable
(Un)Satisfiability was proved
Number of variables945406
Number of clauses5079060
Sum of the clauses size12071640
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 25035980
Number of clauses of size 3240
Number of clauses of size 4960
Number of clauses of size 52400
Number of clauses of size over 538760

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372409-1305421552/watcher-3372409-1305421552 -o /tmp/evaluation-result-3372409-1305421552/solver-3372409-1305421552 -C 5000 -W 5100 -M 15500 lingeling HOME/instance-3372409-1305421552.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.32 4.20 3/349 5110
/proc/meminfo: memFree=26026392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=7356 CPUtime=0 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 417 0 0 0 0 0 0 0 22 0 1 0 653758152 7532544 360 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634515200 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 1839 360 109 53 0 262 0

[startup+0.079519 s]
/proc/loadavg: 2.02 2.32 4.20 3/349 5110
/proc/meminfo: memFree=26026392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=12332 CPUtime=0.07 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 1633 0 0 0 7 0 0 0 22 0 1 0 653758152 12627968 1576 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634515200 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 3083 1576 113 53 0 1506 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 12332

[startup+0.100514 s]
/proc/loadavg: 2.02 2.32 4.20 3/349 5110
/proc/meminfo: memFree=26026392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=12972 CPUtime=0.09 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 1793 0 0 0 9 0 0 0 22 0 1 0 653758152 13283328 1736 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634515200 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 3243 1736 113 53 0 1666 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12972

[startup+0.300478 s]
/proc/loadavg: 2.02 2.32 4.20 3/349 5110
/proc/meminfo: memFree=26026392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=30320 CPUtime=0.29 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 6163 0 0 0 28 1 0 0 23 0 1 0 653758152 31047680 6105 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634515200 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 7580 6105 113 53 0 6003 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30320

[startup+1.42028 s]
/proc/loadavg: 2.02 2.32 4.20 3/349 5110
/proc/meminfo: memFree=26026392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=125044 CPUtime=1.41 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 29908 0 0 0 135 6 0 0 25 0 1 0 653758152 128045056 29786 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634515200 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 31261 29786 113 53 0 29684 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 125044

[startup+1.50027 s]
/proc/loadavg: 2.02 2.32 4.20 3/349 5110
/proc/meminfo: memFree=26026392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=157812 CPUtime=1.49 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 38100 0 0 0 142 7 0 0 25 0 1 0 653758152 161599488 37978 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634515200 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 39453 37978 113 53 0 37876 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 157812

[startup+3.10099 s]
/proc/loadavg: 2.02 2.32 4.20 3/350 5111
/proc/meminfo: memFree=25843700/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=190576 CPUtime=3.09 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 61349 0 0 0 298 11 0 0 25 0 1 0 653758152 195149824 46148 33554432000 4194304 4409284 140736073657424 18446744073709551615 4280280 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 47644 46148 125 53 0 46067 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 190576

[startup+6.30043 s]
/proc/loadavg: 2.02 2.32 4.19 3/350 5111
/proc/meminfo: memFree=25867392/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=194760 CPUtime=6.29 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 89750 0 0 0 615 14 0 0 25 0 1 0 653758152 199434240 47204 33554432000 4194304 4409284 140736073657424 18446744073709551615 4259624 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 48690 47204 134 53 0 47113 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 194760

[startup+12.7003 s]
/proc/loadavg: 2.02 2.31 4.17 3/350 5111
/proc/meminfo: memFree=25834136/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=194760 CPUtime=12.69 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 106138 0 0 0 1253 16 0 0 25 0 1 0 653758152 199434240 47207 33554432000 4194304 4409284 140736073657424 18446744073709551615 4247265 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 48690 47207 137 53 0 47113 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 194760

[startup+25.5011 s]
/proc/loadavg: 2.01 2.30 4.14 3/350 5111
/proc/meminfo: memFree=25828244/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=201064 CPUtime=25.49 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 107719 0 0 0 2533 16 0 0 25 0 1 0 653758152 205889536 48788 33554432000 4194304 4409284 140736073657424 18446744073709551615 4247088 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 50266 48788 137 53 0 48689 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 201064

[startup+51.1005 s]
/proc/loadavg: 2.01 2.27 4.08 3/350 5112
/proc/meminfo: memFree=25830780/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=207492 CPUtime=51.09 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 109644 0 0 0 5092 17 0 0 25 0 1 0 653758152 212471808 50400 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358325 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 51873 50400 141 53 0 50296 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 207492

[startup+102.301 s]
/proc/loadavg: 2.00 2.23 3.97 3/350 5113
/proc/meminfo: memFree=25793928/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=248216 CPUtime=102.29 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 153092 0 0 0 10202 27 0 0 25 0 1 0 653758152 254173184 60581 33554432000 4194304 4409284 140736073657424 18446744073709551615 4226593 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 62054 60581 141 53 0 60477 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 248216

[startup+162.301 s]
/proc/loadavg: 2.00 2.18 3.84 3/350 5115
/proc/meminfo: memFree=25746160/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=277608 CPUtime=162.29 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 160442 0 0 0 16201 28 0 0 25 0 1 0 653758152 284270592 67929 33554432000 4194304 4409284 140736073657424 18446744073709551615 4259191 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 69402 67929 141 53 0 67825 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 277608

[startup+222.3 s]
/proc/loadavg: 2.00 2.15 3.72 3/350 5117
/proc/meminfo: memFree=25718360/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=271212 CPUtime=222.3 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 160442 0 0 0 22196 34 0 0 25 0 1 0 653758152 277721088 66330 33554432000 4194304 4409284 140736073657424 18446744073709551615 4226456 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 67803 66330 141 53 0 66226 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 271212

[startup+282.301 s]
/proc/loadavg: 2.00 2.12 3.61 3/350 5118
/proc/meminfo: memFree=25685592/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=311564 CPUtime=282.3 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 203757 0 0 0 28186 44 0 0 25 0 1 0 653758152 319041536 76418 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358609 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 77891 76418 141 53 0 76314 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 311564

[startup+342.3 s]
/proc/loadavg: 2.00 2.09 3.51 3/350 5120
/proc/meminfo: memFree=25637924/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=376460 CPUtime=342.29 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 219981 0 0 0 34181 48 0 0 25 0 1 0 653758152 385495040 92642 33554432000 4194304 4409284 140736073657424 18446744073709551615 4325642 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 94115 92642 141 53 0 92538 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 376460

[startup+402.301 s]
/proc/loadavg: 2.05 2.09 3.42 3/350 5121
/proc/meminfo: memFree=25629952/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=387876 CPUtime=402.29 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 237713 0 0 0 40177 52 0 0 25 0 1 0 653758152 397185024 95528 33554432000 4194304 4409284 140736073657424 18446744073709551615 4258742 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 96969 95528 141 53 0 95392 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 387876

[startup+462.3 s]
/proc/loadavg: 2.09 2.09 3.33 3/350 5123
/proc/meminfo: memFree=25406948/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=613020 CPUtime=462.3 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 299901 0 0 0 46167 63 0 0 25 0 1 0 653758152 627732480 151782 33554432000 4194304 4409284 140736073657424 18446744073709551615 4244391 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 153255 151782 141 53 0 151678 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 613020

[startup+522.301 s]
/proc/loadavg: 2.03 2.07 3.25 3/350 5125
/proc/meminfo: memFree=25523848/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=493340 CPUtime=522.31 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 299901 0 0 0 52162 69 0 0 25 0 1 0 653758152 505180160 121862 33554432000 4194304 4409284 140736073657424 18446744073709551615 4230778 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 123335 121862 141 53 0 121758 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 493340

[startup+582.301 s]
/proc/loadavg: 2.01 2.05 3.16 3/350 5126
/proc/meminfo: memFree=25380836/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=599048 CPUtime=582.3 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 326328 0 0 0 58154 76 0 0 25 0 1 0 653758152 613425152 148289 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358699 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 149762 148289 141 53 0 148185 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 599048

[startup+642.312 s]

################
# More data... #
################

[startup+4002.3 s]
/proc/loadavg: 2.01 2.02 2.01 3/350 5702
/proc/meminfo: memFree=25120400/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=877908 CPUtime=4002.34 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3150167 0 0 0 399597 637 0 0 25 0 1 0 653758152 898977792 218036 33554432000 4194304 4409284 140736073657424 18446744073709551615 4244761 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 219477 218036 141 53 0 217900 0
Current children cumulated CPU time (s) 4002.34
Current children cumulated vsize (KiB) 877908

[startup+4062.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/350 5704
/proc/meminfo: memFree=24953072/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1040140 CPUtime=4062.35 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3190725 0 0 0 405587 648 0 0 25 0 1 0 653758152 1065103360 258594 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 260035 258594 141 53 0 258458 0
Current children cumulated CPU time (s) 4062.35
Current children cumulated vsize (KiB) 1040140

[startup+4122.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/350 5706
/proc/meminfo: memFree=24855672/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1125720 CPUtime=4122.34 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3212120 0 0 0 411581 653 0 0 25 0 1 0 653758152 1152737280 279989 33554432000 4194304 4409284 140736073657424 18446744073709551615 4230994 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 281430 279989 141 53 0 279853 0
Current children cumulated CPU time (s) 4122.34
Current children cumulated vsize (KiB) 1125720

[startup+4182.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/350 5707
/proc/meminfo: memFree=24741408/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1262840 CPUtime=4182.36 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3246400 0 0 0 417577 659 0 0 25 0 1 0 653758152 1293148160 314269 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358347 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 315710 314269 141 53 0 314133 0
Current children cumulated CPU time (s) 4182.36
Current children cumulated vsize (KiB) 1262840

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/350 5709
/proc/meminfo: memFree=24737268/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1262840 CPUtime=4242.34 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3246400 0 0 0 423570 664 0 0 25 0 1 0 653758152 1293148160 314269 33554432000 4194304 4409284 140736073657424 18446744073709551615 216634539927 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 315710 314269 141 53 0 314133 0
Current children cumulated CPU time (s) 4242.34
Current children cumulated vsize (KiB) 1262840

[startup+4302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/350 5710
/proc/meminfo: memFree=24721968/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1262840 CPUtime=4302.35 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3246400 0 0 0 429567 668 0 0 25 0 1 0 653758152 1293148160 314269 33554432000 4194304 4409284 140736073657424 18446744073709551615 4259235 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 315710 314269 141 53 0 314133 0
Current children cumulated CPU time (s) 4302.35
Current children cumulated vsize (KiB) 1262840

[startup+4362.3 s]
/proc/loadavg: 2.12 2.03 2.01 3/350 5712
/proc/meminfo: memFree=24077620/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1871052 CPUtime=4362.34 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3465182 0 0 0 435542 692 0 0 25 0 1 0 653758152 1915957248 466322 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 467763 466322 141 53 0 466186 0
Current children cumulated CPU time (s) 4362.34
Current children cumulated vsize (KiB) 1871052

[startup+4422.3 s]
/proc/loadavg: 2.15 2.05 2.01 3/350 5714
/proc/meminfo: memFree=24018052/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1994564 CPUtime=4422.34 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3711837 0 0 0 441514 720 0 0 25 0 1 0 653758152 2042433536 497200 33554432000 4194304 4409284 140736073657424 18446744073709551615 4256972 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 4422.34
Current children cumulated vsize (KiB) 1994564

[startup+4482.3 s]
/proc/loadavg: 2.05 2.04 2.01 3/350 5715
/proc/meminfo: memFree=23997924/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1994564 CPUtime=4482.34 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3711837 0 0 0 447510 724 0 0 25 0 1 0 653758152 2042433536 497200 33554432000 4194304 4409284 140736073657424 18446744073709551615 4226446 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 4482.34
Current children cumulated vsize (KiB) 1994564

[startup+4542.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/350 5717
/proc/meminfo: memFree=23984724/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1994564 CPUtime=4542.35 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3711837 0 0 0 453506 729 0 0 25 0 1 0 653758152 2042433536 497200 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358572 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 4542.35
Current children cumulated vsize (KiB) 1994564

[startup+4602.3 s]
/proc/loadavg: 2.59 2.17 2.05 5/357 8360
/proc/meminfo: memFree=23944428/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1994564 CPUtime=4602.35 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3711837 0 0 0 459502 733 0 0 25 0 1 0 653758152 2042433536 497200 33554432000 4194304 4409284 140736073657424 18446744073709551615 4350659 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 4602.35
Current children cumulated vsize (KiB) 1994564

[startup+4662.3 s]
/proc/loadavg: 1.68 1.99 1.99 2/344 11740
/proc/meminfo: memFree=24669812/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1427148 CPUtime=4662.36 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3711837 0 0 0 465499 737 0 0 25 0 1 0 653758152 1461399552 355346 33554432000 4194304 4409284 140736073657424 18446744073709551615 4305924 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 356787 355346 141 53 0 355210 0
Current children cumulated CPU time (s) 4662.36
Current children cumulated vsize (KiB) 1427148

[startup+4722.3 s]
/proc/loadavg: 1.25 1.81 1.93 2/344 11742
/proc/meminfo: memFree=24735260/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=1362688 CPUtime=4722.36 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3711837 0 0 0 471499 737 0 0 25 0 1 0 653758152 1395392512 339231 33554432000 4194304 4409284 140736073657424 18446744073709551615 4248769 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 340672 339231 141 53 0 339095 0
Current children cumulated CPU time (s) 4722.36
Current children cumulated vsize (KiB) 1362688

[startup+4782.3 s]
/proc/loadavg: 1.09 1.66 1.87 2/344 11743
/proc/meminfo: memFree=23663112/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=2433304 CPUtime=4782.35 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3980165 0 0 0 477466 769 0 0 25 0 1 0 653758152 2491703296 606885 33554432000 4194304 4409284 140736073657424 18446744073709551615 4230803 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 608326 606885 141 53 0 606749 0
Current children cumulated CPU time (s) 4782.35
Current children cumulated vsize (KiB) 2433304

[startup+4842.31 s]
/proc/loadavg: 1.03 1.54 1.81 2/344 11745
/proc/meminfo: memFree=23663200/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=2433304 CPUtime=4842.37 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3980165 0 0 0 483462 775 0 0 25 0 1 0 653758152 2491703296 606885 33554432000 4194304 4409284 140736073657424 18446744073709551615 4351898 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 608326 606885 141 53 0 606749 0
Current children cumulated CPU time (s) 4842.37
Current children cumulated vsize (KiB) 2433304

[startup+4902.3 s]
/proc/loadavg: 1.01 1.44 1.76 2/344 11746
/proc/meminfo: memFree=23663156/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=2433304 CPUtime=4902.36 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3980165 0 0 0 489455 781 0 0 25 0 1 0 653758152 2491703296 606885 33554432000 4194304 4409284 140736073657424 18446744073709551615 4226432 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 608326 606885 141 53 0 606749 0
Current children cumulated CPU time (s) 4902.36
Current children cumulated vsize (KiB) 2433304

[startup+4962.3 s]
/proc/loadavg: 1.08 1.37 1.71 2/344 11748
/proc/meminfo: memFree=23663364/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=2433304 CPUtime=4962.36 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3980165 0 0 0 495450 786 0 0 25 0 1 0 653758152 2491703296 606885 33554432000 4194304 4409284 140736073657424 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 608326 606885 141 53 0 606749 0
Current children cumulated CPU time (s) 4962.36
Current children cumulated vsize (KiB) 2433304



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 1.04 1.32 1.68 2/344 11749
/proc/meminfo: memFree=23663216/32951124 swapFree=53501236/67111528
[pid=5110] ppid=5108 vsize=2433304 CPUtime=5000.06 cores=1,3,5,7
/proc/5110/stat : 5110 (lingeling) R 5108 5110 4220 0 -1 4202496 3980165 0 0 0 499216 790 0 0 25 0 1 0 653758152 2491703296 606885 33554432000 4194304 4409284 140736073657424 18446744073709551615 4358421 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/5110/statm: 608326 606885 141 53 0 606749 0
Current children cumulated CPU time (s) 5000.06
Current children cumulated vsize (KiB) 2433304

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5000.1
CPU time (s): 5000.17
CPU user time (s): 4992.17
CPU system time (s): 7.99578
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 3380776

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4992.17
system time used= 7.99578
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3980165
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 57590

runsolver used 15.3647 second user time and 39.193 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-15 03:05:55
IDJOB=3372409
IDBENCH=82367
IDSOLVER=1850
FILE ID=node103/3372409-1305421552
RUNJOBID= node103-1305420880-4899
PBS_JOBID= 13324557
Free space on /tmp= 72896 MiB

SOLVER NAME= Lingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372409-1305421552/watcher-3372409-1305421552 -o /tmp/evaluation-result-3372409-1305421552/solver-3372409-1305421552 -C 5000 -W 5100 -M 15500  lingeling HOME/instance-3372409-1305421552.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fce318b20c1a474ab81b77594d3f6f99
RANDOM SEED=1202942686

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26026672 kB
Buffers:        306752 kB
Cached:        4012220 kB
SwapCached:     340192 kB
Active:        1487728 kB
Inactive:      5162232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26026672 kB
SwapTotal:    67111528 kB
SwapFree:     53501236 kB
Dirty:           97692 kB
Writeback:           0 kB
AnonPages:     2001260 kB
Mapped:          11056 kB
Slab:           154860 kB
PageTables:      53084 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 78375384 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72952 MiB
End job on node103 at 2011-05-15 04:29:17