Trace number 3317926

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4749.83 1300.08

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00X23.cnf
MD5SUM9cec6483d4ca03e8555377ba059b61ae
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2133873
Sum of the clauses size18060684
Maximum clause length91
Minimum clause length1
Number of clauses of size 116
Number of clauses of size 240913
Number of clauses of size 337518
Number of clauses of size 422333
Number of clauses of size 5147683
Number of clauses of size over 51885410

Solver Data 

0.30/0.48	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.30/0.48	c INFO: solving HOME/instance-3317926-1304270801.cnf
0.30/0.48	c INFO: computing task features
17.79/17.97	c INFO: computed variable-clause graph statistics
18.28/18.42	c INFO: computed clause balance statistics
110.68/110.84	c INFO: computed variable balance statistics
140.18/140.31	c INFO: computed small-clause counts
140.29/140.47	c INFO: computed Horn-clause counts
144.30/144.49	c INFO: computed variable graph statistics
144.39/144.51	c INFO: collected features for HOME/instance-3317926-1304270801.cnf in 143.47 s
144.39/144.53	c INFO: running lingeling-276@0 for 97 with 4655 remaining (b = 0.24)
144.39/144.56	c INFO: running cryptominisat-2.9.0@0 for 485 with 4655 remaining (b = 0.19)
144.39/144.59	c INFO: running SApperloT@0 for 97 with 4655 remaining (b = 0.03)
144.48/144.62	c INFO: running lingeling-276@0 for 291 with 4655 remaining (b = 0.10)
540.03/243.77	c INFO: running lingeling-276@0 for 1164 with 4556 remaining (b = 0.28)
544.42/244.84	c INFO: running precosat-570@0 for 291 with 4555 remaining (b = 0.17)
1312.32/437.23	c INFO: running lingeling-276@98 for 1164 with 4363 remaining (b = 0.28)
1728.24/541.46	c INFO: running lingeling-276@0 for 97 with 4259 remaining (b = 0.11)
2086.98/631.35	c INFO: running cryptominisat-2.9.0@0 for 388 with 4169 remaining (b = 0.09)
2128.47/641.70	c INFO: running cryptominisat-2.9.0@0 for 485 with 4158 remaining (b = 0.11)
3631.69/1019.27	c INFO: running lingeling-276@486 for 97 with 3781 remaining (b = 0.02)
4018.73/1116.47	c INFO: running lingeling-276@0 for 97 with 3684 remaining (b = 0.08)
4085.62/1133.28	c INFO: running cryptominisat-2.9.0@387 for 194 with 3667 remaining (b = 0.04)
4418.09/1216.71	c INFO: running cryptominisat-2.9.0@99 for 3298 with 3583 remaining (b = 0.41)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317926-1304270801/watcher-3317926-1304270801 -o /tmp/evaluation-result-3317926-1304270801/solver-3317926-1304270801 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317926-1304270801.cnf -seed 2018229040 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.40 8.88 9.32 4/263 28961
/proc/meminfo: memFree=29668968/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=15780 CPUtime=0 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 896 0 0 0 0 0 0 0 20 0 1 0 519495978 16158720 777 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338381824 0 2147483391 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 3945 777 343 364 0 432 0

[startup+0.0536109 s]
/proc/loadavg: 6.40 8.88 9.32 4/263 28961
/proc/meminfo: memFree=29668968/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=29792 CPUtime=0.03 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 1461 0 0 0 3 0 0 0 17 0 1 0 519495978 30507008 1300 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338381824 0 2147483391 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 7448 1300 443 364 0 818 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29792

[startup+0.100579 s]
/proc/loadavg: 6.40 8.88 9.32 4/263 28961
/proc/meminfo: memFree=29668968/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=102012 CPUtime=0.06 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 27821 0 -1 4202496 3026 0 0 0 5 1 0 0 17 0 1 0 519495978 104460288 2717 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338381824 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/28961/statm: 25504 2718 841 364 0 1804 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 102012

[startup+0.300541 s]
/proc/loadavg: 6.40 8.88 9.32 4/263 28961
/proc/meminfo: memFree=29668968/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=157384 CPUtime=0.22 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 6597 934 1 0 16 6 0 0 17 0 1 0 519495978 161161216 4696 33554432000 4194304 5683644 140736756360432 18446744073709551615 4532146 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 157384

[startup+0.70046 s]
/proc/loadavg: 6.40 8.88 9.32 4/263 28961
/proc/meminfo: memFree=29668968/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=385140 CPUtime=0.59 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 35950 934 1 0 45 14 0 0 17 0 1 0 519495978 394383360 33628 33554432000 4194304 5683644 140736756360432 18446744073709551615 4602436 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 96285 33630 1761 364 0 32209 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 385140

[startup+1.5003 s]
/proc/loadavg: 6.40 8.88 9.32 5/264 28966
/proc/meminfo: memFree=29532436/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=405604 CPUtime=1.39 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 40968 934 1 0 124 15 0 0 18 0 1 0 519495978 415338496 38646 33554432000 4194304 5683644 140736756360432 18446744073709551615 4943939 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 101401 38646 1761 364 0 37325 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 405604

[startup+3.10098 s]
/proc/loadavg: 6.40 8.88 9.32 5/264 28966
/proc/meminfo: memFree=29491876/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=498408 CPUtime=2.99 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 63910 934 1 0 282 17 0 0 21 0 1 0 519495978 510369792 61588 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338044613 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 124602 61588 1761 364 0 60526 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 498408

[startup+6.30035 s]
/proc/loadavg: 6.45 8.85 9.30 8/276 28978
/proc/meminfo: memFree=29197336/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=710208 CPUtime=6.19 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 114778 934 1 0 595 24 0 0 25 0 1 0 519495978 727252992 112456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338044613 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 177552 112456 1761 364 0 113476 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 710208

[startup+12.7011 s]
/proc/loadavg: 6.58 8.83 9.30 5/264 29010
/proc/meminfo: memFree=28820384/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=1111752 CPUtime=12.58 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 214718 934 1 0 1222 36 0 0 25 0 1 0 519495978 1138434048 212396 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338044613 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 277938 212396 1761 364 0 213862 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 1111752

[startup+25.5005 s]
/proc/loadavg: 6.00 8.60 9.21 5/264 29010
/proc/meminfo: memFree=28561840/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=1270700 CPUtime=25.39 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 438625 934 1 0 2478 61 0 0 25 0 1 0 519495978 1301196800 255091 33554432000 4194304 5683644 140736756360432 18446744073709551615 47574367693820 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 317675 255091 1826 364 0 253599 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 1270700

[startup+51.1005 s]
/proc/loadavg: 6.17 8.42 9.14 8/276 29023
/proc/meminfo: memFree=28327264/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=1270700 CPUtime=50.98 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 438625 934 1 0 5037 61 0 0 25 0 1 0 519495978 1301196800 255091 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338042013 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 317675 255091 1826 364 0 253599 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 1270700

[startup+102.3 s]
/proc/loadavg: 6.70 8.21 9.03 8/276 29024
/proc/meminfo: memFree=28150468/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=1270700 CPUtime=102.18 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 27821 0 -1 4202496 438625 934 1 0 10157 61 0 0 25 0 1 0 519495978 1301196800 255091 33554432000 4194304 5683644 140736756360432 18446744073709551615 47574367651809 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/28961/statm: 317675 255091 1826 364 0 253599 0
Current children cumulated CPU time (s) 102.18
Current children cumulated vsize (KiB) 1270700

[startup+162.301 s]
/proc/loadavg: 6.76 7.96 8.89 8/276 29075
/proc/meminfo: memFree=27209832/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=816912 CPUtime=144.52 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 27821 0 -1 4202496 458018 934 1 0 14382 70 0 0 20 0 5 0 519495978 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 204228 131456 1881 364 0 140137 0
[pid=29054] ppid=28961 vsize=775900 CPUtime=0.03 cores=1,3,5,7
/proc/29054/stat : 29054 (python) S 28961 28961 27821 0 -1 4202560 997 0 0 0 2 1 0 0 18 0 1 0 519510431 794521600 129940 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403855 0 0 16781312 514 13996695060658225416 0 0 17 7 0 0 0
/proc/29054/statm: 193975 129940 381 364 0 129893 0
[pid=29056] ppid=29054 vsize=217772 CPUtime=17.66 cores=1,3,5,7
/proc/29056/stat : 29056 (lingeling) R 29054 29056 29056 0 -1 4202496 102657 0 0 0 1748 18 0 0 25 0 1 0 519510432 222998528 53607 33554432000 4194304 4352236 140735736227760 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/29056/statm: 54443 53607 129 39 0 53523 0
[pid=29057] ppid=28961 vsize=786156 CPUtime=0.03 cores=1,3,5,7
/proc/29057/stat : 29057 (python) S 28961 28961 27821 0 -1 4202560 932 0 0 0 1 2 0 0 15 0 1 0 519510434 805023744 129933 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 13996695060658225413 0 0 17 1 0 0 0
/proc/29057/statm: 196539 129933 370 364 0 132454 0
[pid=29059] ppid=29057 vsize=781212 CPUtime=17.69 cores=1,3,5,7
/proc/29059/stat : 29059 (cryptominisat-2) R 29057 29059 29059 0 -1 4202496 162914 0 0 0 1747 22 0 0 25 0 1 0 519510435 799961088 162385 33554432000 4194304 4677096 140734101359344 18446744073709551615 4502834 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29059/statm: 195303 162385 378 118 0 190262 0
[pid=29060] ppid=28961 vsize=796412 CPUtime=0.04 cores=1,3,5,7
/proc/29060/stat : 29060 (python) S 28961 28961 27821 0 -1 4202560 936 0 0 0 1 3 0 0 18 0 1 0 519510437 815525888 129937 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 13996695060658225412 0 0 17 7 0 0 0
/proc/29060/statm: 199103 129937 370 364 0 135015 0
[pid=29062] ppid=29060 vsize=227836 CPUtime=17.45 cores=1,3,5,7
/proc/29062/stat : 29062 (SApperloT-base) R 29060 29062 29062 0 -1 4202496 52613 0 0 0 1729 16 0 0 25 0 1 0 519510438 233304064 51392 33554432000 134512640 135674940 4289772816 18446744073709551615 134564674 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29062/statm: 56959 51392 99 284 0 56673 0
[pid=29063] ppid=28961 vsize=806668 CPUtime=0.03 cores=1,3,5,7
/proc/29063/stat : 29063 (python) S 28961 28961 27821 0 -1 4202560 954 0 0 0 2 1 0 0 18 0 1 0 519510440 826028032 129941 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 13996695060658225414 0 0 17 1 0 0 0
/proc/29063/statm: 201667 129941 370 364 0 137576 0
[pid=29065] ppid=29063 vsize=226152 CPUtime=17.65 cores=1,3,5,7
/proc/29065/stat : 29065 (lingeling) R 29063 29065 29065 0 -1 4202496 105016 0 0 0 1747 18 0 0 25 0 1 0 519510441 231579648 55702 33554432000 4194304 4352236 140737215314848 18446744073709551615 4235610 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/29065/statm: 56538 55702 129 39 0 55618 0
[pid=28961/tid=29055] ppid=28959 vsize=816912 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29055/stat : 29055 (python) S 28959 28961 27821 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 519510432 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 3 0 0 0
[pid=28961/tid=29058] ppid=28959 vsize=816912 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29058/stat : 29058 (python) S 28959 28961 27821 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 519510435 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 7 0 0 0
[pid=28961/tid=29061] ppid=28959 vsize=816912 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29061/stat : 29061 (python) S 28959 28961 27821 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 5 0 519510438 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 7 0 0 0
[pid=28961/tid=29064] ppid=28959 vsize=816912 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29064/stat : 29064 (python) S 28959 28961 27821 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 5 0 519510441 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 215.1
Current children cumulated vsize (KiB) 5435020

[startup+222.301 s]
/proc/loadavg: 6.91 7.78 8.77 8/276 29077
/proc/meminfo: memFree=27062448/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=816912 CPUtime=144.52 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 27821 0 -1 4202496 458018 934 1 0 14382 70 0 0 20 0 5 0 519495978 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 204228 131456 1881 364 0 140137 0
[pid=29054] ppid=28961 vsize=775900 CPUtime=0.15 cores=1,3,5,7
/proc/29054/stat : 29054 (python) S 28961 28961 27821 0 -1 4202560 1026 0 0 0 8 7 0 0 18 0 1 0 519510431 794521600 129940 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403855 0 0 16781312 514 13996695060658225416 0 0 17 7 0 0 0
/proc/29054/statm: 193975 129940 381 364 0 129893 0
[pid=29056] ppid=29054 vsize=357880 CPUtime=77.43 cores=1,3,5,7
/proc/29056/stat : 29056 (lingeling) R 29054 29056 29056 0 -1 4202496 189927 0 0 0 7715 28 0 0 25 0 1 0 519510432 366469120 88634 33554432000 4194304 4352236 140735736227760 18446744073709551615 4245501 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/29056/statm: 89470 88634 129 39 0 88550 0
[pid=29057] ppid=28961 vsize=786156 CPUtime=0.16 cores=1,3,5,7
/proc/29057/stat : 29057 (python) S 28961 28961 27821 0 -1 4202560 955 0 0 0 8 8 0 0 15 0 1 0 519510434 805023744 129933 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 13996695060658225413 0 0 17 1 0 0 0
/proc/29057/statm: 196539 129933 370 364 0 132454 0
[pid=29059] ppid=29057 vsize=781212 CPUtime=77.69 cores=1,3,5,7
/proc/29059/stat : 29059 (cryptominisat-2) R 29057 29059 29059 0 -1 4202496 162914 0 0 0 7747 22 0 0 25 0 1 0 519510435 799961088 162385 33554432000 4194304 4677096 140734101359344 18446744073709551615 4502837 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29059/statm: 195303 162385 378 118 0 190262 0
[pid=29060] ppid=28961 vsize=796412 CPUtime=0.15 cores=1,3,5,7
/proc/29060/stat : 29060 (python) S 28961 28961 27821 0 -1 4202560 964 0 0 0 6 9 0 0 18 0 1 0 519510437 815525888 129937 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 13996695060658225412 0 0 17 7 0 0 0
/proc/29060/statm: 199103 129937 370 364 0 135015 0
[pid=29062] ppid=29060 vsize=254384 CPUtime=76.73 cores=1,3,5,7
/proc/29062/stat : 29062 (SApperloT-base) R 29060 29062 29062 0 -1 4202496 58401 0 0 0 7654 19 0 0 25 0 1 0 519510438 260489216 57180 33554432000 134512640 135674940 4289772816 18446744073709551615 134564271 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29062/statm: 63596 57180 100 284 0 63310 0
[pid=29063] ppid=28961 vsize=806668 CPUtime=0.15 cores=1,3,5,7
/proc/29063/stat : 29063 (python) S 28961 28961 27821 0 -1 4202560 978 0 0 0 7 8 0 0 18 0 1 0 519510440 826028032 129941 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 13996695060658225414 0 0 17 1 0 0 0
/proc/29063/statm: 201667 129941 370 364 0 137576 0
[pid=29065] ppid=29063 vsize=233576 CPUtime=77.64 cores=1,3,5,7
/proc/29065/stat : 29065 (lingeling) R 29063 29065 29065 0 -1 4202496 158832 0 0 0 7740 24 0 0 25 0 1 0 519510441 239181824 57558 33554432000 4194304 4352236 140737215314848 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/29065/statm: 58394 57558 129 39 0 57474 0
[pid=28961/tid=29055] ppid=28959 vsize=816912 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29055/stat : 29055 (python) S 28959 28961 27821 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 519510432 836517888 131456 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 3 0 0 0

################
# More data... #
################

/proc/29062/stat : 29062 (SApperloT-base) T 29060 29062 29062 0 -1 4202496 58413 0 0 0 9877 19 0 0 25 0 1 0 519510438 260489216 57192 33554432000 134512640 135674940 4289772816 18446744073709551615 134564062 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29062/statm: 63596 57192 100 284 0 63310 0
[pid=29060/tid=29079] ppid=28961 vsize=796412 CPUtime=0 cores=1,3,5,7
/proc/29060/task/29079/stat : 29079 (python) S 28961 28961 27821 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 519520460 815525888 129967 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604464875863040 0 0 -1 7 0 0 0
[pid=29063] ppid=28961 vsize=806668 CPUtime=2.31 cores=1,3,5,7
/proc/29063/stat : 29063 (python) S 28961 28961 27821 0 -1 4202560 1177 0 0 0 122 109 0 0 18 0 2 0 519510440 826028032 129971 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29063/statm: 201667 129971 399 364 0 137576 0
[pid=29065] ppid=29063 vsize=242364 CPUtime=1154.72 cores=1,3,5,7
/proc/29065/stat : 29065 (lingeling) R 29063 29065 29065 0 -1 4202496 213504 0 0 0 115440 32 0 0 25 0 1 0 519510441 248180736 59755 33554432000 4194304 4352236 140737215314848 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/29065/statm: 60591 59755 129 39 0 59671 0
[pid=29063/tid=29088] ppid=28961 vsize=806668 CPUtime=0 cores=1,3,5,7
/proc/29063/task/29088/stat : 29088 (python) S 28961 28961 27821 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519539699 826028032 129971 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604466058689280 0 0 -1 3 0 0 0
[pid=29080] ppid=28961 vsize=816924 CPUtime=0.6 cores=1,3,5,7
/proc/29080/stat : 29080 (python) S 28961 28961 27821 0 -1 4202560 1174 0 0 0 30 30 0 0 19 0 2 0 519520462 836530176 129975 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29080/statm: 204231 129975 399 364 0 140137 0
[pid=29082] ppid=29080 vsize=517172 CPUtime=295.41 cores=1,3,5,7
/proc/29082/stat : 29082 (precosat) T 29080 29082 29082 0 -1 4202496 165559 0 0 0 29509 32 0 0 25 0 1 0 519520464 529584128 129063 33554432000 4194304 4890832 140736894549216 18446744073709551615 4238565 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/29082/statm: 129293 129063 86 171 0 129120 0
[pid=29080/tid=29092] ppid=28961 vsize=816924 CPUtime=0 cores=1,3,5,7
/proc/29080/task/29092/stat : 29092 (python) S 28961 28961 27821 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519550122 836530176 129975 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604467451213952 0 0 -1 1 0 0 0
[pid=29093] ppid=28961 vsize=827180 CPUtime=0.41 cores=1,3,5,7
/proc/29093/stat : 29093 (python) S 28961 28961 27821 0 -1 4202560 1164 0 0 0 22 19 0 0 18 0 2 0 519550124 847032320 129979 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29093/statm: 206795 129979 399 364 0 142698 0
[pid=29095] ppid=29093 vsize=229912 CPUtime=196.82 cores=1,3,5,7
/proc/29095/stat : 29095 (lingeling) T 29093 29095 29095 0 -1 4202496 191417 0 0 0 19652 30 0 0 25 0 1 0 519550125 235429888 56642 33554432000 4194304 4352236 140733379968336 18446744073709551615 4328055 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29095/statm: 57478 56642 129 39 0 56558 0
[pid=29093/tid=29100] ppid=28961 vsize=827180 CPUtime=0 cores=1,3,5,7
/proc/29093/task/29100/stat : 29100 (python) S 28961 28961 27821 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 519560146 847032320 129979 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604467451213056 0 0 -1 5 0 0 0
[pid=29101] ppid=28961 vsize=837436 CPUtime=1.34 cores=1,3,5,7
/proc/29101/stat : 29101 (python) S 28961 28961 27821 0 -1 4202560 1183 0 0 0 73 61 0 0 15 0 2 0 519560148 857534464 129983 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29101/statm: 209359 129983 399 364 0 145259 0
[pid=29103] ppid=29101 vsize=850032 CPUtime=654.38 cores=1,3,5,7
/proc/29103/stat : 29103 (cryptominisat-2) R 29101 29103 29103 0 -1 4202496 223951 0 0 0 65402 36 0 0 25 0 1 0 519560149 870432768 174733 33554432000 4194304 4677096 140733382063856 18446744073709551615 4502837 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/29103/statm: 212508 174733 388 118 0 207467 0
[pid=29101/tid=29120] ppid=28961 vsize=837436 CPUtime=0 cores=1,3,5,7
/proc/29101/task/29120/stat : 29120 (python) S 28961 28961 27821 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 519609304 857534464 129983 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604458722976832 0 0 -1 1 0 0 0
[pid=29116] ppid=28961 vsize=847692 CPUtime=0.21 cores=1,3,5,7
/proc/29116/stat : 29116 (python) S 28961 28961 27821 0 -1 4202560 1186 0 0 0 11 10 0 0 19 0 2 0 519607626 868036608 129993 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29116/statm: 211923 129993 405 364 0 147820 0
[pid=29118] ppid=29116 vsize=301232 CPUtime=100.08 cores=1,3,5,7
/proc/29118/stat : 29118 (lingeling) T 29116 29118 29118 0 -1 4202496 189833 0 0 0 9975 33 0 0 25 0 1 0 519607627 308461568 74472 33554432000 4194304 4352236 140735360747264 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29118/statm: 75308 74472 129 39 0 74388 0
[pid=29116/tid=29123] ppid=28961 vsize=847692 CPUtime=0 cores=1,3,5,7
/proc/29116/task/29123/stat : 29123 (python) S 28961 28961 27821 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519617647 868036608 129993 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604471134476352 0 0 -1 5 0 0 0
[pid=28961/tid=29055] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29055/stat : 29055 (python) S 28959 28961 27821 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 9 0 519510432 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 3 0 0 0
[pid=28961/tid=29058] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29058/stat : 29058 (python) S 28959 28961 27821 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 9 0 519510435 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 7 0 0 0
[pid=28961/tid=29061] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29061/stat : 29061 (python) S 28959 28961 27821 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 9 0 519510438 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 7 0 0 0
[pid=28961/tid=29064] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29064/stat : 29064 (python) S 28959 28961 27821 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 519510441 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29081] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29081/stat : 29081 (python) S 28959 28961 27821 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 9 0 519520463 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29094] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29094/stat : 29094 (python) S 28959 28961 27821 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 519550125 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29102] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29102/stat : 29102 (python) S 28959 28961 27821 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 9 0 519560149 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29117] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29117/stat : 29117 (python) S 28959 28961 27821 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 9 0 519607627 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4749.83
Current children cumulated vsize (KiB) 10849488

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 7.11 7.13 7.60 8/296 29125
/proc/meminfo: memFree=25331224/32951124 swapFree=67111356/67111528
[pid=28961] ppid=28959 vsize=857936 CPUtime=144.79 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 27821 0 -1 4202496 462060 934 1 0 14405 74 0 0 18 0 9 0 519495978 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 214484 131481 1890 364 0 150381 0
[pid=29054] ppid=28961 vsize=786144 CPUtime=2.34 cores=1,3,5,7
/proc/29054/stat : 29054 (python) S 28961 28961 27821 0 -1 4202560 1225 0 0 0 125 109 0 0 18 0 2 0 519510431 805011456 129979 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29054/statm: 196536 129979 415 364 0 132454 0
[pid=29056] ppid=29054 vsize=239548 CPUtime=1137.41 cores=1,3,5,7
/proc/29056/stat : 29056 (lingeling) R 29054 29056 29056 0 -1 4202496 194983 0 0 0 113712 29 0 0 25 0 1 0 519510432 245297152 59051 33554432000 4194304 4352236 140735736227760 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/29056/statm: 59887 59051 129 39 0 58967 0
[pid=29054/tid=29078] ppid=28961 vsize=786144 CPUtime=0 cores=1,3,5,7
/proc/29054/task/29078/stat : 29078 (python) S 28961 28961 27821 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 519520353 805011456 129979 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604465440285120 0 0 -1 7 0 0 0
[pid=29057] ppid=28961 vsize=786156 CPUtime=1.94 cores=1,3,5,7
/proc/29057/stat : 29057 (python) S 28961 28961 27821 0 -1 4202560 1149 0 0 0 104 90 0 0 15 0 2 0 519510434 805023744 129963 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29057/statm: 196539 129963 399 364 0 132454 0
[pid=29059] ppid=29057 vsize=852296 CPUtime=957.9 cores=1,3,5,7
/proc/29059/stat : 29059 (cryptominisat-2) R 29057 29059 29059 0 -1 4202496 243271 0 0 0 95756 34 0 0 25 0 1 0 519510435 872751104 176061 33554432000 4194304 4677096 140734101359344 18446744073709551615 4502821 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29059/statm: 213074 176061 388 118 0 208033 0
[pid=29057/tid=29099] ppid=28961 vsize=786156 CPUtime=0 cores=1,3,5,7
/proc/29057/task/29099/stat : 29099 (python) S 28961 28961 27821 0 -1 4202560 44 0 0 0 0 0 0 0 15 0 2 0 519559111 805023744 129963 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604462874806272 0 0 -1 1 0 0 0
[pid=29060] ppid=28961 vsize=796412 CPUtime=0.21 cores=1,3,5,7
/proc/29060/stat : 29060 (python) S 28961 28961 27821 0 -1 4202560 1128 0 0 0 9 12 0 0 19 0 2 0 519510437 815525888 129967 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29060/statm: 199103 129967 399 364 0 135015 0
[pid=29062] ppid=29060 vsize=254384 CPUtime=98.96 cores=1,3,5,7
/proc/29062/stat : 29062 (SApperloT-base) T 29060 29062 29062 0 -1 4202496 58413 0 0 0 9877 19 0 0 25 0 1 0 519510438 260489216 57192 33554432000 134512640 135674940 4289772816 18446744073709551615 134564062 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29062/statm: 63596 57192 100 284 0 63310 0
[pid=29060/tid=29079] ppid=28961 vsize=796412 CPUtime=0 cores=1,3,5,7
/proc/29060/task/29079/stat : 29079 (python) S 28961 28961 27821 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 519520460 815525888 129967 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604464875863040 0 0 -1 7 0 0 0
[pid=29063] ppid=28961 vsize=806668 CPUtime=2.31 cores=1,3,5,7
/proc/29063/stat : 29063 (python) S 28961 28961 27821 0 -1 4202560 1177 0 0 0 122 109 0 0 18 0 2 0 519510440 826028032 129971 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29063/statm: 201667 129971 399 364 0 137576 0
[pid=29065] ppid=29063 vsize=242364 CPUtime=1154.72 cores=1,3,5,7
/proc/29065/stat : 29065 (lingeling) R 29063 29065 29065 0 -1 4202496 213504 0 0 0 115440 32 0 0 25 0 1 0 519510441 248180736 59755 33554432000 4194304 4352236 140737215314848 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/29065/statm: 60591 59755 129 39 0 59671 0
[pid=29063/tid=29088] ppid=28961 vsize=806668 CPUtime=0 cores=1,3,5,7
/proc/29063/task/29088/stat : 29088 (python) S 28961 28961 27821 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519539699 826028032 129971 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604466058689280 0 0 -1 3 0 0 0
[pid=29080] ppid=28961 vsize=816924 CPUtime=0.6 cores=1,3,5,7
/proc/29080/stat : 29080 (python) S 28961 28961 27821 0 -1 4202560 1174 0 0 0 30 30 0 0 19 0 2 0 519520462 836530176 129975 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29080/statm: 204231 129975 399 364 0 140137 0
[pid=29082] ppid=29080 vsize=517172 CPUtime=295.41 cores=1,3,5,7
/proc/29082/stat : 29082 (precosat) T 29080 29082 29082 0 -1 4202496 165559 0 0 0 29509 32 0 0 25 0 1 0 519520464 529584128 129063 33554432000 4194304 4890832 140736894549216 18446744073709551615 4238565 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/29082/statm: 129293 129063 86 171 0 129120 0
[pid=29080/tid=29092] ppid=28961 vsize=816924 CPUtime=0 cores=1,3,5,7
/proc/29080/task/29092/stat : 29092 (python) S 28961 28961 27821 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519550122 836530176 129975 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604467451213952 0 0 -1 1 0 0 0
[pid=29093] ppid=28961 vsize=827180 CPUtime=0.41 cores=1,3,5,7
/proc/29093/stat : 29093 (python) S 28961 28961 27821 0 -1 4202560 1164 0 0 0 22 19 0 0 18 0 2 0 519550124 847032320 129979 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29093/statm: 206795 129979 399 364 0 142698 0
[pid=29095] ppid=29093 vsize=229912 CPUtime=196.82 cores=1,3,5,7
/proc/29095/stat : 29095 (lingeling) T 29093 29095 29095 0 -1 4202496 191417 0 0 0 19652 30 0 0 25 0 1 0 519550125 235429888 56642 33554432000 4194304 4352236 140733379968336 18446744073709551615 4328055 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29095/statm: 57478 56642 129 39 0 56558 0
[pid=29093/tid=29100] ppid=28961 vsize=827180 CPUtime=0 cores=1,3,5,7
/proc/29093/task/29100/stat : 29100 (python) S 28961 28961 27821 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 519560146 847032320 129979 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604467451213056 0 0 -1 5 0 0 0
[pid=29101] ppid=28961 vsize=837436 CPUtime=1.34 cores=1,3,5,7
/proc/29101/stat : 29101 (python) S 28961 28961 27821 0 -1 4202560 1183 0 0 0 73 61 0 0 15 0 2 0 519560148 857534464 129983 33554432000 4194304 5683644 140736756360432 18446744073709551615 270338403910 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29101/statm: 209359 129983 399 364 0 145259 0
[pid=29103] ppid=29101 vsize=850032 CPUtime=654.38 cores=1,3,5,7
/proc/29103/stat : 29103 (cryptominisat-2) R 29101 29103 29103 0 -1 4202496 223951 0 0 0 65402 36 0 0 25 0 1 0 519560149 870432768 174733 33554432000 4194304 4677096 140733382063856 18446744073709551615 4502837 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/29103/statm: 212508 174733 388 118 0 207467 0
[pid=29101/tid=29120] ppid=28961 vsize=837436 CPUtime=0 cores=1,3,5,7
/proc/29101/task/29120/stat : 29120 (python) S 28961 28961 27821 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 519609304 857534464 129983 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604458722976832 0 0 -1 1 0 0 0
[pid=29116] ppid=28961 vsize=847692 CPUtime=0.21 cores=1,3,5,7
/proc/29116/stat : 29116 (python) S 28961 28961 27821 0 -1 4202560 1186 0 0 0 11 10 0 0 19 0 2 0 519607626 868036608 129993 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350210507 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29116/statm: 211923 129993 405 364 0 147820 0
[pid=29118] ppid=29116 vsize=301232 CPUtime=100.08 cores=1,3,5,7
/proc/29118/stat : 29118 (lingeling) T 29116 29118 29118 0 -1 4202496 189833 0 0 0 9975 33 0 0 25 0 1 0 519607627 308461568 74472 33554432000 4194304 4352236 140735360747264 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29118/statm: 75308 74472 129 39 0 74388 0
[pid=29116/tid=29123] ppid=28961 vsize=847692 CPUtime=0 cores=1,3,5,7
/proc/29116/task/29123/stat : 29123 (python) S 28961 28961 27821 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519617647 868036608 129993 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 514 18446604471134476352 0 0 -1 5 0 0 0
[pid=28961/tid=29055] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29055/stat : 29055 (python) S 28959 28961 27821 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 9 0 519510432 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 3 0 0 0
[pid=28961/tid=29058] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29058/stat : 29058 (python) S 28959 28961 27821 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 9 0 519510435 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 7 0 0 0
[pid=28961/tid=29061] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29061/stat : 29061 (python) S 28959 28961 27821 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 9 0 519510438 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 7 0 0 0
[pid=28961/tid=29064] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29064/stat : 29064 (python) S 28959 28961 27821 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 519510441 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29081] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29081/stat : 29081 (python) S 28959 28961 27821 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 9 0 519520463 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29094] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29094/stat : 29094 (python) S 28959 28961 27821 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 519550125 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29102] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29102/stat : 29102 (python) S 28959 28961 27821 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 9 0 519560149 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
[pid=28961/tid=29117] ppid=28959 vsize=857936 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29117/stat : 29117 (python) S 28959 28961 27821 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 9 0 519607627 878526464 131481 33554432000 4194304 5683644 140736756360432 18446744073709551615 270350207409 0 0 16781312 2 18446604468449774464 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4749.83
Current children cumulated vsize (KiB) 10849488

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28961 and gives
#  childrusage.ru_utime.tv_sec=144
#  childrusage.ru_utime.tv_usec=52100
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=772882
# CPU time returned by wait4() is 144.825
# while last known CPU time is 4749.83
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.08
CPU time (s): 4749.83
CPU user time (s): 4742.24
CPU system time (s): 7.59
CPU usage (%): 365.348
Max. virtual memory (cumulated for all children) (KiB): 10979264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 144.052
system time used= 0.772882
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 462998
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1051
involuntary context switches= 1735

runsolver used 5.13322 second user time and 12.3161 second system time

The end

Launcher Data 

Begin job on node143 at 2011-05-01 19:26:43
IDJOB=3317926
IDBENCH=83463
IDSOLVER=1706
FILE ID=node143/3317926-1304270801
RUNJOBID= node143-1304270801-28938
PBS_JOBID= 13173936
Free space on /tmp= 73404 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00X23.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317926-1304270801/watcher-3317926-1304270801 -o /tmp/evaluation-result-3317926-1304270801/solver-3317926-1304270801 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317926-1304270801.cnf -seed 2018229040 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9cec6483d4ca03e8555377ba059b61ae
RANDOM SEED=2018229040

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29669000 kB
Buffers:        300108 kB
Cached:        1511512 kB
SwapCached:        168 kB
Active:        1760772 kB
Inactive:      1209016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29669000 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:          168220 kB
Writeback:           0 kB
AnonPages:     1158488 kB
Mapped:          26900 kB
Slab:           232328 kB
PageTables:      18024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 42997032 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73312 MiB
End job on node143 at 2011-05-01 19:48:26