Trace number 3380510

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)UNSAT 713.33 90.5373

General information on the benchmark

Nameindustrial/fuhs/medium/
AProVE07-21.cnf
MD5SUM627e3d704e5200c3037f9c9d83c939c1
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark34.3398
Satisfiable
(Un)Satisfiability was proved
Number of variables3189
Number of clauses11039
Sum of the clauses size28509
Maximum clause length25
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 25404
Number of clauses of size 35107
Number of clauses of size 4389
Number of clauses of size 586
Number of clauses of size over 552

Solver Data 

0.34/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.34/0.68	c INFO: solving HOME/instance-3380510-1305481203.cnf
0.34/0.68	c INFO: computing task features
0.41/0.72	c INFO: computed variable-clause graph statistics
0.41/0.72	c INFO: computed clause balance statistics
0.61/0.90	c INFO: computed variable balance statistics
0.72/1.04	c INFO: computed small-clause counts
0.72/1.04	c INFO: computed Horn-clause counts
0.72/1.07	c INFO: computed variable graph statistics
0.72/1.07	c INFO: collected features for HOME/instance-3380510-1305481203.cnf in 0.38 s
0.72/1.09	c INFO: running lingeling-276@0 for 97 with 4999 remaining (b = 0.28)
0.82/1.11	c INFO: running cryptominisat-2.9.0@0 for 485 with 4999 remaining (b = 0.35)
0.82/1.14	c INFO: running lingeling-276@0 for 1261 with 4999 remaining (b = 0.52)
0.82/1.16	c INFO: running lingeling-276@0 for 1261 with 4999 remaining (b = 0.46)
0.82/1.19	c INFO: running SApperloT@0 for 97 with 4999 remaining (b = 0.03)
0.91/1.21	c INFO: running precosat-570@0 for 291 with 4999 remaining (b = 0.17)
0.91/1.24	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4999 remaining (b = 0.48)
0.91/1.26	c INFO: running lingeling-276@0 for 1067 with 4999 remaining (b = 0.33)
624.80/90.51	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380510-1305481203/watcher-3380510-1305481203 -o /tmp/evaluation-result-3380510-1305481203/solver-3380510-1305481203 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380510-1305481203.cnf -seed 993358609 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.02 0.00 2/323 29015
/proc/meminfo: memFree=19945836/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=15752 CPUtime=0 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 838 0 0 0 0 0 0 0 21 0 1 0 659718213 16130048 723 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 6 0 0 0
/proc/29015/statm: 3938 723 334 364 0 425 0

[startup+0.0605209 s]
/proc/loadavg: 0.00 0.02 0.00 2/323 29015
/proc/meminfo: memFree=19945836/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=29788 CPUtime=0.02 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 1413 0 0 0 2 0 0 0 21 0 1 0 659718213 30502912 1258 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 6 0 0 0
/proc/29015/statm: 7447 1258 443 364 0 817 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29788

[startup+0.100515 s]
/proc/loadavg: 0.00 0.02 0.00 2/323 29015
/proc/meminfo: memFree=19945836/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=85620 CPUtime=0.05 cores=0-7
/proc/29015/stat : 29015 (python) R 29013 29015 28989 0 -1 4202496 2628 0 0 0 4 1 0 0 21 0 1 0 659718213 87674880 2348 33554432000 4194304 5683644 140733562532912 18446744073709551615 4859985 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/29015/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85620

[startup+0.300485 s]
/proc/loadavg: 0.00 0.02 0.00 2/323 29015
/proc/meminfo: memFree=19945836/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=135748 CPUtime=0.18 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 5959 933 1 0 13 5 0 0 17 0 1 0 659718213 139005952 4150 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550533637 0 2147483391 16781312 2 18446744071699469502 0 0 17 6 0 0 0
/proc/29015/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700427 s]
/proc/loadavg: 0.00 0.02 0.00 2/323 29015
/proc/meminfo: memFree=19945836/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=279040 CPUtime=0.41 cores=0-7
/proc/29015/stat : 29015 (python) R 29013 29015 28989 0 -1 4202496 9398 933 1 0 30 11 0 0 16 0 1 0 659718213 285736960 7083 33554432000 4194304 5683644 140733562532912 18446744073709551615 4941989 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29015/statm: 69760 7083 1761 364 0 5684 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 279040

[startup+1.50022 s]
/proc/loadavg: 0.00 0.02 0.00 2/324 29020
/proc/meminfo: memFree=19922144/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=427548 CPUtime=0.97 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 15084 933 1 0 85 12 0 0 21 0 9 0 659718213 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29015/statm: 106887 7625 1889 364 0 42784 0
Current children cumulated CPU time (s) 0.97
Current children cumulated vsize (KiB) 427548

[startup+3.10093 s]
/proc/loadavg: 0.00 0.02 0.00 9/348 29044
/proc/meminfo: memFree=19861204/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=427548 CPUtime=0.97 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 15084 933 1 0 85 12 0 0 21 0 9 0 659718213 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29015/statm: 106887 7625 1889 364 0 42784 0
[pid=29021] ppid=29015 vsize=279976 CPUtime=0 cores=0-7
/proc/29021/stat : 29021 (python) S 29015 29015 28989 0 -1 4202560 807 0 0 0 0 0 0 0 18 0 1 0 659718322 286695424 5938 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557711 0 0 16781312 514 1278865068305416191 0 0 17 1 0 0 0
/proc/29021/statm: 69994 5938 359 364 0 5912 0
[pid=29023] ppid=29021 vsize=7884 CPUtime=1.99 cores=0-7
/proc/29023/stat : 29023 (lingeling) R 29021 29023 29023 0 -1 4202496 2011 0 0 0 199 0 0 0 25 0 1 0 659718323 8073216 1173 33554432000 4194304 4352236 140735732414368 18446744073709551615 4329024 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/29023/statm: 1971 1173 129 39 0 1051 0
[pid=29024] ppid=29015 vsize=290232 CPUtime=0 cores=0-7
/proc/29024/stat : 29024 (python) S 29015 29015 28989 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 659718325 297197568 5931 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 5606999089607573763 0 0 17 1 0 0 0
/proc/29024/statm: 72558 5931 348 364 0 8473 0
[pid=29026] ppid=29024 vsize=34340 CPUtime=1.97 cores=0-7
/proc/29026/stat : 29026 (cryptominisat-2) R 29024 29026 29026 0 -1 4202496 3293 0 0 0 197 0 0 0 25 0 1 0 659718325 35164160 1699 33554432000 4194304 4677096 140734850555808 18446744073709551615 4340842 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29026/statm: 8585 1699 392 118 0 3544 0
[pid=29027] ppid=29015 vsize=366024 CPUtime=0 cores=0-7
/proc/29027/stat : 29027 (python) S 29015 29015 28989 0 -1 4202560 704 0 0 0 0 0 0 0 18 0 1 0 659718327 374808576 6012 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 1278868916596113407 0 0 17 1 0 0 0
/proc/29027/statm: 91506 6012 348 364 0 27418 0
[pid=29029] ppid=29027 vsize=7264 CPUtime=1.95 cores=0-7
/proc/29029/stat : 29029 (lingeling) R 29027 29029 29029 0 -1 4202496 1811 0 0 0 195 0 0 0 25 0 1 0 659718327 7438336 986 33554432000 4194304 4352236 140737416128704 18446744073709551615 4327899 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/29029/statm: 1816 986 129 39 0 896 0
[pid=29030] ppid=29015 vsize=376280 CPUtime=0 cores=0-7
/proc/29030/stat : 29030 (python) S 29015 29015 28989 0 -1 4202560 718 0 0 0 0 0 0 0 18 0 1 0 659718329 385310720 6101 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 10460534278386089983 0 0 17 1 0 0 0
/proc/29030/statm: 94070 6101 348 364 0 29979 0
[pid=29032] ppid=29030 vsize=7412 CPUtime=1.92 cores=0-7
/proc/29032/stat : 29032 (lingeling) R 29030 29032 29032 0 -1 4202496 2201 0 0 0 192 0 0 0 25 0 1 0 659718330 7589888 1055 33554432000 4194304 4352236 140733484153024 18446744073709551615 4328559 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29032/statm: 1853 1055 129 39 0 933 0
[pid=29033] ppid=29015 vsize=386536 CPUtime=0 cores=0-7
/proc/29033/stat : 29033 (python) S 29015 29015 28989 0 -1 4202560 722 0 0 0 0 0 0 0 18 0 1 0 659718332 395812864 6105 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 10460530430095392767 0 0 17 1 0 0 0
/proc/29033/statm: 96634 6105 348 364 0 32540 0
[pid=29035] ppid=29033 vsize=4192 CPUtime=1.87 cores=0-7
/proc/29035/stat : 29035 (SApperloT-base) R 29033 29035 29035 0 -1 4202496 1066 0 0 0 187 0 0 0 25 0 1 0 659718332 4292608 810 33554432000 134512640 135674940 4287953568 18446744073709551615 134549348 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29035/statm: 1048 810 99 284 0 762 0
[pid=29036] ppid=29015 vsize=396792 CPUtime=0 cores=0-7
/proc/29036/stat : 29036 (python) S 29015 29015 28989 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 659718334 406315008 6051 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 4825053675795775487 0 0 17 1 0 0 0
/proc/29036/statm: 99198 6051 348 364 0 35101 0
[pid=29038] ppid=29036 vsize=6120 CPUtime=1.86 cores=0-7
/proc/29038/stat : 29038 (precosat) R 29036 29038 29038 0 -1 4202496 1675 0 0 0 186 0 0 0 25 0 1 0 659718335 6266880 1363 33554432000 4194304 4890832 140735430914816 18446744073709551615 4238673 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/29038/statm: 1530 1363 86 171 0 1357 0
[pid=29039] ppid=29015 vsize=407048 CPUtime=0 cores=0-7
/proc/29039/stat : 29039 (python) S 29015 29015 28989 0 -1 4202560 743 0 0 0 0 0 0 0 15 0 1 0 659718337 416817152 6066 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 14939350363910668545 0 0 17 6 0 0 0
/proc/29039/statm: 101762 6066 348 364 0 37662 0
[pid=29043] ppid=29039 vsize=34312 CPUtime=1.83 cores=0-7
/proc/29043/stat : 29043 (cryptominisat-2) R 29039 29043 29043 0 -1 4202496 3126 0 0 0 182 1 0 0 25 0 1 0 659718340 35135488 1623 33554432000 4194304 4677096 140735884144480 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29043/statm: 8578 1623 392 118 0 3537 0
[pid=29041] ppid=29015 vsize=417304 CPUtime=0 cores=0-7
/proc/29041/stat : 29041 (python) S 29015 29015 28989 0 -1 4202560 780 0 0 0 0 0 0 0 18 0 1 0 659718339 427319296 6086 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 5142609676327714815 0 0 17 1 0 0 0
/proc/29041/statm: 104326 6086 354 364 0 40223 0
[pid=29044] ppid=29041 vsize=8084 CPUtime=1.69 cores=0-7
/proc/29044/stat : 29044 (lingeling) R 29041 29044 29044 0 -1 4202496 1998 0 0 0 169 0 0 0 25 0 1 0 659718340 8278016 1223 33554432000 4194304 4352236 140734527414592 18446744073709551615 4328030 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/29044/statm: 2021 1223 129 39 0 1101 0
[pid=29015/tid=29022] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29022/stat : 29022 (python) S 29013 29015 28989 0 -1 4202560 24 933 0 0 0 0 0 0 17 0 9 0 659718322 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29025] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29025/stat : 29025 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 18 0 9 0 659718325 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 3 0 0 0
[pid=29015/tid=29028] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29028/stat : 29028 (python) S 29013 29015 28989 0 -1 4202560 79 933 0 0 0 0 0 0 19 0 9 0 659718327 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 0 0 0 0
[pid=29015/tid=29031] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29031/stat : 29031 (python) S 29013 29015 28989 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 659718330 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 5 0 0 0
[pid=29015/tid=29034] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29034/stat : 29034 (python) S 29013 29015 28989 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 9 0 659718332 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 0 0 0 0
[pid=29015/tid=29037] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29037/stat : 29037 (python) S 29013 29015 28989 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 9 0 659718334 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29040] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29040/stat : 29040 (python) S 29013 29015 28989 0 -1 4202560 47 933 0 0 0 0 0 0 21 0 9 0 659718337 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 6 0 0 0
[pid=29015/tid=29042] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29042/stat : 29042 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 9 0 659718340 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 16.05
Current children cumulated vsize (KiB) 3457348

[startup+6.30135 s]
/proc/loadavg: 0.64 0.15 0.04 9/348 29045
/proc/meminfo: memFree=19840620/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=427548 CPUtime=0.97 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 15084 933 1 0 85 12 0 0 21 0 9 0 659718213 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29015/statm: 106887 7625 1889 364 0 42784 0
[pid=29021] ppid=29015 vsize=279976 CPUtime=0 cores=0-7
/proc/29021/stat : 29021 (python) S 29015 29015 28989 0 -1 4202560 979 0 0 0 0 0 0 0 18 0 1 0 659718322 286695424 5960 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557711 0 0 16781312 514 1278865068305383682 0 0 17 1 0 0 0
/proc/29021/statm: 69994 5960 381 364 0 5912 0
[pid=29023] ppid=29021 vsize=8144 CPUtime=5.18 cores=0-7
/proc/29023/stat : 29023 (lingeling) R 29021 29023 29023 0 -1 4202496 3260 0 0 0 518 0 0 0 25 0 1 0 659718323 8339456 1238 33554432000 4194304 4352236 140735732414368 18446744073709551615 4328336 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/29023/statm: 2036 1238 129 39 0 1116 0
[pid=29024] ppid=29015 vsize=290232 CPUtime=0 cores=0-7
/proc/29024/stat : 29024 (python) S 29015 29015 28989 0 -1 4202560 916 0 0 0 0 0 0 0 15 0 1 0 659718325 297197568 5954 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 3871094572671009027 0 0 17 1 0 0 0
/proc/29024/statm: 72558 5954 371 364 0 8473 0
[pid=29026] ppid=29024 vsize=38992 CPUtime=5.17 cores=0-7
/proc/29026/stat : 29026 (cryptominisat-2) R 29024 29026 29026 0 -1 4202496 5846 0 0 0 516 1 0 0 25 0 1 0 659718325 39927808 2956 33554432000 4194304 4677096 140734850555808 18446744073709551615 271550234260 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29026/statm: 9748 2956 393 118 0 4707 0
[pid=29027] ppid=29015 vsize=366024 CPUtime=0 cores=0-7
/proc/29027/stat : 29027 (python) S 29015 29015 28989 0 -1 4202560 778 0 0 0 0 0 0 0 18 0 1 0 659718327 374808576 6034 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 1278868916596080897 0 0 17 1 0 0 0
/proc/29027/statm: 91506 6034 370 364 0 27418 0
[pid=29029] ppid=29027 vsize=8168 CPUtime=5.14 cores=0-7
/proc/29029/stat : 29029 (lingeling) R 29027 29029 29029 0 -1 4202496 3061 0 0 0 514 0 0 0 25 0 1 0 659718327 8364032 1244 33554432000 4194304 4352236 140737416128704 18446744073709551615 4327863 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/29029/statm: 2042 1244 129 39 0 1122 0
[pid=29030] ppid=29015 vsize=376280 CPUtime=0 cores=0-7
/proc/29030/stat : 29030 (python) S 29015 29015 28989 0 -1 4202560 791 0 0 0 0 0 0 0 18 0 1 0 659718329 385310720 6123 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 10460534278386057476 0 0 17 1 0 0 0
/proc/29030/statm: 94070 6123 370 364 0 29979 0
[pid=29032] ppid=29030 vsize=8064 CPUtime=5.12 cores=0-7
/proc/29032/stat : 29032 (lingeling) R 29030 29032 29032 0 -1 4202496 3228 0 0 0 512 0 0 0 25 0 1 0 659718330 8257536 1218 33554432000 4194304 4352236 140733484153024 18446744073709551615 4328079 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29032/statm: 2016 1218 129 39 0 1096 0
[pid=29033] ppid=29015 vsize=386536 CPUtime=0 cores=0-7
/proc/29033/stat : 29033 (python) S 29015 29015 28989 0 -1 4202560 798 0 0 0 0 0 0 0 18 0 1 0 659718332 395812864 6128 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 10460530430095360259 0 0 17 1 0 0 0
/proc/29033/statm: 96634 6128 371 364 0 32540 0
[pid=29035] ppid=29033 vsize=4852 CPUtime=4.96 cores=0-7
/proc/29035/stat : 29035 (SApperloT-base) R 29033 29035 29035 0 -1 4202496 1232 0 0 0 496 0 0 0 25 0 1 0 659718332 4968448 976 33554432000 134512640 135674940 4287953568 18446744073709551615 134564352 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29035/statm: 1213 976 99 284 0 927 0
[pid=29036] ppid=29015 vsize=396792 CPUtime=0 cores=0-7
/proc/29036/stat : 29036 (python) S 29015 29015 28989 0 -1 4202560 816 0 0 0 0 0 0 0 18 0 1 0 659718334 406315008 6074 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 4825053675795742980 0 0 17 1 0 0 0
/proc/29036/statm: 99198 6074 371 364 0 35101 0
[pid=29038] ppid=29036 vsize=8808 CPUtime=5.02 cores=0-7
/proc/29038/stat : 29038 (precosat) R 29036 29038 29038 0 -1 4202496 2380 0 0 0 502 0 0 0 25 0 1 0 659718335 9019392 2025 33554432000 4194304 4890832 140735430914816 18446744073709551615 4238594 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/29038/statm: 2202 2025 86 171 0 2029 0
[pid=29039] ppid=29015 vsize=407048 CPUtime=0.01 cores=0-7
/proc/29039/stat : 29039 (python) S 29015 29015 28989 0 -1 4202560 828 0 0 0 1 0 0 0 15 0 1 0 659718337 416817152 6089 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 14939350363910668545 0 0 17 6 0 0 0
/proc/29039/statm: 101762 6089 371 364 0 37662 0
[pid=29043] ppid=29039 vsize=39096 CPUtime=5.01 cores=0-7
/proc/29043/stat : 29043 (cryptominisat-2) R 29039 29043 29043 0 -1 4202496 5981 0 0 0 500 1 0 0 25 0 1 0 659718340 40034304 3047 33554432000 4194304 4677096 140735884144480 18446744073709551615 4319860 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29043/statm: 9774 3047 393 118 0 4733 0
[pid=29041] ppid=29015 vsize=417304 CPUtime=0.01 cores=0-7
/proc/29041/stat : 29041 (python) S 29015 29015 28989 0 -1 4202560 861 0 0 0 0 1 0 0 18 0 1 0 659718339 427319296 6108 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 5142609676327682306 0 0 17 1 0 0 0
/proc/29041/statm: 104326 6108 376 364 0 40223 0
[pid=29044] ppid=29041 vsize=9496 CPUtime=4.89 cores=0-7
/proc/29044/stat : 29044 (lingeling) R 29041 29044 29044 0 -1 4202496 3151 0 0 0 489 0 0 0 25 0 1 0 659718340 9723904 1576 33554432000 4194304 4352236 140734527414592 18446744073709551615 4231379 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/29044/statm: 2374 1576 129 39 0 1454 0

################
# More data... #
################

[pid=29015/tid=29037] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29037/stat : 29037 (python) S 29013 29015 28989 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 9 0 659718334 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29040] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29040/stat : 29040 (python) S 29013 29015 28989 0 -1 4202560 47 933 0 0 0 0 0 0 21 0 9 0 659718337 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 6 0 0 0
[pid=29015/tid=29042] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29042/stat : 29042 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 9 0 659718340 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 706.15
Current children cumulated vsize (KiB) 3527036

[startup+90.301 s]
/proc/loadavg: 6.46 2.16 0.76 10/348 29047
/proc/meminfo: memFree=19761712/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=427548 CPUtime=0.97 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 15084 933 1 0 85 12 0 0 21 0 9 0 659718213 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29015/statm: 106887 7625 1889 364 0 42784 0
[pid=29021] ppid=29015 vsize=279976 CPUtime=0.22 cores=0-7
/proc/29021/stat : 29021 (python) S 29015 29015 28989 0 -1 4202560 1018 0 0 0 12 10 0 0 18 0 1 0 659718322 286695424 5961 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557711 0 0 16781312 514 6464319130764804354 0 0 17 1 0 0 0
/proc/29021/statm: 69994 5961 382 364 0 5912 0
[pid=29023] ppid=29021 vsize=19800 CPUtime=89.19 cores=0-7
/proc/29023/stat : 29023 (lingeling) R 29021 29023 29023 0 -1 4202496 19838 0 0 0 8916 3 0 0 25 0 1 0 659718323 20275200 4152 33554432000 4194304 4352236 140735732414368 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/29023/statm: 4950 4152 129 39 0 4030 0
[pid=29024] ppid=29015 vsize=290232 CPUtime=0.24 cores=0-7
/proc/29024/stat : 29024 (python) S 29015 29015 28989 0 -1 4202560 956 0 0 0 13 11 0 0 15 0 1 0 659718325 297197568 5954 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804355 0 0 17 3 0 0 0
/proc/29024/statm: 72558 5954 371 364 0 8473 0
[pid=29026] ppid=29024 vsize=69420 CPUtime=89.09 cores=0-7
/proc/29026/stat : 29026 (cryptominisat-2) R 29024 29026 29026 0 -1 4202496 35701 0 0 0 8899 10 0 0 25 0 1 0 659718325 71086080 9586 33554432000 4194304 4677096 140734850555808 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29026/statm: 17355 9586 393 118 0 12314 0
[pid=29027] ppid=29015 vsize=366024 CPUtime=0.22 cores=0-7
/proc/29027/stat : 29027 (python) S 29015 29015 28989 0 -1 4202560 780 0 0 0 11 11 0 0 18 0 1 0 659718327 374808576 6035 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804353 0 0 17 1 0 0 0
/proc/29027/statm: 91506 6035 371 364 0 27418 0
[pid=29029] ppid=29027 vsize=21624 CPUtime=89.14 cores=0-7
/proc/29029/stat : 29029 (lingeling) R 29027 29029 29029 0 -1 4202496 18521 0 0 0 8912 2 0 0 25 0 1 0 659718327 22142976 4608 33554432000 4194304 4352236 140737416128704 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/29029/statm: 5406 4608 129 39 0 4486 0
[pid=29030] ppid=29015 vsize=376280 CPUtime=0.22 cores=0-7
/proc/29030/stat : 29030 (python) S 29015 29015 28989 0 -1 4202560 792 0 0 0 11 11 0 0 18 0 1 0 659718329 385310720 6124 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804356 0 0 17 1 0 0 0
/proc/29030/statm: 94070 6124 371 364 0 29979 0
[pid=29032] ppid=29030 vsize=20360 CPUtime=89.12 cores=0-7
/proc/29032/stat : 29032 (lingeling) R 29030 29032 29032 0 -1 4202496 18910 0 0 0 8910 2 0 0 25 0 1 0 659718330 20848640 4292 33554432000 4194304 4352236 140733484153024 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29032/statm: 5090 4292 129 39 0 4170 0
[pid=29033] ppid=29015 vsize=386536 CPUtime=0.22 cores=0-7
/proc/29033/stat : 29033 (python) S 29015 29015 28989 0 -1 4202560 798 0 0 0 11 11 0 0 18 0 1 0 659718332 395812864 6128 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804355 0 0 17 1 0 0 0
/proc/29033/statm: 96634 6128 371 364 0 32540 0
[pid=29035] ppid=29033 vsize=8716 CPUtime=87.54 cores=0-7
/proc/29035/stat : 29035 (SApperloT-base) R 29033 29035 29035 0 -1 4202496 2133 0 0 0 8754 0 0 0 25 0 1 0 659718332 8925184 1877 33554432000 134512640 135674940 4287953568 18446744073709551615 134539781 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29035/statm: 2179 1877 100 284 0 1893 0
[pid=29036] ppid=29015 vsize=396792 CPUtime=0.22 cores=0-7
/proc/29036/stat : 29036 (python) S 29015 29015 28989 0 -1 4202560 816 0 0 0 11 11 0 0 18 0 1 0 659718334 406315008 6074 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804356 0 0 17 1 0 0 0
/proc/29036/statm: 99198 6074 371 364 0 35101 0
[pid=29038] ppid=29036 vsize=21928 CPUtime=88.03 cores=0-7
/proc/29038/stat : 29038 (precosat) R 29036 29038 29038 0 -1 4202496 5718 0 0 0 8802 1 0 0 25 0 1 0 659718335 22454272 5313 33554432000 4194304 4890832 140735430914816 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/29038/statm: 5482 5313 86 171 0 5309 0
[pid=29039] ppid=29015 vsize=407048 CPUtime=2.22 cores=0-7
/proc/29039/stat : 29039 (python) R 29015 29015 28989 0 -1 4202560 834 0 0 0 177 45 0 0 18 0 1 0 659718337 416817152 6089 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562367807 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/29039/statm: 101762 6089 371 364 0 37662 0
[pid=29043] ppid=29039 vsize=0 CPUtime=86.78 cores=0-7
/proc/29043/stat : 29043 (cryptominisat-2) R 29039 29043 29043 0 -1 4202500 37205 0 0 0 8670 8 0 0 25 0 1 0 659718340 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29043/statm: 0 0 0 0 0 0 0
[pid=29041] ppid=29015 vsize=417304 CPUtime=0.22 cores=0-7
/proc/29041/stat : 29041 (python) S 29015 29015 28989 0 -1 4202560 862 0 0 0 12 10 0 0 18 0 1 0 659718339 427319296 6109 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804354 0 0 17 1 0 0 0
/proc/29041/statm: 104326 6109 377 364 0 40223 0
[pid=29044] ppid=29041 vsize=19876 CPUtime=88.89 cores=0-7
/proc/29044/stat : 29044 (lingeling) R 29041 29044 29044 0 -1 4202496 18450 0 0 0 8887 2 0 0 25 0 1 0 659718340 20353024 4171 33554432000 4194304 4352236 140734527414592 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/29044/statm: 4969 4171 129 39 0 4049 0
[pid=29015/tid=29022] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29022/stat : 29022 (python) S 29013 29015 28989 0 -1 4202560 24 933 0 0 0 0 0 0 17 0 9 0 659718322 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29025] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29025/stat : 29025 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 18 0 9 0 659718325 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 3 0 0 0
[pid=29015/tid=29028] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29028/stat : 29028 (python) S 29013 29015 28989 0 -1 4202560 79 933 0 0 0 0 0 0 19 0 9 0 659718327 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 0 0 0 0
[pid=29015/tid=29031] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29031/stat : 29031 (python) S 29013 29015 28989 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 659718330 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 5 0 0 0
[pid=29015/tid=29034] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29034/stat : 29034 (python) S 29013 29015 28989 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 9 0 659718332 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 0 0 0 0
[pid=29015/tid=29037] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29037/stat : 29037 (python) S 29013 29015 28989 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 9 0 659718334 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29040] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29040/stat : 29040 (python) S 29013 29015 28989 0 -1 4202560 47 933 0 0 0 0 0 0 21 0 9 0 659718337 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 6 0 0 0
[pid=29015/tid=29042] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29042/stat : 29042 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 9 0 659718340 437809152 7625 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 712.53
Current children cumulated vsize (KiB) 3529464

[startup+90.501 s]
/proc/loadavg: 6.46 2.16 0.76 10/348 29047
/proc/meminfo: memFree=19761712/32951124 swapFree=67056788/67111528
[pid=29015] ppid=29013 vsize=427548 CPUtime=0.97 cores=0-7
/proc/29015/stat : 29015 (python) S 29013 29015 28989 0 -1 4202496 15119 933 1 0 85 12 0 0 18 0 9 0 659718213 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562367807 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29015/statm: 106887 7626 1890 364 0 42784 0
[pid=29021] ppid=29015 vsize=279976 CPUtime=0.22 cores=0-7
/proc/29021/stat : 29021 (python) S 29015 29015 28989 0 -1 4202560 1018 0 0 0 12 10 0 0 18 0 1 0 659718322 286695424 5961 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557711 0 0 16781312 514 6464319130764804354 0 0 17 1 0 0 0
/proc/29021/statm: 69994 5961 382 364 0 5912 0
[pid=29023] ppid=29021 vsize=19800 CPUtime=89.39 cores=0-7
/proc/29023/stat : 29023 (lingeling) R 29021 29023 29023 0 -1 4202496 19838 0 0 0 8936 3 0 0 25 0 1 0 659718323 20275200 4152 33554432000 4194304 4352236 140735732414368 18446744073709551615 4207791 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/29023/statm: 4950 4152 129 39 0 4030 0
[pid=29024] ppid=29015 vsize=290232 CPUtime=0.24 cores=0-7
/proc/29024/stat : 29024 (python) S 29015 29015 28989 0 -1 4202560 956 0 0 0 13 11 0 0 15 0 1 0 659718325 297197568 5954 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804355 0 0 17 3 0 0 0
/proc/29024/statm: 72558 5954 371 364 0 8473 0
[pid=29026] ppid=29024 vsize=69420 CPUtime=89.29 cores=0-7
/proc/29026/stat : 29026 (cryptominisat-2) R 29024 29026 29026 0 -1 4202496 35729 0 0 0 8919 10 0 0 25 0 1 0 659718325 71086080 9614 33554432000 4194304 4677096 140734850555808 18446744073709551615 4320248 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29026/statm: 17355 9614 393 118 0 12314 0
[pid=29027] ppid=29015 vsize=366024 CPUtime=0.22 cores=0-7
/proc/29027/stat : 29027 (python) S 29015 29015 28989 0 -1 4202560 780 0 0 0 11 11 0 0 18 0 1 0 659718327 374808576 6035 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804353 0 0 17 1 0 0 0
/proc/29027/statm: 91506 6035 371 364 0 27418 0
[pid=29029] ppid=29027 vsize=21624 CPUtime=89.34 cores=0-7
/proc/29029/stat : 29029 (lingeling) R 29027 29029 29029 0 -1 4202496 18521 0 0 0 8932 2 0 0 25 0 1 0 659718327 22142976 4608 33554432000 4194304 4352236 140737416128704 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/29029/statm: 5406 4608 129 39 0 4486 0
[pid=29030] ppid=29015 vsize=376280 CPUtime=0.22 cores=0-7
/proc/29030/stat : 29030 (python) S 29015 29015 28989 0 -1 4202560 809 0 0 0 11 11 0 0 16 0 1 0 659718329 385310720 6129 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562367807 0 0 16781824 2 18446744071562232103 0 0 17 1 0 0 0
/proc/29030/statm: 94070 6129 376 364 0 29979 0
[pid=29033] ppid=29015 vsize=386536 CPUtime=0.22 cores=0-7
/proc/29033/stat : 29033 (python) S 29015 29015 28989 0 -1 4202560 798 0 0 0 11 11 0 0 18 0 1 0 659718332 395812864 6128 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804355 0 0 17 1 0 0 0
/proc/29033/statm: 96634 6128 371 364 0 32540 0
[pid=29035] ppid=29033 vsize=8716 CPUtime=87.74 cores=0-7
/proc/29035/stat : 29035 (SApperloT-base) R 29033 29035 29035 0 -1 4202496 2133 0 0 0 8774 0 0 0 25 0 1 0 659718332 8925184 1877 33554432000 134512640 135674940 4287953568 18446744073709551615 135111117 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29035/statm: 2179 1877 100 284 0 1893 0
[pid=29036] ppid=29015 vsize=396792 CPUtime=0.22 cores=0-7
/proc/29036/stat : 29036 (python) S 29015 29015 28989 0 -1 4202560 816 0 0 0 11 11 0 0 18 0 1 0 659718334 406315008 6074 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804356 0 0 17 1 0 0 0
/proc/29036/statm: 99198 6074 371 364 0 35101 0
[pid=29038] ppid=29036 vsize=21928 CPUtime=88.23 cores=0-7
/proc/29038/stat : 29038 (precosat) R 29036 29038 29038 0 -1 4202496 5718 0 0 0 8822 1 0 0 25 0 1 0 659718335 22454272 5313 33554432000 4194304 4890832 140735430914816 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/29038/statm: 5482 5313 86 171 0 5309 0
[pid=29039] ppid=29015 vsize=0 CPUtime=89.19 cores=0-7
/proc/29039/stat : 29039 (python) Z 29015 29015 28989 0 -1 4202588 1099 37205 0 0 193 48 8670 8 18 0 2 0 659718337 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29039/statm: 0 0 0 0 0 0 0
[pid=29041] ppid=29015 vsize=417304 CPUtime=0.22 cores=0-7
/proc/29041/stat : 29041 (python) S 29015 29015 28989 0 -1 4202560 862 0 0 0 12 10 0 0 18 0 1 0 659718339 427319296 6109 33554432000 4194304 5683644 140733562532912 18446744073709551615 271550557766 0 0 16781312 514 6464319130764804354 0 0 17 1 0 0 0
/proc/29041/statm: 104326 6109 377 364 0 40223 0
[pid=29044] ppid=29041 vsize=19876 CPUtime=89.09 cores=0-7
/proc/29044/stat : 29044 (lingeling) R 29041 29044 29044 0 -1 4202496 18450 0 0 0 8907 2 0 0 25 0 1 0 659718340 20353024 4171 33554432000 4194304 4352236 140734527414592 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/29044/statm: 4969 4171 129 39 0 4049 0
[pid=29015/tid=29022] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29022/stat : 29022 (python) S 29013 29015 28989 0 -1 4202560 24 933 0 0 0 0 0 0 17 0 9 0 659718322 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29025] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29025/stat : 29025 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 18 0 9 0 659718325 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 3 0 0 0
[pid=29015/tid=29028] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29028/stat : 29028 (python) S 29013 29015 28989 0 -1 4202560 79 933 0 0 0 0 0 0 19 0 9 0 659718327 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 0 0 0 0
[pid=29015/tid=29031] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29031/stat : 29031 (python) S 29013 29015 28989 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 659718330 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 5 0 0 0
[pid=29015/tid=29034] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29034/stat : 29034 (python) S 29013 29015 28989 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 9 0 659718332 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 0 0 0 0
[pid=29015/tid=29037] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29037/stat : 29037 (python) S 29013 29015 28989 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 9 0 659718334 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 7 0 0 0
[pid=29015/tid=29040] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29040/stat : 29040 (python) S 29013 29015 28989 0 -1 4202560 47 933 0 0 0 0 0 0 21 0 9 0 659718337 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 6 0 0 0
[pid=29015/tid=29042] ppid=29013 vsize=427548 CPUtime=0 cores=0-7
/proc/29015/task/29042/stat : 29042 (python) S 29013 29015 28989 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 9 0 659718340 437809152 7626 33554432000 4194304 5683644 140733562532912 18446744073709551615 271562361265 0 0 16781312 2 18446604446166637312 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 624.8
Current children cumulated vsize (KiB) 3102056

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29015 and gives
#  childrusage.ru_utime.tv_sec=712
#  childrusage.ru_utime.tv_usec=628663
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=752733
# CPU time returned by wait4() is 714.381
# while last known CPU time is 624.8
#
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 88.53
#  lost CPU user time (s): 88.52
#  lost CPU system time (s): 0.00999999

Real time (s): 90.5373
CPU time (s): 713.33
CPU user time (s): 711.71
CPU system time (s): 1.62
CPU usage (%): 787.885
Max. virtual memory (cumulated for all children) (KiB): 3583784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 712.629
system time used= 1.75273
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 184635
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4224
involuntary context switches= 8104

runsolver used 0.353946 second user time and 0.72089 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-15 19:40:03
IDJOB=3380510
IDBENCH=20393
IDSOLVER=1864
FILE ID=node133/3380510-1305481203
RUNJOBID= node133-1305481203-29003
PBS_JOBID= 13325347
Free space on /tmp= 73624 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT07/industrial/fuhs/medium/AProVE07-21.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380510-1305481203/watcher-3380510-1305481203 -o /tmp/evaluation-result-3380510-1305481203/solver-3380510-1305481203 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380510-1305481203.cnf -seed 993358609 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 627e3d704e5200c3037f9c9d83c939c1
RANDOM SEED=993358609

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19946372 kB
Buffers:        310628 kB
Cached:        4198856 kB
SwapCached:       8756 kB
Active:        9522604 kB
Inactive:      3180556 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19946372 kB
SwapTotal:    67111528 kB
SwapFree:     67056788 kB
Dirty:           31812 kB
Writeback:           4 kB
AnonPages:     8190856 kB
Mapped:          27648 kB
Slab:           202068 kB
PageTables:      34232 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 63747400 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73592 MiB
End job on node133 at 2011-05-15 19:41:34