Trace number 3317932

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 1088.19 316.657

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
MD5SUM0385ba51f44fb47d0b0726e26312816f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses858766
Sum of the clauses size2046721
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2847665
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.67	c INFO: solving HOME/instance-3317932-1304268635.cnf
0.35/0.67	c INFO: computing task features
2.93/3.28	c INFO: computed variable-clause graph statistics
3.03/3.38	c INFO: computed clause balance statistics
15.33/15.60	c INFO: computed variable balance statistics
23.93/24.24	c INFO: computed small-clause counts
24.13/24.41	c INFO: computed Horn-clause counts
58.33/58.69	c INFO: computed variable graph statistics
58.33/58.69	c INFO: collected features for HOME/instance-3317932-1304268635.cnf in 57.94 s
58.43/58.71	c INFO: running lingeling-276@0 for 97 with 4741 remaining (b = 0.22)
58.43/58.74	c INFO: running cryptominisat-2.9.0@0 for 485 with 4741 remaining (b = 0.19)
58.43/58.77	c INFO: running lingeling-276@0 for 1261 with 4741 remaining (b = 0.33)
58.43/58.79	c INFO: running cryptominisat-2.9.0@0 for 1940 with 4741 remaining (b = 0.43)
453.98/157.88	c INFO: running lingeling-276@0 for 1164 with 4642 remaining (b = 0.26)
1088.19/316.63	c INFO: running SApperloT@0 for 97 with 4484 remaining (b = 0.08)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317932-1304268635/watcher-3317932-1304268635 -o /tmp/evaluation-result-3317932-1304268635/solver-3317932-1304268635 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317932-1304268635.cnf -seed 502743211 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 4.99 2.77 5/193 20945
/proc/meminfo: memFree=26823876/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 734 0 0 0 0 0 0 0 17 0 1 0 538464296 15548416 622 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/20945/statm: 3796 622 322 364 0 283 0

[startup+0.0109241 s]
/proc/loadavg: 7.93 4.99 2.77 5/193 20945
/proc/meminfo: memFree=26823876/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=15780 CPUtime=0 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 860 0 0 0 0 0 0 0 17 0 1 0 538464296 16158720 741 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921776784 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 3945 741 335 364 0 432 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15780

[startup+0.100926 s]
/proc/loadavg: 7.93 4.99 2.77 5/193 20945
/proc/meminfo: memFree=26823876/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=87708 CPUtime=0.06 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 2638 0 0 0 5 1 0 0 17 0 1 0 538464296 89812992 2354 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/20945/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300896 s]
/proc/loadavg: 7.93 4.99 2.77 5/193 20945
/proc/meminfo: memFree=26823876/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=135752 CPUtime=0.19 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 5960 934 1 0 14 5 0 0 17 0 1 0 538464296 139010048 4150 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921773061 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700802 s]
/proc/loadavg: 7.93 4.99 2.77 5/193 20945
/proc/meminfo: memFree=26823876/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=294812 CPUtime=0.43 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 13340 934 1 0 31 12 0 0 15 0 1 0 538464296 301887488 11022 33554432000 4194304 5683644 140736171112832 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 73703 11022 1761 364 0 9627 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 294812

[startup+1.50066 s]
/proc/loadavg: 7.61 4.98 2.78 6/194 20950
/proc/meminfo: memFree=26765024/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=349924 CPUtime=1.23 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 26919 934 1 0 109 14 0 0 16 0 1 0 538464296 358322176 24601 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921437893 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 87481 24601 1761 364 0 23405 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 349924

[startup+3.10036 s]
/proc/loadavg: 7.61 4.98 2.78 6/194 20950
/proc/meminfo: memFree=26687772/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=453836 CPUtime=2.83 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 72879 934 1 0 264 19 0 0 18 0 1 0 538464296 464728064 50831 33554432000 4194304 5683644 140736171112832 18446744073709551615 47818080882987 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 113459 50831 1814 364 0 49383 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 453836

[startup+6.30077 s]
/proc/loadavg: 7.40 4.98 2.79 6/194 20950
/proc/meminfo: memFree=26624540/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=453836 CPUtime=6.03 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 72892 934 1 0 584 19 0 0 25 0 1 0 538464296 464728064 50843 33554432000 4194304 5683644 140736171112832 18446744073709551615 4662462 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 113459 50843 1826 364 0 49383 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 453836

[startup+12.7006 s]
/proc/loadavg: 7.21 4.98 2.80 6/194 20950
/proc/meminfo: memFree=26645292/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=453836 CPUtime=12.43 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 72892 934 1 0 1224 19 0 0 25 0 1 0 538464296 464728064 50843 33554432000 4194304 5683644 140736171112832 18446744073709551615 47818080918305 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 113459 50843 1826 364 0 49383 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 453836

[startup+25.5002 s]
/proc/loadavg: 6.87 4.98 2.83 6/198 20955
/proc/meminfo: memFree=26033708/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=453836 CPUtime=25.23 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 72899 934 1 0 2504 19 0 0 25 0 1 0 538464296 464728064 50850 33554432000 4194304 5683644 140736171112832 18446744073709551615 47818078144640 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 113459 50850 1833 364 0 49383 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 453836

[startup+51.1006 s]
/proc/loadavg: 6.19 4.99 2.90 6/198 20955
/proc/meminfo: memFree=25774540/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=453836 CPUtime=50.83 cores=1,3,5,7
/proc/20945/stat : 20945 (python) R 20943 20945 20627 0 -1 4202496 72899 934 1 0 5064 19 0 0 25 0 1 0 538464296 464728064 50850 33554432000 4194304 5683644 140736171112832 18446744073709551615 47818078144652 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20945/statm: 113459 50850 1833 364 0 49383 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 453836

[startup+102.307 s]
/proc/loadavg: 7.22 5.44 3.16 9/210 20969
/proc/meminfo: memFree=24171828/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=481520 CPUtime=58.52 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 75622 934 1 0 5831 21 0 0 20 0 5 0 538464296 493076480 47576 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/20945/statm: 120380 47576 1881 364 0 56289 0
[pid=20956] ppid=20945 vsize=440508 CPUtime=0.05 cores=1,3,5,7
/proc/20956/stat : 20956 (python) S 20945 20945 20627 0 -1 4202560 1014 0 0 0 2 3 0 0 18 0 1 0 538470168 451080192 46061 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797135 0 0 16781312 514 9261177644664193288 0 0 17 7 0 0 0
/proc/20956/statm: 110127 46061 382 364 0 46045 0
[pid=20958] ppid=20956 vsize=59736 CPUtime=43.46 cores=1,3,5,7
/proc/20958/stat : 20958 (lingeling) R 20956 20958 20958 0 -1 4202496 22804 0 0 0 4343 3 0 0 25 0 1 0 538470168 61169664 14104 33554432000 4194304 4352236 140733597352400 18446744073709551615 4331541 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20958/statm: 14934 14104 129 39 0 14014 0
[pid=20959] ppid=20945 vsize=450764 CPUtime=0.05 cores=1,3,5,7
/proc/20959/stat : 20959 (python) S 20945 20945 20627 0 -1 4202560 939 0 0 0 2 3 0 0 15 0 1 0 538470170 461582336 46053 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 1 0 0 0
/proc/20959/statm: 112691 46053 370 364 0 48606 0
[pid=20961] ppid=20959 vsize=839028 CPUtime=43.54 cores=1,3,5,7
/proc/20961/stat : 20961 (cryptominisat-2) R 20959 20961 20961 0 -1 4202496 156680 0 0 0 4332 22 0 0 25 0 1 0 538470171 859164672 152023 33554432000 4194304 4677096 140734720950672 18446744073709551615 4319615 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20961/statm: 209757 152023 387 118 0 204716 0
[pid=20962] ppid=20945 vsize=461020 CPUtime=0.05 cores=1,3,5,7
/proc/20962/stat : 20962 (python) S 20945 20945 20627 0 -1 4202560 948 0 0 0 3 2 0 0 18 0 1 0 538470173 472084480 46057 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 7 0 0 0
/proc/20962/statm: 115255 46057 370 364 0 51167 0
[pid=20964] ppid=20962 vsize=58736 CPUtime=43.13 cores=1,3,5,7
/proc/20964/stat : 20964 (lingeling) R 20962 20964 20964 0 -1 4202496 21313 0 0 0 4310 3 0 0 25 0 1 0 538470174 60145664 12831 33554432000 4194304 4352236 140736786938960 18446744073709551615 4278565 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20964/statm: 14684 12831 129 39 0 13764 0
[pid=20965] ppid=20945 vsize=471276 CPUtime=0.05 cores=1,3,5,7
/proc/20965/stat : 20965 (python) S 20945 20945 20627 0 -1 4202560 959 0 0 0 2 3 0 0 15 0 1 0 538470176 482586624 46061 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 1 0 0 0
/proc/20965/statm: 117819 46061 370 364 0 53728 0
[pid=20967] ppid=20965 vsize=810152 CPUtime=43.49 cores=1,3,5,7
/proc/20967/stat : 20967 (cryptominisat-2) R 20965 20967 20967 0 -1 4202496 158813 0 0 0 4329 20 0 0 25 0 1 0 538470176 829595648 149490 33554432000 4194304 4677096 140736236261936 18446744073709551615 4336148 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20967/statm: 202538 149490 387 118 0 197497 0
[pid=20945/tid=20957] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20957/stat : 20957 (python) S 20943 20945 20627 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 5 0 538470168 493076480 47576 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 3 0 0 0
[pid=20945/tid=20960] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20960/stat : 20960 (python) S 20943 20945 20627 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538470171 493076480 47576 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20963] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20963/stat : 20963 (python) S 20943 20945 20627 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 5 0 538470174 493076480 47576 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20966] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20966/stat : 20966 (python) S 20943 20945 20627 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 5 0 538470176 493076480 47576 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 232.34
Current children cumulated vsize (KiB) 4072740

[startup+162.301 s]
/proc/loadavg: 7.84 5.94 3.47 10/211 20971
/proc/meminfo: memFree=21764188/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=481520 CPUtime=58.54 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 76146 934 1 0 5833 21 0 0 18 0 5 0 538464296 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/20945/statm: 120380 47577 1882 364 0 56289 0
[pid=20956] ppid=20945 vsize=450752 CPUtime=0.13 cores=1,3,5,7
/proc/20956/stat : 20956 (python) S 20945 20945 20627 0 -1 4202560 1194 0 0 0 6 7 0 0 18 0 2 0 538470168 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20956/statm: 112688 46100 416 364 0 48606 0
[pid=20958] ppid=20956 vsize=73668 CPUtime=103.15 cores=1,3,5,7
/proc/20958/stat : 20958 (lingeling) R 20956 20958 20958 0 -1 4202496 26294 0 0 0 10312 3 0 0 25 0 1 0 538470168 75436032 17587 33554432000 4194304 4352236 140733597352400 18446744073709551615 4207584 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20958/statm: 18417 17587 129 39 0 17497 0
[pid=20956/tid=20971] ppid=20945 vsize=450752 CPUtime=0 cores=1,3,5,7
/proc/20956/task/20971/stat : 20971 (python) S 20945 20945 20627 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538480082 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 514 18446604471130538048 0 0 -1 7 0 0 0
[pid=20959] ppid=20945 vsize=450764 CPUtime=0.13 cores=1,3,5,7
/proc/20959/stat : 20959 (python) S 20945 20945 20627 0 -1 4202560 959 0 0 0 6 7 0 0 15 0 1 0 538470170 461582336 46053 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 10548147213177946376 0 0 17 1 0 0 0
/proc/20959/statm: 112691 46053 370 364 0 48606 0
[pid=20961] ppid=20959 vsize=882196 CPUtime=103.54 cores=1,3,5,7
/proc/20961/stat : 20961 (cryptominisat-2) R 20959 20961 20961 0 -1 4202496 172111 0 0 0 10328 26 0 0 25 0 1 0 538470171 903368704 155970 33554432000 4194304 4677096 140734720950672 18446744073709551615 4336292 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20961/statm: 220549 155970 387 118 0 215508 0
[pid=20962] ppid=20945 vsize=461020 CPUtime=0.13 cores=1,3,5,7
/proc/20962/stat : 20962 (python) S 20945 20945 20627 0 -1 4202560 970 0 0 0 7 6 0 0 18 0 1 0 538470173 472084480 46057 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 7 0 0 0
/proc/20962/statm: 115255 46057 370 364 0 51167 0
[pid=20964] ppid=20962 vsize=62804 CPUtime=102.59 cores=1,3,5,7
/proc/20964/stat : 20964 (lingeling) R 20962 20964 20964 0 -1 4202496 27679 0 0 0 10255 4 0 0 25 0 1 0 538470174 64311296 14903 33554432000 4194304 4352236 140736786938960 18446744073709551615 4207640 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20964/statm: 15701 14903 129 39 0 14781 0
[pid=20965] ppid=20945 vsize=471276 CPUtime=0.48 cores=1,3,5,7
/proc/20965/stat : 20965 (python) S 20945 20945 20627 0 -1 4202560 1196 0 0 0 36 12 0 0 15 0 1 0 538470176 482586624 46062 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 10548134019038413064 0 0 17 3 0 0 0
/proc/20965/statm: 117819 46062 371 364 0 53728 0
[pid=20967] ppid=20965 vsize=3165416 CPUtime=103.25 cores=1,3,5,7
/proc/20967/stat : 20967 (cryptominisat-2) R 20965 20967 20967 0 -1 4202496 2707329 0 0 0 9996 329 0 0 25 0 1 0 538470176 3241385984 736487 33554432000 4194304 4677096 140736236261936 18446744073709551615 4365677 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20967/statm: 791354 736487 390 118 0 786313 0
[pid=20945/tid=20957] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20957/stat : 20957 (python) S 20943 20945 20627 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 5 0 538470168 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 3 0 0 0
[pid=20945/tid=20960] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20960/stat : 20960 (python) S 20943 20945 20627 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538470171 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20963] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20963/stat : 20963 (python) S 20943 20945 20627 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 5 0 538470174 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20966] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20966/stat : 20966 (python) S 20943 20945 20627 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 5 0 538470176 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 471.94
Current children cumulated vsize (KiB) 6499416

[startup+222.301 s]
/proc/loadavg: 8.02 6.34 3.76 9/211 20973
/proc/meminfo: memFree=17576532/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=481520 CPUtime=58.54 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 76146 934 1 0 5833 21 0 0 18 0 5 0 538464296 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/20945/statm: 120380 47577 1882 364 0 56289 0
[pid=20956] ppid=20945 vsize=450752 CPUtime=0.22 cores=1,3,5,7
/proc/20956/stat : 20956 (python) S 20945 20945 20627 0 -1 4202560 1216 0 0 0 10 12 0 0 18 0 2 0 538470168 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20956/statm: 112688 46100 416 364 0 48606 0
[pid=20958] ppid=20956 vsize=79788 CPUtime=162.91 cores=1,3,5,7
/proc/20958/stat : 20958 (lingeling) R 20956 20958 20958 0 -1 4202496 28053 0 0 0 16287 4 0 0 25 0 1 0 538470168 81702912 19117 33554432000 4194304 4352236 140733597352400 18446744073709551615 4279064 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20958/statm: 19947 19117 129 39 0 19027 0
[pid=20956/tid=20971] ppid=20945 vsize=450752 CPUtime=0 cores=1,3,5,7
/proc/20956/task/20971/stat : 20971 (python) S 20945 20945 20627 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538480082 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 514 18446604471130538048 0 0 -1 7 0 0 0
[pid=20959] ppid=20945 vsize=450764 CPUtime=0.37 cores=1,3,5,7
/proc/20959/stat : 20959 (python) S 20945 20945 20627 0 -1 4202560 1110 0 0 0 23 14 0 0 15 0 1 0 538470170 461582336 46054 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 10548147213177946376 0 0 17 1 0 0 0
/proc/20959/statm: 112691 46054 371 364 0 48606 0
[pid=20961] ppid=20959 vsize=2034504 CPUtime=163.54 cores=1,3,5,7
/proc/20961/stat : 20961 (cryptominisat-2) R 20959 20961 20961 0 -1 4202496 1557762 0 0 0 16143 211 0 0 25 0 1 0 538470171 2083332096 443180 33554432000 4194304 4677096 140734720950672 18446744073709551615 4293307 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20961/statm: 508626 443180 390 118 0 503585 0
[pid=20962] ppid=20945 vsize=461020 CPUtime=0.21 cores=1,3,5,7
/proc/20962/stat : 20962 (python) S 20945 20945 20627 0 -1 4202560 987 0 0 0 11 10 0 0 18 0 1 0 538470173 472084480 46057 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 7 0 0 0
/proc/20962/statm: 115255 46057 370 364 0 51167 0
[pid=20964] ppid=20962 vsize=79148 CPUtime=162.03 cores=1,3,5,7
/proc/20964/stat : 20964 (lingeling) R 20962 20964 20964 0 -1 4202496 31949 0 0 0 16199 4 0 0 25 0 1 0 538470174 81047552 18957 33554432000 4194304 4352236 140736786938960 18446744073709551615 4234119 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20964/statm: 19787 18957 129 39 0 18867 0
[pid=20965] ppid=20945 vsize=471276 CPUtime=1 cores=1,3,5,7
/proc/20965/stat : 20965 (python) S 20945 20945 20627 0 -1 4202560 1565 0 0 0 76 24 0 0 16 0 1 0 538470176 482586624 46062 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 5601792094596202760 0 0 17 3 0 0 0
/proc/20965/statm: 117819 46062 371 364 0 53728 0
[pid=20967] ppid=20965 vsize=6129172 CPUtime=162.73 cores=1,3,5,7
/proc/20967/stat : 20967 (cryptominisat-2) R 20965 20967 20967 0 -1 4202496 6857181 0 0 0 15413 860 0 0 25 0 1 0 538470176 6276272128 1472567 33554432000 4194304 4677096 140736236261936 18446744073709551615 222921802858 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20967/statm: 1532293 1472304 390 118 0 1527252 0
[pid=20945/tid=20957] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20957/stat : 20957 (python) S 20943 20945 20627 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 5 0 538470168 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 3 0 0 0
[pid=20945/tid=20960] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20960/stat : 20960 (python) S 20943 20945 20627 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538470171 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20963] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20963/stat : 20963 (python) S 20943 20945 20627 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 5 0 538470174 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20966] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20966/stat : 20966 (python) S 20943 20945 20627 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 5 0 538470176 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 711.55
Current children cumulated vsize (KiB) 10637944

[startup+282.301 s]
/proc/loadavg: 8.11 6.67 4.03 9/211 20974
/proc/meminfo: memFree=14241244/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=481520 CPUtime=58.54 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 76146 934 1 0 5833 21 0 0 18 0 5 0 538464296 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/20945/statm: 120380 47577 1882 364 0 56289 0
[pid=20956] ppid=20945 vsize=450752 CPUtime=0.3 cores=1,3,5,7
/proc/20956/stat : 20956 (python) S 20945 20945 20627 0 -1 4202560 1221 0 0 0 14 16 0 0 18 0 2 0 538470168 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20956/statm: 112688 46100 416 364 0 48606 0
[pid=20958] ppid=20956 vsize=87956 CPUtime=222.43 cores=1,3,5,7
/proc/20958/stat : 20958 (lingeling) R 20956 20958 20958 0 -1 4202496 30101 0 0 0 22239 4 0 0 25 0 1 0 538470168 90066944 21159 33554432000 4194304 4352236 140733597352400 18446744073709551615 4270802 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20958/statm: 21989 21159 129 39 0 21069 0
[pid=20956/tid=20971] ppid=20945 vsize=450752 CPUtime=0 cores=1,3,5,7
/proc/20956/task/20971/stat : 20971 (python) S 20945 20945 20627 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538480082 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 514 18446604471130538048 0 0 -1 7 0 0 0
[pid=20959] ppid=20945 vsize=450764 CPUtime=0.86 cores=1,3,5,7
/proc/20959/stat : 20959 (python) S 20945 20945 20627 0 -1 4202560 1484 0 0 0 60 26 0 0 15 0 1 0 538470170 461582336 46054 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 10548147213177946376 0 0 17 1 0 0 0
/proc/20959/statm: 112691 46054 371 364 0 48606 0
[pid=20961] ppid=20959 vsize=4943352 CPUtime=223.54 cores=1,3,5,7
/proc/20961/stat : 20961 (cryptominisat-2) R 20959 20961 20961 0 -1 4202496 5481077 0 0 0 21668 686 0 0 25 0 1 0 538470171 5061992448 1171902 33554432000 4194304 4677096 140734720950672 18446744073709551615 4365459 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20961/statm: 1235838 1171903 390 118 0 1230797 0
[pid=20962] ppid=20945 vsize=461020 CPUtime=0.29 cores=1,3,5,7
/proc/20962/stat : 20962 (python) S 20945 20945 20627 0 -1 4202560 1000 0 0 0 16 13 0 0 18 0 1 0 538470173 472084480 46057 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 7 0 0 0
/proc/20962/statm: 115255 46057 370 364 0 51167 0
[pid=20964] ppid=20962 vsize=83212 CPUtime=221.5 cores=1,3,5,7
/proc/20964/stat : 20964 (lingeling) R 20962 20964 20964 0 -1 4202496 32973 0 0 0 22146 4 0 0 25 0 1 0 538470174 85209088 19973 33554432000 4194304 4352236 140736786938960 18446744073709551615 4234028 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20964/statm: 20803 19973 129 39 0 19883 0
[pid=20965] ppid=20945 vsize=471276 CPUtime=1.08 cores=1,3,5,7
/proc/20965/stat : 20965 (python) S 20945 20945 20627 0 -1 4202560 1884 0 0 0 81 27 0 0 15 0 1 0 538470176 482586624 46062 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 3 0 0 0
/proc/20965/statm: 117819 46062 371 364 0 53728 0
[pid=20967] ppid=20965 vsize=6555556 CPUtime=222.64 cores=1,3,5,7
/proc/20967/stat : 20967 (cryptominisat-2) R 20965 20967 20967 0 -1 4202496 6966420 0 0 0 21384 880 0 0 25 0 1 0 538470176 6712889344 1560575 33554432000 4194304 4677096 140736236261936 18446744073709551615 4335955 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20967/statm: 1638889 1560575 393 118 0 1633848 0
[pid=20945/tid=20957] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20957/stat : 20957 (python) S 20943 20945 20627 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 5 0 538470168 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 3 0 0 0
[pid=20945/tid=20960] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20960/stat : 20960 (python) S 20943 20945 20627 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538470171 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20963] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20963/stat : 20963 (python) S 20943 20945 20627 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 5 0 538470174 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20966] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20966/stat : 20966 (python) S 20943 20945 20627 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 5 0 538470176 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 951.18
Current children cumulated vsize (KiB) 13985408



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+316.601 s]
/proc/loadavg: 8.20 6.85 4.19 9/212 20976
/proc/meminfo: memFree=12438736/32951124 swapFree=67110188/67111528
[pid=20945] ppid=20943 vsize=481520 CPUtime=58.54 cores=1,3,5,7
/proc/20945/stat : 20945 (python) S 20943 20945 20627 0 -1 4202496 76146 934 1 0 5833 21 0 0 18 0 5 0 538464296 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/20945/statm: 120380 47577 1882 364 0 56289 0
[pid=20956] ppid=20945 vsize=450752 CPUtime=0.34 cores=1,3,5,7
/proc/20956/stat : 20956 (python) S 20945 20945 20627 0 -1 4202560 1221 0 0 0 16 18 0 0 18 0 2 0 538470168 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20956/statm: 112688 46100 416 364 0 48606 0
[pid=20958] ppid=20956 vsize=96120 CPUtime=256.52 cores=1,3,5,7
/proc/20958/stat : 20958 (lingeling) R 20956 20958 20958 0 -1 4202496 32149 0 0 0 25647 5 0 0 25 0 1 0 538470168 98426880 23200 33554432000 4194304 4352236 140733597352400 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20958/statm: 24030 23200 129 39 0 23110 0
[pid=20956/tid=20971] ppid=20945 vsize=450752 CPUtime=0 cores=1,3,5,7
/proc/20956/task/20971/stat : 20971 (python) S 20945 20945 20627 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538480082 461570048 46100 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 514 18446604471130538048 0 0 -1 7 0 0 0
[pid=20959] ppid=20945 vsize=450764 CPUtime=1.06 cores=1,3,5,7
/proc/20959/stat : 20959 (python) S 20945 20945 20627 0 -1 4202560 1875 0 0 0 75 31 0 0 15 0 1 0 538470170 461582336 46054 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 1 0 0 0
/proc/20959/statm: 112691 46054 371 364 0 48606 0
[pid=20961] ppid=20959 vsize=6226988 CPUtime=257.85 cores=1,3,5,7
/proc/20961/stat : 20961 (cryptominisat-2) R 20959 20961 20961 0 -1 4202496 7558174 0 0 0 24846 939 0 0 25 0 1 0 538470171 6376435712 1502130 33554432000 4194304 4677096 140734720950672 18446744073709551615 4335943 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20961/statm: 1556747 1502130 390 118 0 1551706 0
[pid=20962] ppid=20945 vsize=461020 CPUtime=0.34 cores=1,3,5,7
/proc/20962/stat : 20962 (python) S 20945 20945 20627 0 -1 4202560 1000 0 0 0 19 15 0 0 18 0 1 0 538470173 472084480 46057 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 7 0 0 0
/proc/20962/statm: 115255 46057 370 364 0 51167 0
[pid=20964] ppid=20962 vsize=87276 CPUtime=255.49 cores=1,3,5,7
/proc/20964/stat : 20964 (lingeling) R 20962 20964 20964 0 -1 4202496 33997 0 0 0 25545 4 0 0 25 0 1 0 538470174 89370624 20989 33554432000 4194304 4352236 140736786938960 18446744073709551615 4281048 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20964/statm: 21819 20989 129 39 0 20899 0
[pid=20965] ppid=20945 vsize=471276 CPUtime=1.14 cores=1,3,5,7
/proc/20965/stat : 20965 (python) S 20945 20945 20627 0 -1 4202560 1886 0 0 0 84 30 0 0 15 0 1 0 538470176 482586624 46062 33554432000 4194304 5683644 140736171112832 18446744073709551615 222921797190 0 0 16781312 514 9261177644664193288 0 0 17 3 0 0 0
/proc/20965/statm: 117819 46062 371 364 0 53728 0
[pid=20967] ppid=20965 vsize=7148720 CPUtime=256.91 cores=1,3,5,7
/proc/20967/stat : 20967 (cryptominisat-2) R 20965 20967 20967 0 -1 4202496 7076005 0 0 0 24795 896 0 0 25 0 1 0 538470176 7320289280 1664007 33554432000 4194304 4677096 140736236261936 18446744073709551615 4319674 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20967/statm: 1787180 1664007 393 118 0 1782139 0
[pid=20945/tid=20957] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20957/stat : 20957 (python) S 20943 20945 20627 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 5 0 538470168 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 3 0 0 0
[pid=20945/tid=20960] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20960/stat : 20960 (python) S 20943 20945 20627 0 -1 4202560 22 934 0 0 0 0 0 0 20 0 5 0 538470171 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20963] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20963/stat : 20963 (python) S 20943 20945 20627 0 -1 4202560 24 934 0 0 0 0 0 0 22 0 5 0 538470174 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 7 0 0 0
[pid=20945/tid=20966] ppid=20943 vsize=481520 CPUtime=0 cores=1,3,5,7
/proc/20945/task/20966/stat : 20966 (python) S 20943 20945 20627 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 5 0 538470176 493076480 47577 33554432000 4194304 5683644 140736171112832 18446744073709551615 222933600689 0 0 16781312 2 18446604467260749760 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1088.19
Current children cumulated vsize (KiB) 15874436

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20945 and gives
#  childrusage.ru_utime.tv_sec=315
#  childrusage.ru_utime.tv_usec=761996
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=805877
# CPU time returned by wait4() is 316.568
# while last known CPU time is 1088.19
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 316.657
CPU time (s): 1088.19
CPU user time (s): 1068.6
CPU system time (s): 19.59
CPU usage (%): 343.65
Max. virtual memory (cumulated for all children) (KiB): 15874436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 315.762
system time used= 0.805877
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 112691
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11975
involuntary context switches= 11037

runsolver used 0.536918 second user time and 1.40679 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-01 18:50:35
IDJOB=3317932
IDBENCH=82369
IDSOLVER=1706
FILE ID=node109/3317932-1304268635
RUNJOBID= node109-1304267294-20646
PBS_JOBID= 13173969
Free space on /tmp= 73008 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317932-1304268635/watcher-3317932-1304268635 -o /tmp/evaluation-result-3317932-1304268635/solver-3317932-1304268635 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317932-1304268635.cnf -seed 502743211 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0385ba51f44fb47d0b0726e26312816f
RANDOM SEED=502743211

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26823908 kB
Buffers:        820692 kB
Cached:        1476860 kB
SwapCached:        712 kB
Active:        3750296 kB
Inactive:      1969028 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26823908 kB
SwapTotal:    67111528 kB
SwapFree:     67110188 kB
Dirty:           47132 kB
Writeback:           0 kB
AnonPages:     3420684 kB
Mapped:          21380 kB
Slab:           331200 kB
PageTables:      17260 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  5299380 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72980 MiB
End job on node109 at 2011-05-01 18:55:54