Trace number 3380768

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? (MO) 2187.6 328.677

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
MD5SUM0385ba51f44fb47d0b0726e26312816f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses858766
Sum of the clauses size2046721
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2847665
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.37/0.67	c INFO: solving HOME/instance-3380768-1305491646.cnf
0.37/0.67	c INFO: computing task features
2.96/3.27	c INFO: computed variable-clause graph statistics
3.06/3.37	c INFO: computed clause balance statistics
15.24/15.55	c INFO: computed variable balance statistics
23.95/24.23	c INFO: computed small-clause counts
24.14/24.40	c INFO: computed Horn-clause counts
61.54/61.82	c INFO: computed variable graph statistics
61.54/61.82	c INFO: collected features for HOME/instance-3380768-1305491646.cnf in 61.06 s
61.54/61.85	c INFO: running lingeling-276@0 for 97 with 4938 remaining (b = 0.22)
61.54/61.87	c INFO: running cryptominisat-2.9.0@0 for 485 with 4938 remaining (b = 0.19)
61.64/61.90	c INFO: running lingeling-276@0 for 1261 with 4938 remaining (b = 0.33)
61.64/61.93	c INFO: running cryptominisat-2.9.0@0 for 1940 with 4938 remaining (b = 0.43)
61.64/61.96	c INFO: running lingeling-276@0 for 1261 with 4938 remaining (b = 0.26)
61.64/61.99	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4938 remaining (b = 0.33)
61.74/62.02	c INFO: running precosat-570@0 for 291 with 4938 remaining (b = 0.08)
61.74/62.05	c INFO: running cryptominisat-2.9.0@0 for 1940 with 4938 remaining (b = 0.30)
860.67/162.10	c INFO: running lingeling-276@0 for 1164 with 4838 remaining (b = 0.18)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380768-1305491646/watcher-3380768-1305491646 -o /tmp/evaluation-result-3380768-1305491646/solver-3380768-1305491646 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380768-1305491646.cnf -seed 1112230754 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.87 7.80 7.92 1/295 14416
/proc/meminfo: memFree=24398012/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=15760 CPUtime=0 cores=0-7
/proc/14416/stat : 14416 (python) S 14414 14416 14390 0 -1 4202496 843 0 0 0 0 0 0 0 22 0 1 0 739395236 16138240 727 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/14416/statm: 3940 727 334 364 0 427 0

[startup+0.0981021 s]
/proc/loadavg: 6.87 7.80 7.92 1/295 14416
/proc/meminfo: memFree=24398012/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=85616 CPUtime=0.06 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 2626 0 0 0 5 1 0 0 22 0 1 0 739395236 87670784 2347 33554432000 4194304 5683644 140737197670400 18446744073709551615 4902516 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 21404 2347 713 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85616

[startup+0.101114 s]
/proc/loadavg: 6.87 7.80 7.92 1/295 14416
/proc/meminfo: memFree=24398012/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=89764 CPUtime=0.06 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 2646 0 0 0 5 1 0 0 22 0 1 0 739395236 91918336 2364 33554432000 4194304 5683644 140737197670400 18446744073709551615 260023922576 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 22441 2387 750 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89764

[startup+0.301067 s]
/proc/loadavg: 6.87 7.80 7.92 1/295 14416
/proc/meminfo: memFree=24398012/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=135748 CPUtime=0.18 cores=0-7
/proc/14416/stat : 14416 (python) S 14414 14416 14390 0 -1 4202496 5958 934 1 0 14 4 0 0 17 0 1 0 739395236 139005952 4150 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/14416/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700994 s]
/proc/loadavg: 6.87 7.80 7.92 1/295 14416
/proc/meminfo: memFree=24398012/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=295024 CPUtime=0.44 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 13394 934 1 0 33 11 0 0 16 0 1 0 739395236 302104576 11079 33554432000 4194304 5683644 140737197670400 18446744073709551615 4960193 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 73756 11079 1761 364 0 9680 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 295024

[startup+1.50084 s]
/proc/loadavg: 6.87 7.80 7.92 2/296 14421
/proc/meminfo: memFree=24339352/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=350052 CPUtime=1.25 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 26982 934 1 0 112 13 0 0 17 0 1 0 739395236 358453248 24667 33554432000 4194304 5683644 140737197670400 18446744073709551615 4602436 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 87513 24670 1761 364 0 23437 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 350052

[startup+3.10055 s]
/proc/loadavg: 6.87 7.80 7.92 2/296 14421
/proc/meminfo: memFree=24264208/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=453832 CPUtime=2.85 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 72876 934 1 0 266 19 0 0 19 0 1 0 739395236 464723968 50831 33554432000 4194304 5683644 140737197670400 18446744073709551615 47924385191557 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 113458 50831 1814 364 0 49382 0
Current children cumulated CPU time (s) 2.85
Current children cumulated vsize (KiB) 453832

[startup+6.30096 s]
/proc/loadavg: 6.40 7.69 7.88 2/296 14421
/proc/meminfo: memFree=24200008/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=453832 CPUtime=6.04 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 72889 934 1 0 585 19 0 0 25 0 1 0 739395236 464723968 50843 33554432000 4194304 5683644 140737197670400 18446744073709551615 4272792 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 113458 50843 1826 364 0 49382 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 453832

[startup+12.7008 s]
/proc/loadavg: 5.96 7.57 7.84 2/296 14422
/proc/meminfo: memFree=24200652/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=453832 CPUtime=12.44 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 72889 934 1 0 1225 19 0 0 25 0 1 0 739395236 464723968 50843 33554432000 4194304 5683644 140737197670400 18446744073709551615 260023804597 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14416/statm: 113458 50843 1826 364 0 49382 0
Current children cumulated CPU time (s) 12.44
Current children cumulated vsize (KiB) 453832

[startup+25.5004 s]
/proc/loadavg: 4.86 7.25 7.73 2/296 14422
/proc/meminfo: memFree=24201884/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=453832 CPUtime=25.24 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 72896 934 1 0 2505 19 0 0 25 0 1 0 739395236 464723968 50850 33554432000 4194304 5683644 140737197670400 18446744073709551615 47924384876672 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/14416/statm: 113458 50850 1833 364 0 49382 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 453832

[startup+51.1007 s]
/proc/loadavg: 3.54 6.75 7.55 2/296 14423
/proc/meminfo: memFree=24201612/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=453832 CPUtime=50.84 cores=0-7
/proc/14416/stat : 14416 (python) R 14414 14416 14390 0 -1 4202496 72896 934 1 0 5065 19 0 0 25 0 1 0 739395236 464723968 50850 33554432000 4194304 5683644 140737197670400 18446744073709551615 47924384876684 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14416/statm: 113458 50850 1833 364 0 49382 0
Current children cumulated CPU time (s) 50.84
Current children cumulated vsize (KiB) 453832

[startup+102.312 s]
/proc/loadavg: 5.62 6.77 7.51 9/320 14448
/proc/meminfo: memFree=21472548/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=588076 CPUtime=61.79 cores=0-7
/proc/14416/stat : 14416 (python) S 14414 14416 14390 0 -1 4202496 78788 934 1 0 6155 24 0 0 25 0 9 0 739395236 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/14416/statm: 147019 47602 1889 364 0 82916 0
[pid=14424] ppid=14416 vsize=440504 CPUtime=0.09 cores=0-7
/proc/14424/stat : 14424 (python) S 14416 14416 14390 0 -1 4202560 1012 0 0 0 4 5 0 0 18 0 1 0 739401421 451076096 46060 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416015 0 0 16781312 514 4676513224001028356 0 0 17 1 0 0 0
/proc/14424/statm: 110126 46060 381 364 0 46044 0
[pid=14426] ppid=14424 vsize=59972 CPUtime=40.44 cores=0-7
/proc/14426/stat : 14426 (lingeling) R 14424 14426 14426 0 -1 4202496 22656 0 0 0 4041 3 0 0 25 0 1 0 739401422 61411328 14162 33554432000 4194304 4352236 140737342214656 18446744073709551615 4328102 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/14426/statm: 14993 14162 129 39 0 14073 0
[pid=14427] ppid=14416 vsize=450760 CPUtime=0.09 cores=0-7
/proc/14427/stat : 14427 (python) S 14416 14416 14390 0 -1 4202560 940 0 0 0 4 5 0 0 15 0 1 0 739401424 461578240 46053 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028355 0 0 17 0 0 0 0
/proc/14427/statm: 112690 46053 370 364 0 48605 0
[pid=14429] ppid=14427 vsize=808332 CPUtime=40.41 cores=0-7
/proc/14429/stat : 14429 (cryptominisat-2) R 14427 14429 14429 0 -1 4202496 156885 0 0 0 4020 21 0 0 25 0 1 0 739401424 827731968 148021 33554432000 4194304 4677096 140734294897264 18446744073709551615 4336322 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14429/statm: 202083 148021 387 118 0 197042 0
[pid=14430] ppid=14416 vsize=461016 CPUtime=0.09 cores=0-7
/proc/14430/stat : 14430 (python) S 14416 14416 14390 0 -1 4202560 921 0 0 0 4 5 0 0 18 0 1 0 739401426 472080384 46057 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 1 0 0 0
/proc/14430/statm: 115254 46057 370 364 0 51166 0
[pid=14432] ppid=14430 vsize=59296 CPUtime=40.38 cores=0-7
/proc/14432/stat : 14432 (lingeling) R 14430 14432 14432 0 -1 4202496 21676 0 0 0 4035 3 0 0 25 0 1 0 739401427 60719104 12971 33554432000 4194304 4352236 140734632763360 18446744073709551615 4328114 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/14432/statm: 14824 12971 129 39 0 13904 0
[pid=14433] ppid=14416 vsize=471272 CPUtime=0.09 cores=0-7
/proc/14433/stat : 14433 (python) S 14416 14416 14390 0 -1 4202560 962 0 0 0 5 4 0 0 15 0 1 0 739401429 482582528 46061 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028356 0 0 17 1 0 0 0
/proc/14433/statm: 117818 46061 370 364 0 53727 0
[pid=14435] ppid=14433 vsize=834912 CPUtime=40.35 cores=0-7
/proc/14435/stat : 14435 (cryptominisat-2) R 14433 14435 14435 0 -1 4202496 153973 0 0 0 4014 21 0 0 25 0 1 0 739401430 854949888 149316 33554432000 4194304 4677096 140735256885856 18446744073709551615 4336210 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/14435/statm: 208728 149316 387 118 0 203687 0
[pid=14436] ppid=14416 vsize=547064 CPUtime=0.09 cores=0-7
/proc/14436/stat : 14436 (python) S 14416 14416 14390 0 -1 4202560 963 0 0 0 4 5 0 0 18 0 1 0 739401432 560193536 46067 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028354 0 0 17 1 0 0 0
/proc/14436/statm: 136766 46067 370 364 0 72672 0
[pid=14438] ppid=14436 vsize=60404 CPUtime=39.88 cores=0-7
/proc/14438/stat : 14438 (lingeling) R 14436 14438 14438 0 -1 4202496 21738 0 0 0 3985 3 0 0 25 0 1 0 739401433 61853696 13248 33554432000 4194304 4352236 140735308344112 18446744073709551615 4281230 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/14438/statm: 15101 13248 129 39 0 14181 0
[pid=14439] ppid=14416 vsize=557320 CPUtime=0.09 cores=0-7
/proc/14439/stat : 14439 (python) S 14416 14416 14390 0 -1 4202560 970 0 0 0 5 4 0 0 15 0 1 0 739401435 570695680 46071 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 6 0 0 0
/proc/14439/statm: 139330 46071 370 364 0 75233 0
[pid=14441] ppid=14439 vsize=853548 CPUtime=39.93 cores=0-7
/proc/14441/stat : 14441 (cryptominisat-2) R 14439 14441 14441 0 -1 4202496 157236 0 0 0 3973 20 0 0 25 0 1 0 739401436 874033152 149983 33554432000 4194304 4677096 140733878019680 18446744073709551615 4336167 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/14441/statm: 213387 149983 387 118 0 208346 0
[pid=14442] ppid=14416 vsize=567576 CPUtime=0.09 cores=0-7
/proc/14442/stat : 14442 (python) S 14416 14416 14390 0 -1 4202560 968 0 0 0 4 5 0 0 18 0 1 0 739401438 581197824 46075 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 0 0 0 0
/proc/14442/statm: 141894 46075 370 364 0 77794 0
[pid=14444] ppid=14442 vsize=172628 CPUtime=40.01 cores=0-7
/proc/14444/stat : 14444 (precosat) R 14442 14444 14444 0 -1 4202496 44177 0 0 0 3996 5 0 0 25 0 1 0 739401439 176771072 41226 33554432000 4194304 4890832 140733880644880 18446744073709551615 4467438 0 0 16781312 17442 0 0 0 17 6 0 0 0
/proc/14444/statm: 43157 41226 86 171 0 42984 0
[pid=14445] ppid=14416 vsize=577832 CPUtime=0.09 cores=0-7
/proc/14445/stat : 14445 (python) S 14416 14416 14390 0 -1 4202560 1022 0 0 0 5 4 0 0 15 0 1 0 739401441 591699968 46085 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028355 0 0 17 6 0 0 0
/proc/14445/statm: 144458 46085 376 364 0 80355 0
[pid=14447] ppid=14445 vsize=807308 CPUtime=40.05 cores=0-7
/proc/14447/stat : 14447 (cryptominisat-2) R 14445 14447 14447 0 -1 4202496 156653 0 0 0 3984 21 0 0 25 0 1 0 739401442 826683392 147938 33554432000 4194304 4677096 140734098004144 18446744073709551615 4335825 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14447/statm: 201827 147938 387 118 0 196786 0
[pid=14416/tid=14425] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14425/stat : 14425 (python) S 14414 14416 14390 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 739401421 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
[pid=14416/tid=14428] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14428/stat : 14428 (python) S 14414 14416 14390 0 -1 4202560 19 934 0 0 0 0 0 0 25 0 9 0 739401424 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 4 0 0 0
[pid=14416/tid=14431] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14431/stat : 14431 (python) S 14414 14416 14390 0 -1 4202560 21 934 0 0 0 0 0 0 25 0 9 0 739401427 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14434] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14434/stat : 14434 (python) S 14414 14416 14390 0 -1 4202560 19 934 0 0 0 0 0 0 18 0 9 0 739401430 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 5 0 0 0
[pid=14416/tid=14437] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14437/stat : 14437 (python) S 14414 14416 14390 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 9 0 739401433 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14440] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14440/stat : 14440 (python) S 14414 14416 14390 0 -1 4202560 23 934 0 0 0 0 0 0 21 0 9 0 739401436 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
[pid=14416/tid=14443] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14443/stat : 14443 (python) S 14414 14416 14390 0 -1 4202560 26 934 0 0 0 0 0 0 23 0 9 0 739401439 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14446] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14446/stat : 14446 (python) S 14414 14416 14390 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 739401442 602189824 47602 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 383.96
Current children cumulated vsize (KiB) 8317820

[startup+162.301 s]
/proc/loadavg: 7.17 7.00 7.55 9/320 14449
/proc/meminfo: memFree=17926484/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=588076 CPUtime=61.82 cores=0-7
/proc/14416/stat : 14416 (python) S 14414 14416 14390 0 -1 4202496 79289 934 1 0 6157 25 0 0 18 0 9 0 739395236 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/14416/statm: 147019 47603 1890 364 0 82916 0
[pid=14424] ppid=14416 vsize=450748 CPUtime=0.22 cores=0-7
/proc/14424/stat : 14424 (python) S 14416 14416 14390 0 -1 4202560 1189 0 0 0 11 11 0 0 18 0 2 0 739401421 461565952 46099 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/14424/statm: 112687 46099 415 364 0 48605 0

################
# More data... #
################

/proc/meminfo: memFree=95704/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=588076 CPUtime=61.82 cores=0-7
/proc/14416/stat : 14416 (python) S 14414 14416 14390 0 -1 4202496 79289 934 1 0 6157 25 0 0 18 0 9 0 739395236 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/14416/statm: 147019 47603 1890 364 0 82916 0
[pid=14424] ppid=14416 vsize=450748 CPUtime=0.5 cores=0-7
/proc/14424/stat : 14424 (python) S 14416 14416 14390 0 -1 4202560 1217 0 0 0 24 26 0 0 18 0 2 0 739401421 461565952 46099 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/14424/statm: 112687 46099 415 364 0 48605 0
[pid=14426] ppid=14424 vsize=85316 CPUtime=219.38 cores=0-7
/proc/14426/stat : 14426 (lingeling) R 14424 14426 14426 0 -1 4202496 29422 0 0 0 21932 6 0 0 25 0 1 0 739401422 87363584 20498 33554432000 4194304 4352236 140737342214656 18446744073709551615 4278712 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/14426/statm: 21329 20498 129 39 0 20409 0
[pid=14424/tid=14451] ppid=14416 vsize=450748 CPUtime=0 cores=0-7
/proc/14424/task/14451/stat : 14451 (python) S 14416 14416 14390 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 739411443 461565952 46099 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 514 18446604441290354944 0 0 -1 1 0 0 0
[pid=14427] ppid=14416 vsize=450760 CPUtime=1.4 cores=0-7
/proc/14427/stat : 14427 (python) S 14416 14416 14390 0 -1 4202560 1882 0 0 0 102 38 0 0 15 0 1 0 739401424 461578240 46054 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 13583771274118660355 0 0 17 0 0 0 0
/proc/14427/statm: 112690 46054 371 364 0 48605 0
[pid=14429] ppid=14427 vsize=6290816 CPUtime=218.86 cores=0-7
/proc/14429/stat : 14429 (cryptominisat-2) R 14427 14429 14429 0 -1 4202496 7723637 0 0 0 20826 1060 0 0 25 0 1 0 739401424 6441795584 1505297 33554432000 4194304 4677096 140734294897264 18446744073709551615 4564132 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14429/statm: 1572704 1505297 393 118 0 1567663 0
[pid=14430] ppid=14416 vsize=461016 CPUtime=0.49 cores=0-7
/proc/14430/stat : 14430 (python) S 14416 14416 14390 0 -1 4202560 973 0 0 0 24 25 0 0 18 0 1 0 739401426 472080384 46057 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 1 0 0 0
/proc/14430/statm: 115254 46057 370 364 0 51166 0
[pid=14432] ppid=14430 vsize=83152 CPUtime=220.38 cores=0-7
/proc/14432/stat : 14432 (lingeling) R 14430 14432 14432 0 -1 4202496 28877 0 0 0 22034 4 0 0 25 0 1 0 739401427 85147648 19958 33554432000 4194304 4352236 140734632763360 18446744073709551615 4234208 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/14432/statm: 20788 19958 129 39 0 19868 0
[pid=14433] ppid=14416 vsize=471272 CPUtime=1.36 cores=0-7
/proc/14433/stat : 14433 (python) S 14416 14416 14390 0 -1 4202560 1888 0 0 0 96 40 0 0 15 0 1 0 739401429 482582528 46062 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028356 0 0 17 5 0 0 0
/proc/14433/statm: 117818 46062 371 364 0 53727 0
[pid=14435] ppid=14433 vsize=6223464 CPUtime=219.2 cores=0-7
/proc/14435/stat : 14435 (cryptominisat-2) R 14433 14435 14435 0 -1 4202496 7186571 0 0 0 20910 1010 0 0 25 0 1 0 739401430 6372827136 1493635 33554432000 4194304 4677096 140735256885856 18446744073709551615 4336167 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/14435/statm: 1555866 1493635 390 118 0 1550825 0
[pid=14436] ppid=14416 vsize=547064 CPUtime=0.49 cores=0-7
/proc/14436/stat : 14436 (python) S 14416 14416 14390 0 -1 4202560 1013 0 0 0 24 25 0 0 18 0 1 0 739401432 560193536 46067 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028354 0 0 17 1 0 0 0
/proc/14436/statm: 136766 46067 370 364 0 72672 0
[pid=14438] ppid=14436 vsize=88464 CPUtime=216.84 cores=0-7
/proc/14438/stat : 14438 (lingeling) R 14436 14438 14438 0 -1 4202496 30216 0 0 0 21679 5 0 0 25 0 1 0 739401433 90587136 21286 33554432000 4194304 4352236 140735308344112 18446744073709551615 4328063 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/14438/statm: 22116 21286 129 39 0 21196 0
[pid=14439] ppid=14416 vsize=557320 CPUtime=1.39 cores=0-7
/proc/14439/stat : 14439 (python) S 14416 14416 14390 0 -1 4202560 1912 0 0 0 94 45 0 0 15 0 1 0 739401435 570695680 46072 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 3 0 0 0
/proc/14439/statm: 139330 46072 371 364 0 75233 0
[pid=14441] ppid=14439 vsize=6345636 CPUtime=218.15 cores=0-7
/proc/14441/stat : 14441 (cryptominisat-2) R 14439 14441 14441 0 -1 4202496 7209312 0 0 0 20810 1005 0 0 25 0 1 0 739401436 6497931264 1516292 33554432000 4194304 4677096 140733878019680 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/14441/statm: 1586409 1516292 393 118 0 1581368 0
[pid=14442] ppid=14416 vsize=567576 CPUtime=0.48 cores=0-7
/proc/14442/stat : 14442 (python) S 14416 14416 14390 0 -1 4202560 1018 0 0 0 24 24 0 0 18 0 1 0 739401438 581197824 46075 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 0 0 0 0
/proc/14442/statm: 141894 46075 370 364 0 77794 0
[pid=14444] ppid=14442 vsize=211788 CPUtime=218.77 cores=0-7
/proc/14444/stat : 14444 (precosat) R 14442 14444 14444 0 -1 4202496 86575 0 0 0 21866 11 0 0 25 0 1 0 739401439 216870912 51019 33554432000 4194304 4890832 140733880644880 18446744073709551615 4273674 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/14444/statm: 52947 51019 86 171 0 52774 0
[pid=14445] ppid=14416 vsize=577832 CPUtime=1.27 cores=0-7
/proc/14445/stat : 14445 (python) S 14416 14416 14390 0 -1 4202560 1972 0 0 0 89 38 0 0 15 0 1 0 739401441 591699968 46086 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028355 0 0 17 6 0 0 0
/proc/14445/statm: 144458 46086 377 364 0 80355 0
[pid=14447] ppid=14445 vsize=6114412 CPUtime=219.8 cores=0-7
/proc/14447/stat : 14447 (cryptominisat-2) R 14445 14447 14447 0 -1 4202496 7572205 0 0 0 20909 1071 0 0 25 0 1 0 739401442 6261157888 1474067 33554432000 4194304 4677096 140734098004144 18446744073709551615 4336232 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14447/statm: 1528603 1474067 390 118 0 1523562 0
[pid=14416/tid=14425] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14425/stat : 14425 (python) S 14414 14416 14390 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 739401421 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
[pid=14416/tid=14428] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14428/stat : 14428 (python) S 14414 14416 14390 0 -1 4202560 19 934 0 0 0 0 0 0 25 0 9 0 739401424 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 4 0 0 0
[pid=14416/tid=14431] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14431/stat : 14431 (python) S 14414 14416 14390 0 -1 4202560 21 934 0 0 0 0 0 0 25 0 9 0 739401427 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14434] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14434/stat : 14434 (python) S 14414 14416 14390 0 -1 4202560 19 934 0 0 0 0 0 0 18 0 9 0 739401430 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 5 0 0 0
[pid=14416/tid=14437] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14437/stat : 14437 (python) S 14414 14416 14390 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 9 0 739401433 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14440] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14440/stat : 14440 (python) S 14414 14416 14390 0 -1 4202560 23 934 0 0 0 0 0 0 21 0 9 0 739401436 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
[pid=14416/tid=14443] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14443/stat : 14443 (python) S 14414 14416 14390 0 -1 4202560 26 934 0 0 0 0 0 0 23 0 9 0 739401439 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14446] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14446/stat : 14446 (python) S 14414 14416 14390 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 739401442 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1820.58
Current children cumulated vsize (KiB) 30114712



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+328.602 s]
/proc/loadavg: 8.45 7.59 7.67 9/321 14458
/proc/meminfo: memFree=94892/32951124 swapFree=67083432/67111528
[pid=14416] ppid=14414 vsize=588076 CPUtime=61.82 cores=0-7
/proc/14416/stat : 14416 (python) S 14414 14416 14390 0 -1 4202496 79289 934 1 0 6157 25 0 0 18 0 9 0 739395236 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032222667 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/14416/statm: 147019 47603 1890 364 0 82916 0
[pid=14424] ppid=14416 vsize=450748 CPUtime=0.58 cores=0-7
/proc/14424/stat : 14424 (python) S 14416 14416 14390 0 -1 4202560 1217 0 0 0 29 29 0 0 18 0 2 0 739401421 461565952 46099 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/14424/statm: 112687 46099 415 364 0 48605 0
[pid=14426] ppid=14424 vsize=93492 CPUtime=265.57 cores=0-7
/proc/14426/stat : 14426 (lingeling) R 14424 14426 14426 0 -1 4202496 33519 0 0 0 26551 6 0 0 25 0 1 0 739401422 95735808 22542 33554432000 4194304 4352236 140737342214656 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/14426/statm: 23373 22542 129 39 0 22453 0
[pid=14424/tid=14451] ppid=14416 vsize=450748 CPUtime=0 cores=0-7
/proc/14424/task/14451/stat : 14451 (python) S 14416 14416 14390 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 739411443 461565952 46099 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 514 18446604441290354944 0 0 -1 1 0 0 0
[pid=14427] ppid=14416 vsize=450760 CPUtime=1.51 cores=0-7
/proc/14427/stat : 14427 (python) S 14416 14416 14390 0 -1 4202560 1884 0 0 0 108 43 0 0 15 0 1 0 739401424 461578240 46054 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028355 0 0 17 0 0 0 0
/proc/14427/statm: 112690 46054 371 364 0 48605 0
[pid=14429] ppid=14427 vsize=6693880 CPUtime=264.64 cores=0-7
/proc/14429/stat : 14429 (cryptominisat-2) R 14427 14429 14429 0 -1 4202496 7803344 0 0 0 25388 1076 0 0 25 0 1 0 739401424 6854533120 1575961 33554432000 4194304 4677096 140734294897264 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/14429/statm: 1673470 1575961 393 118 0 1668429 0
[pid=14430] ppid=14416 vsize=461016 CPUtime=0.59 cores=0-7
/proc/14430/stat : 14430 (python) S 14416 14416 14390 0 -1 4202560 974 0 0 0 29 30 0 0 18 0 1 0 739401426 472080384 46057 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 1 0 0 0
/proc/14430/statm: 115254 46057 370 364 0 51166 0
[pid=14432] ppid=14430 vsize=87220 CPUtime=266.69 cores=0-7
/proc/14432/stat : 14432 (lingeling) R 14430 14432 14432 0 -1 4202496 29901 0 0 0 26665 4 0 0 25 0 1 0 739401427 89313280 20975 33554432000 4194304 4352236 140734632763360 18446744073709551615 4239210 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/14432/statm: 21805 20975 129 39 0 20885 0
[pid=14433] ppid=14416 vsize=471272 CPUtime=1.47 cores=0-7
/proc/14433/stat : 14433 (python) S 14416 14416 14390 0 -1 4202560 1889 0 0 0 101 46 0 0 15 0 1 0 739401429 482582528 46062 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028356 0 0 17 5 0 0 0
/proc/14433/statm: 117818 46062 371 364 0 53727 0
[pid=14435] ppid=14433 vsize=6654412 CPUtime=265.39 cores=0-7
/proc/14435/stat : 14435 (cryptominisat-2) R 14433 14435 14435 0 -1 4202496 7293051 0 0 0 25512 1027 0 0 25 0 1 0 739401430 6814117888 1591361 33554432000 4194304 4677096 140735256885856 18446744073709551615 4336292 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/14435/statm: 1663603 1591361 393 118 0 1658562 0
[pid=14436] ppid=14416 vsize=547064 CPUtime=0.59 cores=0-7
/proc/14436/stat : 14436 (python) S 14416 14416 14390 0 -1 4202560 1014 0 0 0 29 30 0 0 18 0 1 0 739401432 560193536 46067 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028354 0 0 17 1 0 0 0
/proc/14436/statm: 136766 46067 370 364 0 72672 0
[pid=14438] ppid=14436 vsize=104812 CPUtime=261.43 cores=0-7
/proc/14438/stat : 14438 (lingeling) R 14436 14438 14438 0 -1 4202496 34312 0 0 0 26137 6 0 0 25 0 1 0 739401433 107327488 25373 33554432000 4194304 4352236 140735308344112 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/14438/statm: 26203 25373 129 39 0 25283 0
[pid=14439] ppid=14416 vsize=557320 CPUtime=1.5 cores=0-7
/proc/14439/stat : 14439 (python) S 14416 14416 14390 0 -1 4202560 1912 0 0 0 99 51 0 0 15 0 1 0 739401435 570695680 46072 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 13551625952169001217 0 0 17 3 0 0 0
/proc/14439/statm: 139330 46072 371 364 0 75233 0
[pid=14441] ppid=14439 vsize=6665788 CPUtime=263.39 cores=0-7
/proc/14441/stat : 14441 (cryptominisat-2) R 14439 14441 14441 0 -1 4202496 7289934 0 0 0 25319 1020 0 0 25 0 1 0 739401436 6825766912 1586718 33554432000 4194304 4677096 140733878019680 18446744073709551615 4236529 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14441/statm: 1666447 1586718 393 118 0 1661406 0
[pid=14442] ppid=14416 vsize=567576 CPUtime=0.59 cores=0-7
/proc/14442/stat : 14442 (python) S 14416 14416 14390 0 -1 4202560 1019 0 0 0 30 29 0 0 18 0 1 0 739401438 581197824 46075 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028353 0 0 17 0 0 0 0
/proc/14442/statm: 141894 46075 370 364 0 77794 0
[pid=14444] ppid=14442 vsize=226220 CPUtime=264.79 cores=0-7
/proc/14444/stat : 14444 (precosat) R 14442 14444 14444 0 -1 4202496 94174 0 0 0 26466 13 0 0 25 0 1 0 739401439 231649280 54627 33554432000 4194304 4890832 140733880644880 18446744073709551615 4236287 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/14444/statm: 56555 54627 86 171 0 56382 0
[pid=14445] ppid=14416 vsize=577832 CPUtime=1.39 cores=0-7
/proc/14445/stat : 14445 (python) S 14416 14416 14390 0 -1 4202560 1972 0 0 0 96 43 0 0 15 0 1 0 739401441 591699968 46086 33554432000 4194304 5683644 140737197670400 18446744073709551615 260020416070 0 0 16781312 514 4676513224001028355 0 0 17 6 0 0 0
/proc/14445/statm: 144458 46086 377 364 0 80355 0
[pid=14447] ppid=14445 vsize=6554076 CPUtime=265.66 cores=0-7
/proc/14447/stat : 14447 (cryptominisat-2) R 14445 14447 14447 0 -1 4202496 7660006 0 0 0 25480 1086 0 0 25 0 1 0 739401442 6711373824 1556513 33554432000 4194304 4677096 140734098004144 18446744073709551615 4336232 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/14447/statm: 1638519 1556513 393 118 0 1633478 0
[pid=14416/tid=14425] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14425/stat : 14425 (python) S 14414 14416 14390 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 739401421 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
[pid=14416/tid=14428] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14428/stat : 14428 (python) S 14414 14416 14390 0 -1 4202560 19 934 0 0 0 0 0 0 25 0 9 0 739401424 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 4 0 0 0
[pid=14416/tid=14431] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14431/stat : 14431 (python) S 14414 14416 14390 0 -1 4202560 21 934 0 0 0 0 0 0 25 0 9 0 739401427 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14434] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14434/stat : 14434 (python) S 14414 14416 14390 0 -1 4202560 19 934 0 0 0 0 0 0 18 0 9 0 739401430 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 5 0 0 0
[pid=14416/tid=14437] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14437/stat : 14437 (python) S 14414 14416 14390 0 -1 4202560 26 934 0 0 0 0 0 0 19 0 9 0 739401433 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14440] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14440/stat : 14440 (python) S 14414 14416 14390 0 -1 4202560 23 934 0 0 0 0 0 0 21 0 9 0 739401436 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
[pid=14416/tid=14443] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14443/stat : 14443 (python) S 14414 14416 14390 0 -1 4202560 26 934 0 0 0 0 0 0 23 0 9 0 739401439 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 0 0 0 0
[pid=14416/tid=14446] ppid=14414 vsize=588076 CPUtime=0 cores=0-7
/proc/14416/task/14446/stat : 14446 (python) S 14414 14416 14390 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 739401442 602189824 47603 33554432000 4194304 5683644 140737197670400 18446744073709551615 260032219569 0 0 16781312 2 18446604440629246144 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2187.6
Current children cumulated vsize (KiB) 31751564

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14416 and gives
#  childrusage.ru_utime.tv_sec=61
#  childrusage.ru_utime.tv_usec=578638
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=271958
# CPU time returned by wait4() is 61.8506
# while last known CPU time is 2187.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 328.677
CPU time (s): 2187.6
CPU user time (s): 2141.96
CPU system time (s): 45.64
CPU usage (%): 665.577
Max. virtual memory (cumulated for all children) (KiB): 31751564

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 61.5786
system time used= 0.271958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 80228
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2945
involuntary context switches= 479

runsolver used 1.66875 second user time and 3.05553 second system time

The end

Launcher Data 

Begin job on node110 at 2011-05-15 22:34:06
IDJOB=3380768
IDBENCH=82369
IDSOLVER=1864
FILE ID=node110/3380768-1305491646
RUNJOBID= node110-1305491646-14404
PBS_JOBID= 13325418
Free space on /tmp= 73600 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380768-1305491646/watcher-3380768-1305491646 -o /tmp/evaluation-result-3380768-1305491646/solver-3380768-1305491646 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380768-1305491646.cnf -seed 1112230754 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0385ba51f44fb47d0b0726e26312816f
RANDOM SEED=1112230754

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24398292 kB
Buffers:        301744 kB
Cached:        4511688 kB
SwapCached:       1440 kB
Active:        4760180 kB
Inactive:      3457544 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24398292 kB
SwapTotal:    67111528 kB
SwapFree:     67083432 kB
Dirty:           47512 kB
Writeback:           0 kB
AnonPages:     3402664 kB
Mapped:          26228 kB
Slab:           247852 kB
PageTables:      23524 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 63398248 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73568 MiB
End job on node110 at 2011-05-15 22:39:37