Trace number 3321591

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 3123.76 427.485

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf
MD5SUM28233bedeee44da6e79e63b9febc4d1e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133566
Number of clauses667976
Sum of the clauses size1591941
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2659295
Number of clauses of size 32100
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56370

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.67	c INFO: solving HOME/instance-3321591-1304347731.cnf
0.35/0.67	c INFO: computing task features
2.32/2.64	c INFO: computed variable-clause graph statistics
2.42/2.71	c INFO: computed clause balance statistics
12.62/12.94	c INFO: computed variable balance statistics
19.72/20.06	c INFO: computed small-clause counts
19.82/20.18	c INFO: computed Horn-clause counts
40.82/41.13	c INFO: computed variable graph statistics
40.82/41.13	c INFO: collected features for HOME/instance-3321591-1304347731.cnf in 40.39 s
40.82/41.16	c INFO: running lingeling-276@0 for 97 with 39959 remaining (b = 0.23)
40.82/41.19	c INFO: running cryptominisat-2.9.0@0 for 485 with 39959 remaining (b = 0.21)
40.93/41.22	c INFO: running lingeling-276@0 for 1261 with 39959 remaining (b = 0.35)
40.93/41.26	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39959 remaining (b = 0.44)
40.93/41.29	c INFO: running lingeling-276@0 for 1261 with 39959 remaining (b = 0.28)
41.02/41.32	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39959 remaining (b = 0.34)
41.02/41.36	c INFO: running SApperloT@0 for 97 with 39959 remaining (b = 0.02)
41.02/41.39	c INFO: running precosat-570@0 for 388 with 39959 remaining (b = 0.10)
832.08/140.39	c INFO: running lingeling-276@0 for 1164 with 39860 remaining (b = 0.20)
841.69/141.59	c INFO: running lingeling-276@0 for 97 with 39859 remaining (b = 0.07)
1642.28/241.83	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39758 remaining (b = 0.30)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321591-1304347731/watcher-3321591-1304347731 -o /tmp/evaluation-result-3321591-1304347731/solver-3321591-1304347731 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321591-1304347731.cnf -seed 415846266 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 7.91 7.82 2/248 23563
/proc/meminfo: memFree=29000728/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=15384 CPUtime=0 cores=0-7
/proc/23563/stat : 23563 (python) S 23561 23563 23450 0 -1 4202496 811 0 0 0 0 0 0 0 20 0 1 0 546371137 15753216 696 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244346880 0 2147483391 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 3846 696 334 364 0 333 0

[startup+0.0490889 s]
/proc/loadavg: 8.12 7.91 7.82 2/248 23563
/proc/meminfo: memFree=29000728/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=18888 CPUtime=0.02 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 1289 0 0 0 2 0 0 0 20 0 1 0 546371137 19341312 1141 33554432000 4194304 5683644 140737113262032 18446744073709551615 4438554 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 4722 1141 421 364 0 691 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18888

[startup+0.10108 s]
/proc/loadavg: 8.12 7.91 7.82 2/248 23563
/proc/meminfo: memFree=29000728/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=87708 CPUtime=0.05 cores=0-7
/proc/23563/stat : 23563 (python) S 23561 23563 23450 0 -1 4202496 2639 0 0 0 4 1 0 0 17 0 1 0 546371137 89812992 2354 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244346880 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/23563/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87708

[startup+0.301116 s]
/proc/loadavg: 8.12 7.91 7.82 2/248 23563
/proc/meminfo: memFree=29000728/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=135752 CPUtime=0.18 cores=0-7
/proc/23563/stat : 23563 (python) S 23561 23563 23450 0 -1 4202496 5960 932 1 0 14 4 0 0 17 0 1 0 546371137 139010048 4150 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244344837 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/23563/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700972 s]
/proc/loadavg: 8.12 7.91 7.82 2/248 23563
/proc/meminfo: memFree=29000728/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=291084 CPUtime=0.42 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 12409 932 1 0 31 11 0 0 16 0 1 0 546371137 298070016 10093 33554432000 4194304 5683644 140737113262032 18446744073709551615 47280672596112 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 72771 10093 1761 364 0 8695 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 291084

[startup+1.50086 s]
/proc/loadavg: 8.12 7.91 7.82 2/249 23569
/proc/meminfo: memFree=28945788/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=347252 CPUtime=1.22 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 26383 932 1 0 109 13 0 0 17 0 1 0 546371137 355586048 24067 33554432000 4194304 5683644 140737113262032 18446744073709551615 228243709700 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 86813 24068 1761 364 0 22737 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 347252

[startup+3.10055 s]
/proc/loadavg: 8.12 7.91 7.82 2/249 23569
/proc/meminfo: memFree=28874364/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=414732 CPUtime=2.82 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 58661 932 1 0 265 17 0 0 19 0 1 0 546371137 424685568 41067 33554432000 4194304 5683644 140737113262032 18446744073709551615 4500671 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 103683 41067 1826 364 0 39607 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 414732

[startup+6.30099 s]
/proc/loadavg: 7.55 7.80 7.78 2/249 23569
/proc/meminfo: memFree=28843372/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=414732 CPUtime=6.02 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 58661 932 1 0 585 17 0 0 25 0 1 0 546371137 424685568 41067 33554432000 4194304 5683644 140737113262032 18446744073709551615 4510893 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 103683 41067 1826 364 0 39607 0
Current children cumulated CPU time (s) 6.02
Current children cumulated vsize (KiB) 414732

[startup+12.7009 s]
/proc/loadavg: 7.02 7.69 7.75 2/249 23569
/proc/meminfo: memFree=28844620/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=414732 CPUtime=12.42 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 58661 932 1 0 1225 17 0 0 25 0 1 0 546371137 424685568 41067 33554432000 4194304 5683644 140737113262032 18446744073709551615 4566996 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 103683 41067 1826 364 0 39607 0
Current children cumulated CPU time (s) 12.42
Current children cumulated vsize (KiB) 414732

[startup+25.5006 s]
/proc/loadavg: 5.69 7.36 7.64 2/249 23569
/proc/meminfo: memFree=28846064/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=414732 CPUtime=25.22 cores=0-7
/proc/23563/stat : 23563 (python) R 23561 23563 23450 0 -1 4202496 58668 932 1 0 2505 17 0 0 25 0 1 0 546371137 424685568 41074 33554432000 4194304 5683644 140737113262032 18446744073709551615 47280501749900 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23563/statm: 103683 41074 1833 364 0 39607 0
Current children cumulated CPU time (s) 25.22
Current children cumulated vsize (KiB) 414732

[startup+51.1011 s]
/proc/loadavg: 5.16 7.08 7.54 9/273 23594
/proc/meminfo: memFree=26903548/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=551940 CPUtime=41.13 cores=0-7
/proc/23563/stat : 23563 (python) S 23561 23563 23450 0 -1 4202496 63917 932 1 0 4091 22 0 0 21 0 9 0 546371137 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23563/statm: 137985 38691 1889 364 0 73882 0
[pid=23571] ppid=23563 vsize=404368 CPUtime=0.01 cores=0-7
/proc/23571/stat : 23571 (python) S 23563 23563 23450 0 -1 4202560 923 0 0 0 0 1 0 0 18 0 1 0 546375253 414072832 37020 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368911 0 0 16781312 514 4594384657503453444 0 0 17 1 0 0 0
/proc/23571/statm: 101092 37020 376 364 0 37010 0
[pid=23573] ppid=23571 vsize=28824 CPUtime=9.92 cores=0-7
/proc/23573/stat : 23573 (lingeling) R 23571 23573 23573 0 -1 4202496 14164 0 0 0 990 2 0 0 25 0 1 0 546375254 29515776 6377 33554432000 4194304 4352236 140734757342496 18446744073709551615 4278746 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/23573/statm: 7206 6377 129 39 0 6286 0
[pid=23574] ppid=23563 vsize=414624 CPUtime=0.02 cores=0-7
/proc/23574/stat : 23574 (python) S 23563 23563 23450 0 -1 4202560 909 0 0 0 1 1 0 0 15 0 1 0 546375256 424574976 37018 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114692 0 0 17 1 0 0 0
/proc/23574/statm: 103656 37018 370 364 0 39571 0
[pid=23576] ppid=23574 vsize=755724 CPUtime=9.89 cores=0-7
/proc/23576/stat : 23576 (cryptominisat-2) R 23574 23576 23576 0 -1 4202496 146294 0 0 0 970 19 0 0 25 0 1 0 546375257 773861376 141712 33554432000 4194304 4677096 140735310245760 18446744073709551615 4586888 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23576/statm: 188931 141712 372 118 0 183890 0
[pid=23577] ppid=23563 vsize=490416 CPUtime=0.01 cores=0-7
/proc/23577/stat : 23577 (python) S 23563 23563 23450 0 -1 4202560 786 0 0 0 0 1 0 0 18 0 1 0 546375260 502185984 37140 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 10076886908786409732 0 0 17 1 0 0 0
/proc/23577/statm: 122604 37140 371 364 0 58516 0
[pid=23579] ppid=23577 vsize=28828 CPUtime=9.86 cores=0-7
/proc/23579/stat : 23579 (lingeling) R 23577 23579 23579 0 -1 4202496 14149 0 0 0 984 2 0 0 25 0 1 0 546375260 29519872 6377 33554432000 4194304 4352236 140736061207296 18446744073709551615 4280960 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/23579/statm: 7207 6377 129 39 0 6287 0
[pid=23580] ppid=23563 vsize=500672 CPUtime=0.02 cores=0-7
/proc/23580/stat : 23580 (python) S 23563 23563 23450 0 -1 4202560 800 0 0 0 1 1 0 0 16 0 1 0 546375263 512688128 37124 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114691 0 0 17 4 0 0 0
/proc/23580/statm: 125168 37124 371 364 0 61077 0
[pid=23582] ppid=23580 vsize=755724 CPUtime=9.8 cores=0-7
/proc/23582/stat : 23582 (cryptominisat-2) R 23580 23582 23582 0 -1 4202496 146280 0 0 0 961 19 0 0 25 0 1 0 546375264 773861376 141707 33554432000 4194304 4677096 140736487932080 18446744073709551615 4586920 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23582/statm: 188931 141707 372 118 0 183890 0
[pid=23583] ppid=23563 vsize=510928 CPUtime=0 cores=0-7
/proc/23583/stat : 23583 (python) S 23563 23563 23450 0 -1 4202560 803 0 0 0 0 0 0 0 18 0 1 0 546375266 523190272 37197 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 3306034106680180996 0 0 17 1 0 0 0
/proc/23583/statm: 127732 37197 371 364 0 63638 0
[pid=23585] ppid=23583 vsize=26528 CPUtime=9.78 cores=0-7
/proc/23585/stat : 23585 (lingeling) R 23583 23585 23585 0 -1 4202496 13580 0 0 0 976 2 0 0 25 0 1 0 546375267 27164672 5801 33554432000 4194304 4352236 140736150909808 18446744073709551615 4328055 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/23585/statm: 6632 5801 129 39 0 5712 0
[pid=23586] ppid=23563 vsize=521184 CPUtime=0.01 cores=0-7
/proc/23586/stat : 23586 (python) S 23563 23563 23450 0 -1 4202560 825 0 0 0 0 1 0 0 15 0 1 0 546375270 533692416 37212 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 4589097655841292546 0 0 17 1 0 0 0
/proc/23586/statm: 130296 37212 371 364 0 66199 0
[pid=23588] ppid=23586 vsize=755728 CPUtime=9.66 cores=0-7
/proc/23588/stat : 23588 (cryptominisat-2) R 23586 23588 23588 0 -1 4202496 146286 0 0 0 947 19 0 0 25 0 1 0 546375270 773865472 141707 33554432000 4194304 4677096 140735092552384 18446744073709551615 4586847 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/23588/statm: 188932 141707 372 118 0 183891 0
[pid=23589] ppid=23563 vsize=531440 CPUtime=0 cores=0-7
/proc/23589/stat : 23589 (python) S 23563 23563 23450 0 -1 4202560 823 0 0 0 0 0 0 0 18 0 1 0 546375273 544194560 37216 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 3810370744492196100 0 0 17 1 0 0 0
/proc/23589/statm: 132860 37216 371 364 0 68760 0
[pid=23591] ppid=23589 vsize=30928 CPUtime=9.63 cores=0-7
/proc/23591/stat : 23591 (SApperloT-base) R 23589 23591 23591 0 -1 4202496 7121 0 0 0 961 2 0 0 25 0 1 0 546375275 31670272 6764 33554432000 134512640 135674940 4288727360 18446744073709551615 134551977 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/23591/statm: 7732 6764 99 284 0 7446 0
[pid=23592] ppid=23563 vsize=541696 CPUtime=0.01 cores=0-7
/proc/23592/stat : 23592 (python) S 23563 23563 23450 0 -1 4202560 864 0 0 0 0 1 0 0 18 0 1 0 546375277 554696704 37175 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 4186681897633415425 0 0 17 6 0 0 0
/proc/23592/statm: 135424 37175 377 364 0 71321 0
[pid=23594] ppid=23592 vsize=129124 CPUtime=9.67 cores=0-7
/proc/23594/stat : 23594 (precosat) R 23592 23594 23594 0 -1 4202496 32800 0 0 0 963 4 0 0 25 0 1 0 546375277 132222976 30445 33554432000 4194304 4890832 140735971196464 18446744073709551615 4238505 0 0 16781312 17442 0 0 0 17 6 0 0 0
/proc/23594/statm: 32281 30445 86 171 0 32108 0
[pid=23563/tid=23572] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23572/stat : 23572 (python) S 23561 23563 23450 0 -1 4202560 27 932 0 0 0 0 0 0 25 0 9 0 546375254 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 4 0 0 0
[pid=23563/tid=23575] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23575/stat : 23575 (python) S 23561 23563 23450 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 9 0 546375257 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 3 0 0 0
[pid=23563/tid=23578] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23578/stat : 23578 (python) S 23561 23563 23450 0 -1 4202560 73 932 0 0 0 0 0 0 19 0 9 0 546375260 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23581] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23581/stat : 23581 (python) S 23561 23563 23450 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 9 0 546375263 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23584] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23584/stat : 23584 (python) S 23561 23563 23450 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 9 0 546375267 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23587] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23587/stat : 23587 (python) S 23561 23563 23450 0 -1 4202560 34 932 0 0 0 0 0 0 20 0 9 0 546375270 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 7 0 0 0
[pid=23563/tid=23590] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23590/stat : 23590 (python) S 23561 23563 23450 0 -1 4202560 35 932 0 0 0 0 0 0 19 0 9 0 546375274 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
[pid=23563/tid=23593] ppid=23561 vsize=551940 CPUtime=0 cores=0-7
/proc/23563/task/23593/stat : 23593 (python) S 23561 23563 23450 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 9 0 546375277 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 119.42
Current children cumulated vsize (KiB) 6978676

[startup+102.31 s]
/proc/loadavg: 6.77 7.22 7.56 9/273 23595
/proc/meminfo: memFree=26473000/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=551940 CPUtime=41.13 cores=0-7
/proc/23563/stat : 23563 (python) S 23561 23563 23450 0 -1 4202496 63917 932 1 0 4091 22 0 0 21 0 9 0 546371137 565186560 38691 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23563/statm: 137985 38691 1889 364 0 73882 0
[pid=23571] ppid=23563 vsize=404368 CPUtime=0.11 cores=0-7
/proc/23571/stat : 23571 (python) S 23563 23563 23450 0 -1 4202560 945 0 0 0 5 6 0 0 18 0 1 0 546375253 414072832 37020 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368911 0 0 16781312 514 6231152296932114692 0 0 17 1 0 0 0
/proc/23571/statm: 101092 37020 376 364 0 37010 0
[pid=23573] ppid=23571 vsize=52724 CPUtime=61.13 cores=0-7
/proc/23573/stat : 23573 (lingeling) R 23571 23573 23573 0 -1 4202496 20451 0 0 0 6110 3 0 0 25 0 1 0 546375254 53989376 12352 33554432000 4194304 4352236 140734757342496 18446744073709551615 4208066 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/23573/statm: 13181 12352 129 39 0 12261 0
[pid=23574] ppid=23563 vsize=414624 CPUtime=0.16 cores=0-7
/proc/23574/stat : 23574 (python) S 23563 23563 23450 0 -1 4202560 1003 0 0 0 9 7 0 0 15 0 1 0 546375256 424574976 37019 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 4482510998644687108 0 0 17 3 0 0 0
/proc/23574/statm: 103656 37019 371 364 0 39571 0
[pid=23576] ppid=23574 vsize=1046388 CPUtime=61.08 cores=0-7
/proc/23576/stat : 23576 (cryptominisat-2) R 23574 23576 23576 0 -1 4202496 646567 0 0 0 6027 81 0 0 25 0 1 0 546375257 1071501312 212419 33554432000 4194304 4677096 140735310245760 18446744073709551615 4563790 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23576/statm: 261597 212419 390 118 0 256556 0

################
# More data... #
################

/proc/23588/stat : 23588 (cryptominisat-2) R 23586 23588 23588 0 -1 4202496 8775845 0 0 0 34437 1160 0 0 25 0 1 0 546375270 6941126656 1480005 33554432000 4194304 4677096 140735092552384 18446744073709551615 4236618 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/23588/statm: 1694611 1480005 393 118 0 1689570 0
[pid=23589] ppid=23563 vsize=531440 CPUtime=0.19 cores=0-7
/proc/23589/stat : 23589 (python) S 23563 23563 23450 0 -1 4202560 997 0 0 0 9 10 0 0 19 0 2 0 546375273 544194560 37245 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23589/statm: 132860 37245 399 364 0 68760 0
[pid=23591] ppid=23589 vsize=75636 CPUtime=99.04 cores=0-7
/proc/23591/stat : 23591 (SApperloT-base) T 23589 23591 23591 0 -1 4202496 18418 0 0 0 9899 5 0 0 25 0 1 0 546375275 77451264 17932 33554432000 134512640 135674940 4288727360 18446744073709551615 134564833 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/23591/statm: 18909 17932 99 284 0 18623 0
[pid=23589/tid=23598] ppid=23563 vsize=531440 CPUtime=0 cores=0-7
/proc/23589/task/23598/stat : 23598 (python) S 23563 23563 23450 0 -1 4202560 67 0 0 0 0 0 0 0 19 0 2 0 546385293 544194560 37245 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 514 18446604449504897024 0 0 -1 0 0 0 0
[pid=23592] ppid=23563 vsize=541696 CPUtime=0.7 cores=0-7
/proc/23592/stat : 23592 (python) S 23563 23563 23450 0 -1 4202560 866 0 0 0 34 36 0 0 18 0 1 0 546375277 554696704 37175 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114689 0 0 17 1 0 0 0
/proc/23592/statm: 135424 37175 377 364 0 71321 0
[pid=23594] ppid=23592 vsize=226316 CPUtime=360.7 cores=0-7
/proc/23594/stat : 23594 (precosat) R 23592 23594 23594 0 -1 4202496 108209 0 0 0 36056 14 0 0 25 0 1 0 546375277 231747584 54748 33554432000 4194304 4890832 140735971196464 18446744073709551615 4274298 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/23594/statm: 56579 54748 86 171 0 56406 0
[pid=23599] ppid=23563 vsize=551952 CPUtime=0.19 cores=0-7
/proc/23599/stat : 23599 (python) S 23563 23563 23450 0 -1 4202560 1028 0 0 0 9 10 0 0 19 0 2 0 546385296 565198848 37228 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23599/statm: 137988 37228 399 364 0 73882 0
[pid=23601] ppid=23599 vsize=67600 CPUtime=99.22 cores=0-7
/proc/23601/stat : 23601 (lingeling) T 23599 23601 23601 0 -1 4202496 24174 0 0 0 9919 3 0 0 25 0 1 0 546385297 69222400 16070 33554432000 4194304 4352236 140734721950688 18446744073709551615 4207584 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/23601/statm: 16900 16070 129 39 0 15980 0
[pid=23599/tid=23605] ppid=23563 vsize=551952 CPUtime=0 cores=0-7
/proc/23599/task/23605/stat : 23605 (python) S 23563 23563 23450 0 -1 4202560 77 0 0 0 0 0 0 0 19 0 2 0 546395316 565198848 37228 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 514 18446604444938106176 0 0 -1 0 0 0 0
[pid=23606] ppid=23563 vsize=562208 CPUtime=0.94 cores=0-7
/proc/23606/stat : 23606 (python) S 23563 23563 23450 0 -1 4202560 1230 0 0 0 67 27 0 0 15 0 1 0 546395320 575700992 37516 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114692 0 0 17 6 0 0 0
/proc/23606/statm: 140552 37516 372 364 0 76443 0
[pid=23608] ppid=23606 vsize=4646088 CPUtime=159.5 cores=0-7
/proc/23608/stat : 23608 (cryptominisat-2) R 23606 23608 23608 0 -1 4202496 8437251 0 0 0 14935 1015 0 0 25 0 1 0 546395321 4757594112 1114926 33554432000 4194304 4677096 140733219574560 18446744073709551615 4336322 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23608/statm: 1161522 1114926 390 118 0 1156481 0
[pid=23563/tid=23572] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23572/stat : 23572 (python) S 23561 23563 23450 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 11 0 546375254 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 4 0 0 0
[pid=23563/tid=23575] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23575/stat : 23575 (python) S 23561 23563 23450 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 11 0 546375257 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 3 0 0 0
[pid=23563/tid=23578] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23578/stat : 23578 (python) S 23561 23563 23450 0 -1 4202560 73 932 0 0 0 0 0 0 19 0 11 0 546375260 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23581] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23581/stat : 23581 (python) S 23561 23563 23450 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 11 0 546375263 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23584] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23584/stat : 23584 (python) S 23561 23563 23450 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 11 0 546375267 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23587] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23587/stat : 23587 (python) S 23561 23563 23450 0 -1 4202560 34 932 0 0 0 0 0 0 20 0 11 0 546375270 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 7 0 0 0
[pid=23563/tid=23590] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23590/stat : 23590 (python) S 23561 23563 23450 0 -1 4202560 35 932 0 0 0 0 0 0 19 0 11 0 546375274 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
[pid=23563/tid=23593] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23593/stat : 23593 (python) S 23561 23563 23450 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 11 0 546375277 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 6 0 0 0
[pid=23563/tid=23600] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23600/stat : 23600 (python) S 23561 23563 23450 0 -1 4202560 39 932 0 0 0 0 0 0 19 0 11 0 546385297 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
[pid=23563/tid=23607] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23607/stat : 23607 (python) S 23561 23563 23450 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 11 0 546395321 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2923.29
Current children cumulated vsize (KiB) 31120356



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+427.402 s]
/proc/loadavg: 8.01 7.78 7.70 9/282 23613
/proc/meminfo: memFree=5466864/32951124 swapFree=67111364/67111528
[pid=23563] ppid=23561 vsize=572452 CPUtime=41.25 cores=0-7
/proc/23563/stat : 23563 (python) S 23561 23563 23450 0 -1 4202496 65487 932 1 0 4102 23 0 0 19 0 11 0 546371137 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/23563/statm: 143113 38717 1894 364 0 79004 0
[pid=23571] ppid=23563 vsize=414612 CPUtime=0.72 cores=0-7
/proc/23571/stat : 23571 (python) S 23563 23563 23450 0 -1 4202560 1148 0 0 0 35 37 0 0 18 0 2 0 546375253 424562688 37059 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23571/statm: 103653 37059 410 364 0 39571 0
[pid=23573] ppid=23571 vsize=101804 CPUtime=382.37 cores=0-7
/proc/23573/stat : 23573 (lingeling) R 23571 23573 23573 0 -1 4202496 39152 0 0 0 38232 5 0 0 25 0 1 0 546375254 104247296 24622 33554432000 4194304 4352236 140734757342496 18446744073709551615 4278712 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/23573/statm: 25451 24622 129 39 0 24531 0
[pid=23571/tid=23597] ppid=23563 vsize=414612 CPUtime=0 cores=0-7
/proc/23571/task/23597/stat : 23597 (python) S 23563 23563 23450 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 546385173 424562688 37059 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 514 18446604453982406784 0 0 -1 2 0 0 0
[pid=23574] ppid=23563 vsize=414624 CPUtime=1.58 cores=0-7
/proc/23574/stat : 23574 (python) S 23563 23563 23450 0 -1 4202560 2309 0 0 0 104 54 0 0 15 0 1 0 546375256 424574976 37019 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 4482510998644687108 0 0 17 3 0 0 0
/proc/23574/statm: 103656 37019 371 364 0 39571 0
[pid=23576] ppid=23574 vsize=7006932 CPUtime=384.76 cores=0-7
/proc/23576/stat : 23576 (cryptominisat-2) R 23574 23576 23576 0 -1 4202496 8893067 0 0 0 37305 1171 0 0 25 0 1 0 546375257 7175098368 1526565 33554432000 4194304 4677096 140735310245760 18446744073709551615 4519697 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23576/statm: 1751733 1526565 393 118 0 1746692 0
[pid=23577] ppid=23563 vsize=490416 CPUtime=0.73 cores=0-7
/proc/23577/stat : 23577 (python) S 23563 23563 23450 0 -1 4202560 787 0 0 0 35 38 0 0 18 0 1 0 546375260 502185984 37140 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114692 0 0 17 1 0 0 0
/proc/23577/statm: 122604 37140 371 364 0 58516 0
[pid=23579] ppid=23577 vsize=112328 CPUtime=386.17 cores=0-7
/proc/23579/stat : 23579 (lingeling) R 23577 23579 23579 0 -1 4202496 41661 0 0 0 38612 5 0 0 25 0 1 0 546375260 115023872 27252 33554432000 4194304 4352236 140736061207296 18446744073709551615 4207623 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/23579/statm: 28082 27252 129 39 0 27162 0
[pid=23580] ppid=23563 vsize=500672 CPUtime=1.42 cores=0-7
/proc/23580/stat : 23580 (python) S 23563 23563 23450 0 -1 4202560 1193 0 0 0 95 47 0 0 15 0 1 0 546375263 512688128 37439 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114691 0 0 17 4 0 0 0
/proc/23580/statm: 125168 37439 372 364 0 61077 0
[pid=23582] ppid=23580 vsize=6620264 CPUtime=384.67 cores=0-7
/proc/23582/stat : 23582 (cryptominisat-2) R 23580 23582 23582 0 -1 4202496 8801923 0 0 0 37367 1100 0 0 25 0 1 0 546375264 6779150336 1465415 33554432000 4194304 4677096 140736487932080 18446744073709551615 4336406 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23582/statm: 1655066 1465415 393 118 0 1650025 0
[pid=23583] ppid=23563 vsize=510928 CPUtime=0.72 cores=0-7
/proc/23583/stat : 23583 (python) S 23563 23563 23450 0 -1 4202560 805 0 0 0 35 37 0 0 18 0 1 0 546375266 523190272 37197 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114692 0 0 17 1 0 0 0
/proc/23583/statm: 127732 37197 371 364 0 63638 0
[pid=23585] ppid=23583 vsize=106484 CPUtime=386.1 cores=0-7
/proc/23585/stat : 23585 (lingeling) R 23583 23585 23585 0 -1 4202496 36095 0 0 0 38605 5 0 0 25 0 1 0 546375267 109039616 25790 33554432000 4194304 4352236 140736150909808 18446744073709551615 4278749 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/23585/statm: 26621 25790 129 39 0 25701 0
[pid=23586] ppid=23563 vsize=521184 CPUtime=1.6 cores=0-7
/proc/23586/stat : 23586 (python) S 23563 23563 23450 0 -1 4202560 1664 0 0 0 106 54 0 0 15 0 1 0 546375270 533692416 37523 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114690 0 0 17 7 0 0 0
/proc/23586/statm: 130296 37523 372 364 0 66199 0
[pid=23588] ppid=23586 vsize=6910320 CPUtime=380.91 cores=0-7
/proc/23588/stat : 23588 (cryptominisat-2) R 23586 23588 23588 0 -1 4202496 8813582 0 0 0 36926 1165 0 0 25 0 1 0 546375270 7076167680 1510132 33554432000 4194304 4677096 140735092552384 18446744073709551615 4334070 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/23588/statm: 1727580 1510132 393 118 0 1722539 0
[pid=23589] ppid=23563 vsize=531440 CPUtime=0.19 cores=0-7
/proc/23589/stat : 23589 (python) S 23563 23563 23450 0 -1 4202560 997 0 0 0 9 10 0 0 19 0 2 0 546375273 544194560 37245 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23589/statm: 132860 37245 399 364 0 68760 0
[pid=23591] ppid=23589 vsize=75636 CPUtime=99.04 cores=0-7
/proc/23591/stat : 23591 (SApperloT-base) T 23589 23591 23591 0 -1 4202496 18418 0 0 0 9899 5 0 0 25 0 1 0 546375275 77451264 17932 33554432000 134512640 135674940 4288727360 18446744073709551615 134564833 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/23591/statm: 18909 17932 99 284 0 18623 0
[pid=23589/tid=23598] ppid=23563 vsize=531440 CPUtime=0 cores=0-7
/proc/23589/task/23598/stat : 23598 (python) S 23563 23563 23450 0 -1 4202560 67 0 0 0 0 0 0 0 19 0 2 0 546385293 544194560 37245 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 514 18446604449504897024 0 0 -1 0 0 0 0
[pid=23592] ppid=23563 vsize=541696 CPUtime=0.75 cores=0-7
/proc/23592/stat : 23592 (python) S 23563 23563 23450 0 -1 4202560 866 0 0 0 37 38 0 0 18 0 1 0 546375277 554696704 37175 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114689 0 0 17 1 0 0 0
/proc/23592/statm: 135424 37175 377 364 0 71321 0
[pid=23594] ppid=23592 vsize=223256 CPUtime=385.81 cores=0-7
/proc/23594/stat : 23594 (precosat) R 23592 23594 23594 0 -1 4202496 110543 0 0 0 38567 14 0 0 25 0 1 0 546375277 228614144 53983 33554432000 4194304 4890832 140735971196464 18446744073709551615 4237573 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/23594/statm: 55814 53983 86 171 0 55641 0
[pid=23599] ppid=23563 vsize=551952 CPUtime=0.19 cores=0-7
/proc/23599/stat : 23599 (python) S 23563 23563 23450 0 -1 4202560 1028 0 0 0 9 10 0 0 19 0 2 0 546385296 565198848 37228 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256175563 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23599/statm: 137988 37228 399 364 0 73882 0
[pid=23601] ppid=23599 vsize=67600 CPUtime=99.22 cores=0-7
/proc/23601/stat : 23601 (lingeling) T 23599 23601 23601 0 -1 4202496 24174 0 0 0 9919 3 0 0 25 0 1 0 546385297 69222400 16070 33554432000 4194304 4352236 140734721950688 18446744073709551615 4207584 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/23601/statm: 16900 16070 129 39 0 15980 0
[pid=23599/tid=23605] ppid=23563 vsize=551952 CPUtime=0 cores=0-7
/proc/23599/task/23605/stat : 23605 (python) S 23563 23563 23450 0 -1 4202560 77 0 0 0 0 0 0 0 19 0 2 0 546395316 565198848 37228 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 514 18446604444938106176 0 0 -1 0 0 0 0
[pid=23606] ppid=23563 vsize=562208 CPUtime=1 cores=0-7
/proc/23606/stat : 23606 (python) S 23563 23563 23450 0 -1 4202560 1230 0 0 0 70 30 0 0 15 0 1 0 546395320 575700992 37516 33554432000 4194304 5683644 140737113262032 18446744073709551615 228244368966 0 0 16781312 514 6231152296932114692 0 0 17 6 0 0 0
/proc/23606/statm: 140552 37516 372 364 0 76443 0
[pid=23608] ppid=23606 vsize=4912312 CPUtime=184.56 cores=0-7
/proc/23608/stat : 23608 (cryptominisat-2) R 23606 23608 23608 0 -1 4202496 8478871 0 0 0 17435 1021 0 0 25 0 1 0 546395321 5030207488 1156546 33554432000 4194304 4677096 140733219574560 18446744073709551615 4250231 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23608/statm: 1228078 1156546 393 118 0 1223037 0
[pid=23563/tid=23572] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23572/stat : 23572 (python) S 23561 23563 23450 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 11 0 546375254 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 4 0 0 0
[pid=23563/tid=23575] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23575/stat : 23575 (python) S 23561 23563 23450 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 11 0 546375257 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 3 0 0 0
[pid=23563/tid=23578] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23578/stat : 23578 (python) S 23561 23563 23450 0 -1 4202560 73 932 0 0 0 0 0 0 19 0 11 0 546375260 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23581] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23581/stat : 23581 (python) S 23561 23563 23450 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 11 0 546375263 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23584] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23584/stat : 23584 (python) S 23561 23563 23450 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 11 0 546375267 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 0 0 0 0
[pid=23563/tid=23587] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23587/stat : 23587 (python) S 23561 23563 23450 0 -1 4202560 34 932 0 0 0 0 0 0 20 0 11 0 546375270 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 7 0 0 0
[pid=23563/tid=23590] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23590/stat : 23590 (python) S 23561 23563 23450 0 -1 4202560 35 932 0 0 0 0 0 0 19 0 11 0 546375274 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
[pid=23563/tid=23593] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23593/stat : 23593 (python) S 23561 23563 23450 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 11 0 546375277 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 6 0 0 0
[pid=23563/tid=23600] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23600/stat : 23600 (python) S 23561 23563 23450 0 -1 4202560 39 932 0 0 0 0 0 0 19 0 11 0 546385297 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
[pid=23563/tid=23607] ppid=23561 vsize=572452 CPUtime=0 cores=0-7
/proc/23563/task/23607/stat : 23607 (python) S 23561 23563 23450 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 11 0 546395321 586190848 38717 33554432000 4194304 5683644 140737113262032 18446744073709551615 228256172465 0 0 16781312 2 18446604453977366784 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3123.76
Current children cumulated vsize (KiB) 31749120

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23563 and gives
#  childrusage.ru_utime.tv_sec=41
#  childrusage.ru_utime.tv_usec=24763
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=251961
# CPU time returned by wait4() is 41.2767
# while last known CPU time is 3123.76
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 427.485
CPU time (s): 3123.76
CPU user time (s): 3075.04
CPU system time (s): 48.72
CPU usage (%): 730.731
Max. virtual memory (cumulated for all children) (KiB): 31749120

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 41.0248
system time used= 0.251961
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66426
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3126
involuntary context switches= 87

runsolver used 1.87172 second user time and 4.5743 second system time

The end

Launcher Data 

Begin job on node136 at 2011-05-02 16:48:52
IDJOB=3321591
IDBENCH=82392
IDSOLVER=1710
FILE ID=node136/3321591-1304347731
RUNJOBID= node136-1304347125-23464
PBS_JOBID= 13178655
Free space on /tmp= 73908 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321591-1304347731/watcher-3321591-1304347731 -o /tmp/evaluation-result-3321591-1304347731/solver-3321591-1304347731 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321591-1304347731.cnf -seed 415846266 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 28233bedeee44da6e79e63b9febc4d1e
RANDOM SEED=415846266

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29001008 kB
Buffers:        669248 kB
Cached:        1540372 kB
SwapCached:          0 kB
Active:        1685632 kB
Inactive:      1812184 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29001008 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           43580 kB
Writeback:          36 kB
AnonPages:     1288752 kB
Mapped:          21688 kB
Slab:           372348 kB
PageTables:      14760 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 40136940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73876 MiB
End job on node136 at 2011-05-02 16:56:01