Trace number 3378033

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 1298.95 1300.03

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-01.cnf
MD5SUMd2f77e32530988f77dca5112174eee00
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables7502
Number of clauses28770
Sum of the clauses size76290
Maximum clause length847
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 215814
Number of clauses of size 311119
Number of clauses of size 4733
Number of clauses of size 5172
Number of clauses of size over 5931

Solver Data 

0.57/2.03	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.57/2.03	c INFO: solving HOME/instance-3378033-1305452698.cnf
0.57/2.03	c INFO: computing task features
0.57/2.11	c INFO: computed variable-clause graph statistics
0.57/2.12	c INFO: computed clause balance statistics
1.14/2.62	c INFO: computed variable balance statistics
1.44/2.98	c INFO: computed small-clause counts
1.44/2.99	c INFO: computed Horn-clause counts
1.64/3.11	c INFO: computed variable graph statistics
1.64/3.11	c INFO: collected features for HOME/instance-3378033-1305452698.cnf in 1.06 s
1.64/3.12	c INFO: running lingeling-276@0 for 582 with 2398 remaining (b = 0.58)
589.05/590.31	c INFO: running lingeling-276@0 for 97 with 1812 remaining (b = 0.26)
689.23/690.55	c INFO: running cryptominisat-2.9.0@0 for 1712 with 1712 remaining (b = 0.56)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378033-1305452698/watcher-3378033-1305452698 -o /tmp/evaluation-result-3378033-1305452698/solver-3378033-1305452698 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378033-1305452698.cnf -seed 743672776 -budget 2400 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.03 1.88 3.11 5/265 28409
/proc/meminfo: memFree=22860432/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=6240 CPUtime=0 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4194304 95 0 2 0 0 0 0 0 20 0 1 0 656868012 6389760 51 33554432000 4194304 5683644 140737077087536 18446744073709551615 246511910535 0 2147483391 4096 0 18446744071699453118 0 0 17 0 0 0 0
/proc/28409/statm: 1560 51 40 364 0 42 0

[startup+0.0217099 s]
/proc/loadavg: 1.03 1.88 3.11 5/265 28409
/proc/meminfo: memFree=22860432/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=15080 CPUtime=0 cores=0,2
/proc/28409/stat : 28409 (python) D 28407 28409 27642 0 -1 4202496 609 0 6 0 0 0 0 0 20 0 1 0 656868012 15441920 513 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516832256 0 0 16781312 2 0 0 0 17 0 0 0 1
/proc/28409/statm: 3770 513 300 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.100705 s]
/proc/loadavg: 1.03 1.88 3.11 5/265 28409
/proc/meminfo: memFree=22860432/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=16808 CPUtime=0.02 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 1205 0 6 0 1 1 0 0 17 0 1 0 656868012 17211392 1071 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 0 0 0 2
/proc/28409/statm: 4202 1071 417 364 0 689 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16808

[startup+0.300663 s]
/proc/loadavg: 1.03 1.88 3.11 5/265 28409
/proc/meminfo: memFree=22860432/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=50008 CPUtime=0.08 cores=0,2
/proc/28409/stat : 28409 (python) D 28407 28409 27642 0 -1 4202496 1932 0 14 0 4 4 0 0 17 0 1 0 656868012 51208192 1712 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516830053 0 0 16781312 2 0 0 0 17 0 0 0 4
/proc/28409/statm: 12502 1712 476 364 0 1202 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 50008

[startup+0.700598 s]
/proc/loadavg: 1.03 1.88 3.11 5/265 28409
/proc/meminfo: memFree=22860432/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=119072 CPUtime=0.17 cores=0,2
/proc/28409/stat : 28409 (python) R 28407 28409 27642 0 -1 4202496 3844 0 31 0 7 10 0 0 16 0 1 0 656868012 121929728 3510 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516832256 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/28409/statm: 29768 3510 909 364 0 2652 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 119072

[startup+1.50039 s]
/proc/loadavg: 1.03 1.88 3.11 7/274 28433
/proc/meminfo: memFree=22755240/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=202000 CPUtime=0.45 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 7169 926 62 8 21 24 0 0 16 0 1 0 656868012 206848000 5254 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 20
/proc/28409/statm: 50500 5254 1490 364 0 4009 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 202000

[startup+3.10116 s]
/proc/loadavg: 1.03 1.88 3.11 7/275 28438
/proc/meminfo: memFree=22639088/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=283872 CPUtime=1.64 cores=0,2
/proc/28409/stat : 28409 (python) R 28407 28409 27642 0 -1 4202496 11443 926 83 8 136 28 0 0 17 0 1 0 656868012 290684928 8360 33554432000 4194304 5683644 140737077087536 18446744073709551615 47634026938825 0 0 16781312 2 0 0 0 17 0 0 0 26
/proc/28409/statm: 70968 8360 1833 364 0 6892 0
Current children cumulated CPU time (s) 1.64
Current children cumulated vsize (KiB) 283872
heavy processes:

[startup+6.30054 s]
/proc/loadavg: 1.35 1.93 3.12 5/281 28444
/proc/meminfo: memFree=22383312/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 656868324 288210944 6271 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 10919514687162777859 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6271 354 364 0 6282 0
[pid=28444] ppid=28442 vsize=9880 CPUtime=3.12 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 2147 0 0 0 312 0 0 0 25 0 1 0 656868325 10117120 1640 33554432000 4194304 4352236 140734104929264 18446744073709551615 4328429 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28444/statm: 2470 1640 129 39 0 1550 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.78
Current children cumulated vsize (KiB) 583036
heavy processes:

[startup+12.7104 s]
/proc/loadavg: 1.56 1.96 3.12 5/281 28445
/proc/meminfo: memFree=22336608/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 877 0 0 0 0 0 0 0 18 0 1 0 656868324 288210944 6294 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 10919514687162777859 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6294 377 364 0 6282 0
[pid=28444] ppid=28442 vsize=11176 CPUtime=9.52 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 2823 0 0 0 952 0 0 0 25 0 1 0 656868325 11444224 1964 33554432000 4194304 4352236 140734104929264 18446744073709551615 4331510 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28444/statm: 2794 1964 129 39 0 1874 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.18
Current children cumulated vsize (KiB) 584332

[startup+25.501 s]
/proc/loadavg: 2.10 2.06 3.14 5/281 28445
/proc/meminfo: memFree=22337956/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0.04 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 887 0 0 0 2 2 0 0 18 0 1 0 656868324 288210944 6294 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 12949379448876007683 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6294 377 364 0 6282 0
[pid=28444] ppid=28442 vsize=11432 CPUtime=22.29 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 4519 0 0 0 2229 0 0 0 25 0 1 0 656868325 11706368 2028 33554432000 4194304 4352236 140734104929264 18446744073709551615 4329367 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/28444/statm: 2858 2028 129 39 0 1938 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.99
Current children cumulated vsize (KiB) 584588

[startup+51.1004 s]
/proc/loadavg: 2.82 2.23 3.16 5/284 28449
/proc/meminfo: memFree=22213624/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0.09 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 898 0 0 0 5 4 0 0 18 0 1 0 656868324 288210944 6294 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 12949379448876007683 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6294 377 364 0 6282 0
[pid=28444] ppid=28442 vsize=15540 CPUtime=47.86 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 8638 0 0 0 4786 0 0 0 25 0 1 0 656868325 15912960 3075 33554432000 4194304 4352236 140734104929264 18446744073709551615 4278746 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28444/statm: 3885 3075 129 39 0 2965 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 49.61
Current children cumulated vsize (KiB) 588696

[startup+102.301 s]
/proc/loadavg: 3.64 2.55 3.22 5/284 28450
/proc/meminfo: memFree=22211400/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0.19 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 919 0 0 0 11 8 0 0 18 0 1 0 656868324 288210944 6294 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 12949379448876007683 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6294 377 364 0 6282 0
[pid=28444] ppid=28442 vsize=17428 CPUtime=99 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 13631 0 0 0 9899 1 0 0 25 0 1 0 656868325 17846272 3559 33554432000 4194304 4352236 140734104929264 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28444/statm: 4357 3559 129 39 0 3437 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 100.85
Current children cumulated vsize (KiB) 590584

[startup+162.31 s]
/proc/loadavg: 3.99 2.84 3.28 5/288 28456
/proc/meminfo: memFree=22084728/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0.31 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 943 0 0 0 18 13 0 0 18 0 1 0 656868324 288210944 6294 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 12949379448876007683 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6294 377 364 0 6282 0
[pid=28444] ppid=28442 vsize=23576 CPUtime=158.95 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 22080 0 0 0 15893 2 0 0 25 0 1 0 656868325 24141824 5096 33554432000 4194304 4352236 140734104929264 18446744073709551615 4279815 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28444/statm: 5894 5096 129 39 0 4974 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 160.92
Current children cumulated vsize (KiB) 596732

[startup+222.301 s]
/proc/loadavg: 3.99 3.05 3.32 5/291 28460
/proc/meminfo: memFree=21718768/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=291700 CPUtime=1.66 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 11756 926 83 8 138 28 0 0 19 0 2 0 656868012 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 72925 7788 1867 364 0 8843 0
[pid=28442] ppid=28409 vsize=281456 CPUtime=0.44 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 960 0 0 0 26 18 0 0 18 0 1 0 656868324 288210944 6294 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854287 0 0 16781312 514 12949379448876007683 0 0 17 0 0 0 0
/proc/28442/statm: 70364 6294 377 364 0 6282 0
[pid=28444] ppid=28442 vsize=23064 CPUtime=218.89 cores=0,2
/proc/28444/stat : 28444 (lingeling) R 28442 28444 28444 0 -1 4202496 27136 0 0 0 21885 4 0 0 25 0 1 0 656868325 23617536 4968 33554432000 4194304 4352236 140734104929264 18446744073709551615 4328075 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/28444/statm: 5766 4968 129 39 0 4846 0
[pid=28409/tid=28443] ppid=28407 vsize=291700 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 2 0 656868325 298700800 7788 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0

################
# More data... #
################

[startup+1122.3 s]
/proc/loadavg: 4.00 3.97 3.74 5/350 28610
/proc/meminfo: memFree=18132620/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=312212 CPUtime=1.69 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 13384 926 83 8 140 29 0 0 20 0 4 0 656868012 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 78053 7809 1880 364 0 13965 0
[pid=28442] ppid=28409 vsize=291700 CPUtime=1.27 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 1186 0 0 0 70 57 0 0 19 0 2 0 656868324 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28442/statm: 72925 6338 416 364 0 8843 0
[pid=28444] ppid=28442 vsize=29212 CPUtime=586.12 cores=0,2
/proc/28444/stat : 28444 (lingeling) T 28442 28444 28444 0 -1 4202496 54721 0 0 0 58605 7 0 0 25 0 1 0 656868325 29913088 6505 33554432000 4194304 4352236 140734104929264 18446744073709551615 4276629 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/28444/statm: 7303 6505 129 39 0 6383 0
[pid=28442/tid=28503] ppid=28409 vsize=291700 CPUtime=0 cores=0,2
/proc/28442/task/28503/stat : 28503 (python) S 28409 28409 27642 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 656927043 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604442570188992 0 0 -1 0 0 0 0
[pid=28504] ppid=28409 vsize=291712 CPUtime=0.23 cores=0,2
/proc/28504/stat : 28504 (python) S 28409 28409 27642 0 -1 4202560 1094 0 0 0 13 10 0 0 19 0 2 0 656927044 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28504/statm: 72928 6322 400 364 0 8843 0
[pid=28506] ppid=28504 vsize=17408 CPUtime=99.98 cores=0,2
/proc/28506/stat : 28506 (lingeling) T 28504 28506 28506 0 -1 4202496 13052 0 0 0 9997 1 0 0 25 0 1 0 656927044 17825792 3523 33554432000 4194304 4352236 140735510109536 18446744073709551615 4328047 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/28506/statm: 4352 3523 129 39 0 3432 0
[pid=28504/tid=28522] ppid=28409 vsize=291712 CPUtime=0 cores=0,2
/proc/28504/task/28522/stat : 28522 (python) S 28409 28409 27642 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656937066 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604450394717120 0 0 -1 2 0 0 0
[pid=28523] ppid=28409 vsize=301968 CPUtime=1.11 cores=0,2
/proc/28523/stat : 28523 (python) S 28409 28409 27642 0 -1 4202560 997 0 0 0 65 46 0 0 15 0 1 0 656937067 309215232 6296 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854342 0 0 16781312 514 12949379448876007684 0 0 17 0 0 0 0
/proc/28523/statm: 75492 6296 371 364 0 11404 0
[pid=28525] ppid=28523 vsize=121212 CPUtime=430.74 cores=0,2
/proc/28525/stat : 28525 (cryptominisat-2) R 28523 28525 28525 0 -1 4202496 130486 0 0 0 43037 37 0 0 25 0 1 0 656937067 124121088 22733 33554432000 4194304 4677096 140737034241760 18446744073709551615 4320315 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/28525/statm: 30303 22733 393 118 0 25262 0
[pid=28409/tid=28443] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 4 0 656868325 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28505] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28505/stat : 28505 (python) S 28407 28409 27642 0 -1 4202560 27 926 0 8 0 0 0 0 20 0 4 0 656927044 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28524] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28524/stat : 28524 (python) S 28407 28409 27642 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 4 0 656937067 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1121.14
Current children cumulated vsize (KiB) 1365424

[startup+1182.3 s]
/proc/loadavg: 4.20 4.02 3.77 5/354 28621
/proc/meminfo: memFree=18000044/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=312212 CPUtime=1.69 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 13384 926 83 8 140 29 0 0 20 0 4 0 656868012 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 78053 7809 1880 364 0 13965 0
[pid=28442] ppid=28409 vsize=291700 CPUtime=1.27 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 1186 0 0 0 70 57 0 0 19 0 2 0 656868324 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28442/statm: 72925 6338 416 364 0 8843 0
[pid=28444] ppid=28442 vsize=29212 CPUtime=586.12 cores=0,2
/proc/28444/stat : 28444 (lingeling) T 28442 28444 28444 0 -1 4202496 54721 0 0 0 58605 7 0 0 25 0 1 0 656868325 29913088 6505 33554432000 4194304 4352236 140734104929264 18446744073709551615 4276629 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/28444/statm: 7303 6505 129 39 0 6383 0
[pid=28442/tid=28503] ppid=28409 vsize=291700 CPUtime=0 cores=0,2
/proc/28442/task/28503/stat : 28503 (python) S 28409 28409 27642 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 656927043 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604442570188992 0 0 -1 0 0 0 0
[pid=28504] ppid=28409 vsize=291712 CPUtime=0.23 cores=0,2
/proc/28504/stat : 28504 (python) S 28409 28409 27642 0 -1 4202560 1094 0 0 0 13 10 0 0 19 0 2 0 656927044 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28504/statm: 72928 6322 400 364 0 8843 0
[pid=28506] ppid=28504 vsize=17408 CPUtime=99.98 cores=0,2
/proc/28506/stat : 28506 (lingeling) T 28504 28506 28506 0 -1 4202496 13052 0 0 0 9997 1 0 0 25 0 1 0 656927044 17825792 3523 33554432000 4194304 4352236 140735510109536 18446744073709551615 4328047 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/28506/statm: 4352 3523 129 39 0 3432 0
[pid=28504/tid=28522] ppid=28409 vsize=291712 CPUtime=0 cores=0,2
/proc/28504/task/28522/stat : 28522 (python) S 28409 28409 27642 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656937066 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604450394717120 0 0 -1 2 0 0 0
[pid=28523] ppid=28409 vsize=301968 CPUtime=1.27 cores=0,2
/proc/28523/stat : 28523 (python) S 28409 28409 27642 0 -1 4202560 997 0 0 0 74 53 0 0 15 0 1 0 656937067 309215232 6296 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854342 0 0 16781312 514 12949379448876007684 0 0 17 0 0 0 0
/proc/28523/statm: 75492 6296 371 364 0 11404 0
[pid=28525] ppid=28523 vsize=121416 CPUtime=490.6 cores=0,2
/proc/28525/stat : 28525 (cryptominisat-2) R 28523 28525 28525 0 -1 4202496 143163 0 0 0 49021 39 0 0 25 0 1 0 656937067 124329984 23531 33554432000 4194304 4677096 140737034241760 18446744073709551615 4318914 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/28525/statm: 30354 23531 393 118 0 25313 0
[pid=28409/tid=28443] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 4 0 656868325 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28505] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28505/stat : 28505 (python) S 28407 28409 27642 0 -1 4202560 27 926 0 8 0 0 0 0 20 0 4 0 656927044 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28524] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28524/stat : 28524 (python) S 28407 28409 27642 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 4 0 656937067 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1181.16
Current children cumulated vsize (KiB) 1365628

[startup+1242.3 s]
/proc/loadavg: 4.15 4.04 3.79 5/352 28648
/proc/meminfo: memFree=18180520/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=312212 CPUtime=1.69 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 13384 926 83 8 140 29 0 0 20 0 4 0 656868012 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 78053 7809 1880 364 0 13965 0
[pid=28442] ppid=28409 vsize=291700 CPUtime=1.27 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 1186 0 0 0 70 57 0 0 19 0 2 0 656868324 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28442/statm: 72925 6338 416 364 0 8843 0
[pid=28444] ppid=28442 vsize=29212 CPUtime=586.12 cores=0,2
/proc/28444/stat : 28444 (lingeling) T 28442 28444 28444 0 -1 4202496 54721 0 0 0 58605 7 0 0 25 0 1 0 656868325 29913088 6505 33554432000 4194304 4352236 140734104929264 18446744073709551615 4276629 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/28444/statm: 7303 6505 129 39 0 6383 0
[pid=28442/tid=28503] ppid=28409 vsize=291700 CPUtime=0 cores=0,2
/proc/28442/task/28503/stat : 28503 (python) S 28409 28409 27642 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 656927043 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604442570188992 0 0 -1 0 0 0 0
[pid=28504] ppid=28409 vsize=291712 CPUtime=0.23 cores=0,2
/proc/28504/stat : 28504 (python) S 28409 28409 27642 0 -1 4202560 1094 0 0 0 13 10 0 0 19 0 2 0 656927044 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28504/statm: 72928 6322 400 364 0 8843 0
[pid=28506] ppid=28504 vsize=17408 CPUtime=99.98 cores=0,2
/proc/28506/stat : 28506 (lingeling) T 28504 28506 28506 0 -1 4202496 13052 0 0 0 9997 1 0 0 25 0 1 0 656927044 17825792 3523 33554432000 4194304 4352236 140735510109536 18446744073709551615 4328047 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/28506/statm: 4352 3523 129 39 0 3432 0
[pid=28504/tid=28522] ppid=28409 vsize=291712 CPUtime=0 cores=0,2
/proc/28504/task/28522/stat : 28522 (python) S 28409 28409 27642 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656937066 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604450394717120 0 0 -1 2 0 0 0
[pid=28523] ppid=28409 vsize=301968 CPUtime=1.42 cores=0,2
/proc/28523/stat : 28523 (python) S 28409 28409 27642 0 -1 4202560 997 0 0 0 82 60 0 0 15 0 1 0 656937067 309215232 6296 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854342 0 0 16781312 514 12949379448876007684 0 0 17 0 0 0 0
/proc/28523/statm: 75492 6296 371 364 0 11404 0
[pid=28525] ppid=28523 vsize=201032 CPUtime=550.5 cores=0,2
/proc/28525/stat : 28525 (cryptominisat-2) R 28523 28525 28525 0 -1 4202496 163443 0 0 0 55007 43 0 0 25 0 1 0 656937067 205856768 31870 33554432000 4194304 4677096 140737034241760 18446744073709551615 246516530833 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/28525/statm: 50258 31870 393 118 0 45217 0
[pid=28409/tid=28443] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 4 0 656868325 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28505] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28505/stat : 28505 (python) S 28407 28409 27642 0 -1 4202560 27 926 0 8 0 0 0 0 20 0 4 0 656927044 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28524] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28524/stat : 28524 (python) S 28407 28409 27642 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 4 0 656937067 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1241.21
Current children cumulated vsize (KiB) 1445244



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.16 4.07 3.82 6/355 28660
/proc/meminfo: memFree=17896616/32951124 swapFree=61565116/67111528
[pid=28409] ppid=28407 vsize=312212 CPUtime=1.69 cores=0,2
/proc/28409/stat : 28409 (python) S 28407 28409 27642 0 -1 4202496 13384 926 83 8 140 29 0 0 20 0 4 0 656868012 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 26
/proc/28409/statm: 78053 7809 1880 364 0 13965 0
[pid=28442] ppid=28409 vsize=291700 CPUtime=1.27 cores=0,2
/proc/28442/stat : 28442 (python) S 28409 28409 27642 0 -1 4202560 1186 0 0 0 70 57 0 0 19 0 2 0 656868324 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28442/statm: 72925 6338 416 364 0 8843 0
[pid=28444] ppid=28442 vsize=29212 CPUtime=586.12 cores=0,2
/proc/28444/stat : 28444 (lingeling) T 28442 28444 28444 0 -1 4202496 54721 0 0 0 58605 7 0 0 25 0 1 0 656868325 29913088 6505 33554432000 4194304 4352236 140734104929264 18446744073709551615 4276629 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/28444/statm: 7303 6505 129 39 0 6383 0
[pid=28442/tid=28503] ppid=28409 vsize=291700 CPUtime=0 cores=0,2
/proc/28442/task/28503/stat : 28503 (python) S 28409 28409 27642 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 656927043 298700800 6338 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604442570188992 0 0 -1 0 0 0 0
[pid=28504] ppid=28409 vsize=291712 CPUtime=0.23 cores=0,2
/proc/28504/stat : 28504 (python) S 28409 28409 27642 0 -1 4202560 1094 0 0 0 13 10 0 0 19 0 2 0 656927044 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528660939 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/28504/statm: 72928 6322 400 364 0 8843 0
[pid=28506] ppid=28504 vsize=17408 CPUtime=99.98 cores=0,2
/proc/28506/stat : 28506 (lingeling) T 28504 28506 28506 0 -1 4202496 13052 0 0 0 9997 1 0 0 25 0 1 0 656927044 17825792 3523 33554432000 4194304 4352236 140735510109536 18446744073709551615 4328047 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/28506/statm: 4352 3523 129 39 0 3432 0
[pid=28504/tid=28522] ppid=28409 vsize=291712 CPUtime=0 cores=0,2
/proc/28504/task/28522/stat : 28522 (python) S 28409 28409 27642 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656937066 298713088 6322 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 514 18446604450394717120 0 0 -1 2 0 0 0
[pid=28523] ppid=28409 vsize=301968 CPUtime=1.56 cores=0,2
/proc/28523/stat : 28523 (python) S 28409 28409 27642 0 -1 4202560 997 0 0 0 90 66 0 0 15 0 1 0 656937067 309215232 6296 33554432000 4194304 5683644 140737077087536 18446744073709551615 246516854342 0 0 16781312 514 12949379448876007684 0 0 17 0 0 0 0
/proc/28523/statm: 75492 6296 371 364 0 11404 0
[pid=28525] ppid=28523 vsize=201928 CPUtime=608.1 cores=0,2
/proc/28525/stat : 28525 (cryptominisat-2) R 28523 28525 28525 0 -1 4202496 176192 0 0 0 60765 45 0 0 25 0 1 0 656937067 206774272 31175 33554432000 4194304 4677096 140737034241760 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/28525/statm: 50482 31175 393 118 0 45441 0
[pid=28409/tid=28443] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28443/stat : 28443 (python) S 28407 28409 27642 0 -1 4202560 32 926 0 8 0 0 0 0 19 0 4 0 656868325 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28505] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28505/stat : 28505 (python) S 28407 28409 27642 0 -1 4202560 27 926 0 8 0 0 0 0 20 0 4 0 656927044 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
[pid=28409/tid=28524] ppid=28407 vsize=312212 CPUtime=0 cores=0,2
/proc/28409/task/28524/stat : 28524 (python) S 28407 28409 27642 0 -1 4202560 28 926 0 8 0 0 0 0 20 0 4 0 656937067 319705088 7809 33554432000 4194304 5683644 140737077087536 18446744073709551615 246528657841 0 0 16781312 2 18446604450394715328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1298.95
Current children cumulated vsize (KiB) 1446140

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28409 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=404786
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=298954
# CPU time returned by wait4() is 1.70374
# while last known CPU time is 1298.95
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.03
CPU time (s): 1298.95
CPU user time (s): 1296.8
CPU system time (s): 2.15
CPU usage (%): 99.9166
Max. virtual memory (cumulated for all children) (KiB): 1446140

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.40479
system time used= 0.298954
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14311
page faults= 91
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 41316
involuntary context switches= 119

runsolver used 3.9704 second user time and 8.18176 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-15 11:44:58
IDJOB=3378033
IDBENCH=20399
IDSOLVER=1858
FILE ID=node134/3378033-1305452698
RUNJOBID= node134-1305452698-28379
PBS_JOBID= 13324884
Free space on /tmp= 73508 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT07/industrial/fuhs/hard/AProVE07-01.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378033-1305452698/watcher-3378033-1305452698 -o /tmp/evaluation-result-3378033-1305452698/solver-3378033-1305452698 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378033-1305452698.cnf -seed 743672776 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= d2f77e32530988f77dca5112174eee00
RANDOM SEED=743672776

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22860836 kB
Buffers:        274424 kB
Cached:        6257532 kB
SwapCached:      13768 kB
Active:        1071588 kB
Inactive:      8797336 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22860836 kB
SwapTotal:    67111528 kB
SwapFree:     61565116 kB
Dirty:          106392 kB
Writeback:           0 kB
AnonPages:     3329940 kB
Mapped:          12188 kB
Slab:           128760 kB
PageTables:      32220 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38900636 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73356 MiB
End job on node134 at 2011-05-15 12:06:40