Trace number 3377892

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 1301.89 1300.04

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
MD5SUMee159af2e208d290f7f3fefd15c344f2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark731.23
Satisfiable
(Un)Satisfiability was proved
Number of variables44692
Number of clauses129620
Sum of the clauses size302444
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 286412
Number of clauses of size 343206
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data

0.31/0.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.31/0.49	c INFO: solving HOME/instance-3377892-1305455223.cnf
0.31/0.49	c INFO: computing task features
0.70/0.83	c INFO: computed variable-clause graph statistics
0.70/0.85	c INFO: computed clause balance statistics
2.70/2.81	c INFO: computed variable balance statistics
4.10/4.26	c INFO: computed small-clause counts
4.10/4.28	c INFO: computed Horn-clause counts
6.60/6.71	c INFO: computed variable graph statistics
6.60/6.71	c INFO: collected features for HOME/instance-3377892-1305455223.cnf in 6.23 s
6.60/6.72	c INFO: running lingeling-276@0 for 582 with 2393 remaining (b = 0.59)
594.18/594.24	c INFO: running lingeling-276@0 for 97 with 1807 remaining (b = 0.30)
694.46/694.53	c INFO: running cryptominisat-2.9.0@0 for 1707 with 1707 remaining (b = 0.54)

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3377892-1305455223/watcher-3377892-1305455223 -o /tmp/evaluation-result-3377892-1305455223/solver-3377892-1305455223 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3377892-1305455223.cnf -seed 967358976 -budget 2400 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.00 3.10 3.40 4/388 28997
/proc/meminfo: memFree=21872312/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=15780 CPUtime=0 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 903 0 0 0 0 0 0 0 25 0 1 0 657120054 16158720 784 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/28997/statm: 3945 784 346 364 0 432 0

[startup+0.0446941 s]
/proc/loadavg: 3.00 3.10 3.40 4/388 28997
/proc/meminfo: memFree=21872312/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=27352 CPUtime=0.02 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 1351 0 0 0 2 0 0 0 25 0 1 0 657120054 28008448 1197 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/28997/statm: 6838 1197 440 364 0 725 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 27352

[startup+0.100685 s]
/proc/loadavg: 3.00 3.10 3.40 4/388 28997
/proc/meminfo: memFree=21872312/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=104220 CPUtime=0.07 cores=5,7
/proc/28997/stat : 28997 (python) R 28995 28997 27552 0 -1 4202496 3045 0 0 0 5 2 0 0 17 0 1 0 657120054 106721280 2731 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687673344 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/28997/statm: 26055 2731 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.300646 s]
/proc/loadavg: 3.00 3.10 3.40 4/388 28997
/proc/meminfo: memFree=21872312/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=166548 CPUtime=0.23 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 6694 937 1 0 17 6 0 0 17 0 1 0 657120054 170545152 4777 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/28997/statm: 41637 4777 1322 364 0 3454 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 166548

[startup+0.700572 s]
/proc/loadavg: 3.00 3.10 3.40 4/388 28997
/proc/meminfo: memFree=21872312/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=295344 CPUtime=0.61 cores=5,7
/proc/28997/stat : 28997 (python) R 28995 28997 27552 0 -1 4202496 13407 937 1 0 51 10 0 0 17 0 1 0 657120054 302432256 11079 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687336133 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28997/statm: 73836 11079 1761 364 0 9760 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 295344

[startup+1.50042 s]
/proc/loadavg: 3.00 3.10 3.40 4/388 29002
/proc/meminfo: memFree=21899476/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=304384 CPUtime=1.4 cores=5,7
/proc/28997/stat : 28997 (python) R 28995 28997 27552 0 -1 4202496 18705 937 1 0 130 10 0 0 18 0 1 0 657120054 311689216 13480 33554432000 4194304 5683644 140734222714112 18446744073709551615 47768668169986 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28997/statm: 76096 13480 1826 364 0 12020 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 304384

[startup+3.10013 s]
/proc/loadavg: 3.00 3.10 3.40 4/383 29006
/proc/meminfo: memFree=22072116/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=304384 CPUtime=3 cores=5,7
/proc/28997/stat : 28997 (python) R 28995 28997 27552 0 -1 4202496 18706 937 1 0 290 10 0 0 21 0 1 0 657120054 311689216 13481 33554432000 4194304 5683644 140734222714112 18446744073709551615 47768665637842 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28997/statm: 76096 13481 1827 364 0 12020 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 304384

[startup+6.30055 s]
/proc/loadavg: 3.00 3.10 3.40 4/386 29034
/proc/meminfo: memFree=22013592/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=304384 CPUtime=6.2 cores=5,7
/proc/28997/stat : 28997 (python) R 28995 28997 27552 0 -1 4202496 18712 937 1 0 610 10 0 0 25 0 1 0 657120054 311689216 13487 33554432000 4194304 5683644 140734222714112 18446744073709551615 47768665393292 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28997/statm: 76096 13487 1833 364 0 12020 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 304384

[startup+12.7004 s]
/proc/loadavg: 3.00 3.09 3.40 4/389 29037
/proc/meminfo: memFree=21999684/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.01 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 891 0 0 0 1 0 0 0 18 0 1 0 657120727 309678080 11533 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695375 0 0 16781312 514 17295611478816030983 0 0 17 5 0 0 0
/proc/29035/statm: 75605 11533 376 364 0 11523 0
[pid=29037] ppid=29035 vsize=16320 CPUtime=5.93 cores=5,7
/proc/29037/stat : 29037 (lingeling) R 29035 29037 29037 0 -1 4202496 6016 0 0 0 593 0 0 0 25 0 1 0 657120727 16711680 3250 33554432000 4194304 4352236 140736646279408 18446744073709551615 4281222 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29037/statm: 4080 3250 129 39 0 3160 0
[pid=28997/tid=29036] ppid=28995 vsize=312664 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 2 0 657120727 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 631404

[startup+25.501 s]
/proc/loadavg: 3.00 3.09 3.39 4/392 29041
/proc/meminfo: memFree=21982424/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.04 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 897 0 0 0 3 1 0 0 18 0 1 0 657120727 309678080 11533 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695375 0 0 16781312 514 18395955432599290119 0 0 17 5 0 0 0
/proc/29035/statm: 75605 11533 376 364 0 11523 0
[pid=29037] ppid=29035 vsize=16316 CPUtime=18.69 cores=5,7
/proc/29037/stat : 29037 (lingeling) R 29035 29037 29037 0 -1 4202496 6046 0 0 0 1869 0 0 0 25 0 1 0 657120727 16707584 3279 33554432000 4194304 4352236 140736646279408 18446744073709551615 4328105 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29037/statm: 4079 3279 129 39 0 3159 0
[pid=28997/tid=29036] ppid=28995 vsize=312664 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 2 0 657120727 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 631400

[startup+51.1004 s]
/proc/loadavg: 3.00 3.08 3.38 4/392 29041
/proc/meminfo: memFree=21960200/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.11 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 909 0 0 0 6 5 0 0 18 0 1 0 657120727 309678080 11533 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695375 0 0 16781312 514 18395955432599290119 0 0 17 5 0 0 0
/proc/29035/statm: 75605 11533 376 364 0 11523 0
[pid=29037] ppid=29035 vsize=22216 CPUtime=44.23 cores=5,7
/proc/29037/stat : 29037 (lingeling) R 29035 29037 29037 0 -1 4202496 7491 0 0 0 4423 0 0 0 25 0 1 0 657120727 22749184 4724 33554432000 4194304 4352236 140736646279408 18446744073709551615 4231098 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29037/statm: 5554 4724 129 39 0 4634 0
[pid=28997/tid=29036] ppid=28995 vsize=312664 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 2 0 657120727 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 637300

[startup+102.315 s]
/proc/loadavg: 3.00 3.07 3.36 4/392 29043
/proc/meminfo: memFree=21942724/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.25 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 931 0 0 0 13 12 0 0 18 0 1 0 657120727 309678080 11533 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695375 0 0 16781312 514 18395955432599290119 0 0 17 5 0 0 0
/proc/29035/statm: 75605 11533 376 364 0 11523 0
[pid=29037] ppid=29035 vsize=26236 CPUtime=95.31 cores=5,7
/proc/29037/stat : 29037 (lingeling) R 29035 29037 29037 0 -1 4202496 8496 0 0 0 9531 0 0 0 25 0 1 0 657120727 26865664 5729 33554432000 4194304 4352236 140736646279408 18446744073709551615 4281160 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29037/statm: 6559 5729 129 39 0 5639 0
[pid=28997/tid=29036] ppid=28995 vsize=312664 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 2 0 657120727 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.19
Current children cumulated vsize (KiB) 641320

[startup+162.301 s]
/proc/loadavg: 3.00 3.05 3.33 4/392 29044
/proc/meminfo: memFree=21930544/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.42 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 950 0 0 0 21 21 0 0 18 0 1 0 657120727 309678080 11533 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695375 0 0 16781312 514 18395955432599290119 0 0 17 5 0 0 0
/proc/29035/statm: 75605 11533 376 364 0 11523 0
[pid=29037] ppid=29035 vsize=29824 CPUtime=155.14 cores=5,7
/proc/29037/stat : 29037 (lingeling) R 29035 29037 29037 0 -1 4202496 10673 0 0 0 15513 1 0 0 25 0 1 0 657120727 30539776 6626 33554432000 4194304 4352236 140736646279408 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29037/statm: 7456 6626 129 39 0 6536 0
[pid=28997/tid=29036] ppid=28995 vsize=312664 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 2 0 657120727 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 162.19
Current children cumulated vsize (KiB) 644908

[startup+222.301 s]
/proc/loadavg: 3.07 3.06 3.31 4/392 29046
/proc/meminfo: memFree=21929408/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.59 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 967 0 0 0 29 30 0 0 18 0 1 0 657120727 309678080 11533 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695375 0 0 16781312 514 18395955432599290119 0 0 17 5 0 0 0
/proc/29035/statm: 75605 11533 376 364 0 11523 0
[pid=29037] ppid=29035 vsize=30340 CPUtime=214.97 cores=5,7
/proc/29037/stat : 29037 (lingeling) R 29035 29037 29037 0 -1 4202496 14259 0 0 0 21496 1 0 0 25 0 1 0 657120727 31068160 6755 33554432000 4194304 4352236 140736646279408 18446744073709551615 4278746 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29037/statm: 7585 6755 129 39 0 6665 0
[pid=28997/tid=29036] ppid=28995 vsize=312664 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 2 0 657120727 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 645424

[startup+282.301 s]
/proc/loadavg: 3.18 3.08 3.30 4/392 29049
/proc/meminfo: memFree=21906316/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=312664 CPUtime=6.63 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 18993 937 1 0 653 10 0 0 25 0 2 0 657120054 320167936 13028 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28997/statm: 78166 13028 1867 364 0 14084 0
[pid=29035] ppid=28997 vsize=302420 CPUtime=0.75 cores=5,7

################
# More data... #
################

[startup+1122.3 s]
/proc/loadavg: 3.01 3.06 3.15 4/416 29105
/proc/meminfo: memFree=20316908/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=333176 CPUtime=6.65 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 20574 937 1 0 654 11 0 0 20 0 4 0 657120054 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28997/statm: 83294 13041 1872 364 0 19206 0
[pid=29035] ppid=28997 vsize=312664 CPUtime=1.61 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 1199 0 0 0 86 75 0 0 19 0 2 0 657120727 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29035/statm: 78166 11577 415 364 0 14084 0
[pid=29037] ppid=29035 vsize=54420 CPUtime=585.98 cores=5,7
/proc/29037/stat : 29037 (lingeling) T 29035 29037 29037 0 -1 4202496 63543 0 0 0 58590 8 0 0 25 0 1 0 657120727 55726080 12775 33554432000 4194304 4352236 140736646279408 18446744073709551615 4328100 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29037/statm: 13605 12775 129 39 0 12685 0
[pid=29035/tid=29071] ppid=28997 vsize=312664 CPUtime=0 cores=5,7
/proc/29035/task/29071/stat : 29071 (python) S 28997 28997 27552 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 657179478 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469824543488 0 0 -1 7 0 0 0
[pid=29072] ppid=28997 vsize=312676 CPUtime=0.28 cores=5,7
/proc/29072/stat : 29072 (python) S 28997 28997 27552 0 -1 4202560 1090 0 0 0 15 13 0 0 19 0 2 0 657179479 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29072/statm: 78169 11561 399 364 0 14084 0
[pid=29074] ppid=29072 vsize=27128 CPUtime=99.98 cores=5,7
/proc/29074/stat : 29074 (lingeling) T 29072 29074 29074 0 -1 4202496 11144 0 0 0 9997 1 0 0 25 0 1 0 657179480 27779072 5952 33554432000 4194304 4352236 140735667644352 18446744073709551615 4300236 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/29074/statm: 6782 5952 129 39 0 5862 0
[pid=29072/tid=29084] ppid=28997 vsize=312676 CPUtime=0 cores=5,7
/proc/29072/task/29084/stat : 29084 (python) S 28997 28997 27552 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 657189507 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469311678656 0 0 -1 7 0 0 0
[pid=29085] ppid=28997 vsize=322932 CPUtime=1.36 cores=5,7
/proc/29085/stat : 29085 (python) S 28997 28997 27552 0 -1 4202560 995 0 0 0 69 67 0 0 15 0 1 0 657189508 330682368 11535 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695430 0 0 16781312 514 18395955432599290116 0 0 17 7 0 0 0
/proc/29085/statm: 80733 11535 370 364 0 16645 0
[pid=29087] ppid=29085 vsize=242368 CPUtime=427.76 cores=5,7
/proc/29087/stat : 29087 (cryptominisat-2) R 29085 29087 29087 0 -1 4202496 131678 0 0 0 42753 23 0 0 25 0 1 0 657189508 248184832 51642 33554432000 4194304 4677096 140737129973696 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29087/statm: 60592 51642 392 118 0 55551 0
[pid=28997/tid=29036] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 4 0 657120727 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29073] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29073/stat : 29073 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 4 0 657179479 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29086] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29086/stat : 29086 (python) S 28995 28997 27552 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 4 0 657189508 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1123.62
Current children cumulated vsize (KiB) 1605364

[startup+1182.3 s]
/proc/loadavg: 3.00 3.05 3.14 4/416 29107
/proc/meminfo: memFree=20310444/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=333176 CPUtime=6.65 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 20574 937 1 0 654 11 0 0 20 0 4 0 657120054 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28997/statm: 83294 13041 1872 364 0 19206 0
[pid=29035] ppid=28997 vsize=312664 CPUtime=1.61 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 1199 0 0 0 86 75 0 0 19 0 2 0 657120727 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29035/statm: 78166 11577 415 364 0 14084 0
[pid=29037] ppid=29035 vsize=54420 CPUtime=585.98 cores=5,7
/proc/29037/stat : 29037 (lingeling) T 29035 29037 29037 0 -1 4202496 63543 0 0 0 58590 8 0 0 25 0 1 0 657120727 55726080 12775 33554432000 4194304 4352236 140736646279408 18446744073709551615 4328100 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29037/statm: 13605 12775 129 39 0 12685 0
[pid=29035/tid=29071] ppid=28997 vsize=312664 CPUtime=0 cores=5,7
/proc/29035/task/29071/stat : 29071 (python) S 28997 28997 27552 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 657179478 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469824543488 0 0 -1 7 0 0 0
[pid=29072] ppid=28997 vsize=312676 CPUtime=0.28 cores=5,7
/proc/29072/stat : 29072 (python) S 28997 28997 27552 0 -1 4202560 1090 0 0 0 15 13 0 0 19 0 2 0 657179479 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29072/statm: 78169 11561 399 364 0 14084 0
[pid=29074] ppid=29072 vsize=27128 CPUtime=99.98 cores=5,7
/proc/29074/stat : 29074 (lingeling) T 29072 29074 29074 0 -1 4202496 11144 0 0 0 9997 1 0 0 25 0 1 0 657179480 27779072 5952 33554432000 4194304 4352236 140735667644352 18446744073709551615 4300236 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/29074/statm: 6782 5952 129 39 0 5862 0
[pid=29072/tid=29084] ppid=28997 vsize=312676 CPUtime=0 cores=5,7
/proc/29072/task/29084/stat : 29084 (python) S 28997 28997 27552 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 657189507 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469311678656 0 0 -1 7 0 0 0
[pid=29085] ppid=28997 vsize=322932 CPUtime=1.54 cores=5,7
/proc/29085/stat : 29085 (python) S 28997 28997 27552 0 -1 4202560 996 0 0 0 79 75 0 0 15 0 1 0 657189508 330682368 11535 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695430 0 0 16781312 514 16436898395081113860 0 0 17 7 0 0 0
/proc/29085/statm: 80733 11535 370 364 0 16645 0
[pid=29087] ppid=29085 vsize=243396 CPUtime=487.76 cores=5,7
/proc/29087/stat : 29087 (cryptominisat-2) R 29085 29087 29087 0 -1 4202496 138907 0 0 0 48752 24 0 0 25 0 1 0 657189508 249237504 54023 33554432000 4194304 4677096 140737129973696 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29087/statm: 60849 54023 392 118 0 55808 0
[pid=28997/tid=29036] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 4 0 657120727 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29073] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29073/stat : 29073 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 4 0 657179479 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29086] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29086/stat : 29086 (python) S 28995 28997 27552 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 4 0 657189508 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1183.8
Current children cumulated vsize (KiB) 1606392

[startup+1242.3 s]
/proc/loadavg: 2.47 2.89 3.08 3/401 29129
/proc/meminfo: memFree=21409212/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=333176 CPUtime=6.65 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 20574 937 1 0 654 11 0 0 20 0 4 0 657120054 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28997/statm: 83294 13041 1872 364 0 19206 0
[pid=29035] ppid=28997 vsize=312664 CPUtime=1.61 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 1199 0 0 0 86 75 0 0 19 0 2 0 657120727 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29035/statm: 78166 11577 415 364 0 14084 0
[pid=29037] ppid=29035 vsize=54420 CPUtime=585.98 cores=5,7
/proc/29037/stat : 29037 (lingeling) T 29035 29037 29037 0 -1 4202496 63543 0 0 0 58590 8 0 0 25 0 1 0 657120727 55726080 12775 33554432000 4194304 4352236 140736646279408 18446744073709551615 4328100 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29037/statm: 13605 12775 129 39 0 12685 0
[pid=29035/tid=29071] ppid=28997 vsize=312664 CPUtime=0 cores=5,7
/proc/29035/task/29071/stat : 29071 (python) S 28997 28997 27552 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 657179478 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469824543488 0 0 -1 7 0 0 0
[pid=29072] ppid=28997 vsize=312676 CPUtime=0.28 cores=5,7
/proc/29072/stat : 29072 (python) S 28997 28997 27552 0 -1 4202560 1090 0 0 0 15 13 0 0 19 0 2 0 657179479 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29072/statm: 78169 11561 399 364 0 14084 0
[pid=29074] ppid=29072 vsize=27128 CPUtime=99.98 cores=5,7
/proc/29074/stat : 29074 (lingeling) T 29072 29074 29074 0 -1 4202496 11144 0 0 0 9997 1 0 0 25 0 1 0 657179480 27779072 5952 33554432000 4194304 4352236 140735667644352 18446744073709551615 4300236 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/29074/statm: 6782 5952 129 39 0 5862 0
[pid=29072/tid=29084] ppid=28997 vsize=312676 CPUtime=0 cores=5,7
/proc/29072/task/29084/stat : 29084 (python) S 28997 28997 27552 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 657189507 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469311678656 0 0 -1 7 0 0 0
[pid=29085] ppid=28997 vsize=322932 CPUtime=1.73 cores=5,7
/proc/29085/stat : 29085 (python) S 28997 28997 27552 0 -1 4202560 1007 0 0 0 88 85 0 0 15 0 1 0 657189508 330682368 11536 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695430 0 0 16781312 514 18395955432599290116 0 0 17 7 0 0 0
/proc/29085/statm: 80733 11536 371 364 0 16645 0
[pid=29087] ppid=29085 vsize=259360 CPUtime=547.77 cores=5,7
/proc/29087/stat : 29087 (cryptominisat-2) R 29085 29087 29087 0 -1 4202496 143961 0 0 0 54750 27 0 0 25 0 1 0 657189508 265584640 58533 33554432000 4194304 4677096 140737129973696 18446744073709551615 4320275 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29087/statm: 64840 58533 392 118 0 59799 0
[pid=28997/tid=29036] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 4 0 657120727 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29073] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29073/stat : 29073 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 4 0 657179479 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29086] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29086/stat : 29086 (python) S 28995 28997 27552 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 4 0 657189508 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1244
Current children cumulated vsize (KiB) 1622356



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 2.22 2.75 3.01 3/401 29131
/proc/meminfo: memFree=21447632/32951124 swapFree=67111348/67111528
[pid=28997] ppid=28995 vsize=333176 CPUtime=6.65 cores=5,7
/proc/28997/stat : 28997 (python) S 28995 28997 27552 0 -1 4202496 20574 937 1 0 654 11 0 0 20 0 4 0 657120054 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28997/statm: 83294 13041 1872 364 0 19206 0
[pid=29035] ppid=28997 vsize=312664 CPUtime=1.61 cores=5,7
/proc/29035/stat : 29035 (python) S 28997 28997 27552 0 -1 4202560 1199 0 0 0 86 75 0 0 19 0 2 0 657120727 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29035/statm: 78166 11577 415 364 0 14084 0
[pid=29037] ppid=29035 vsize=54420 CPUtime=585.98 cores=5,7
/proc/29037/stat : 29037 (lingeling) T 29035 29037 29037 0 -1 4202496 63543 0 0 0 58590 8 0 0 25 0 1 0 657120727 55726080 12775 33554432000 4194304 4352236 140736646279408 18446744073709551615 4328100 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29037/statm: 13605 12775 129 39 0 12685 0
[pid=29035/tid=29071] ppid=28997 vsize=312664 CPUtime=0 cores=5,7
/proc/29035/task/29071/stat : 29071 (python) S 28997 28997 27552 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 657179478 320167936 11577 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469824543488 0 0 -1 7 0 0 0
[pid=29072] ppid=28997 vsize=312676 CPUtime=0.28 cores=5,7
/proc/29072/stat : 29072 (python) S 28997 28997 27552 0 -1 4202560 1090 0 0 0 15 13 0 0 19 0 2 0 657179479 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29072/statm: 78169 11561 399 364 0 14084 0
[pid=29074] ppid=29072 vsize=27128 CPUtime=99.98 cores=5,7
/proc/29074/stat : 29074 (lingeling) T 29072 29074 29074 0 -1 4202496 11144 0 0 0 9997 1 0 0 25 0 1 0 657179480 27779072 5952 33554432000 4194304 4352236 140735667644352 18446744073709551615 4300236 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/29074/statm: 6782 5952 129 39 0 5862 0
[pid=29072/tid=29084] ppid=28997 vsize=312676 CPUtime=0 cores=5,7
/proc/29072/task/29084/stat : 29084 (python) S 28997 28997 27552 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 657189507 320180224 11561 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 514 18446604469311678656 0 0 -1 7 0 0 0
[pid=29085] ppid=28997 vsize=322932 CPUtime=1.92 cores=5,7
/proc/29085/stat : 29085 (python) S 28997 28997 27552 0 -1 4202560 1007 0 0 0 97 95 0 0 15 0 1 0 657189508 330682368 11536 33554432000 4194304 5683644 140734222714112 18446744073709551615 212687695430 0 0 16781312 514 18395955432599290116 0 0 17 7 0 0 0
/proc/29085/statm: 80733 11536 371 364 0 16645 0
[pid=29087] ppid=29085 vsize=231308 CPUtime=605.47 cores=5,7
/proc/29087/stat : 29087 (cryptominisat-2) R 29085 29087 29087 0 -1 4202496 156931 0 0 0 60517 30 0 0 25 0 1 0 657189508 236859392 50343 33554432000 4194304 4677096 140737129973696 18446744073709551615 4320291 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29087/statm: 57827 50343 392 118 0 52786 0
[pid=28997/tid=29036] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29036/stat : 29036 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 25 0 4 0 657120727 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29073] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29073/stat : 29073 (python) S 28995 28997 27552 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 4 0 657179479 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 5 0 0 0
[pid=28997/tid=29086] ppid=28995 vsize=333176 CPUtime=0 cores=5,7
/proc/28997/task/29086/stat : 29086 (python) S 28995 28997 27552 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 4 0 657189508 341172224 13041 33554432000 4194304 5683644 140734222714112 18446744073709551615 212699498929 0 0 16781312 2 18446604471162047360 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1301.89
Current children cumulated vsize (KiB) 1594304

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28997 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=547004
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=116982
# CPU time returned by wait4() is 6.66399
# while last known CPU time is 1301.89
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.04
CPU time (s): 1301.89
CPU user time (s): 1299.56
CPU system time (s): 2.33
CPU usage (%): 100.142
Max. virtual memory (cumulated for all children) (KiB): 1688024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.547
system time used= 0.116982
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21512
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 987
involuntary context switches= 26

runsolver used 4.99724 second user time and 11.7252 second system time

The end

Launcher Data

Begin job on node139 at 2011-05-15 12:27:03
IDJOB=3377892
IDBENCH=82466
IDSOLVER=1858
FILE ID=node139/3377892-1305455223
RUNJOBID= node139-1305453462-28373
PBS_JOBID= 13324881
Free space on /tmp= 73328 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3377892-1305455223/watcher-3377892-1305455223 -o /tmp/evaluation-result-3377892-1305455223/solver-3377892-1305455223 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3377892-1305455223.cnf -seed 967358976 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= ee159af2e208d290f7f3fefd15c344f2
RANDOM SEED=967358976

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21872468 kB
Buffers:        312804 kB
Cached:        3072380 kB
SwapCached:          0 kB
Active:        8705608 kB
Inactive:      2061088 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21872468 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           39156 kB
Writeback:           0 kB
AnonPages:     7381680 kB
Mapped:          35492 kB
Slab:           204652 kB
PageTables:      42180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77617720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73340 MiB
End job on node139 at 2011-05-15 12:48:45