Trace number 3378022

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 1300.06 1300.04

General information on the benchmark

NameSAT03/industrial/kukula/addm_bench/
am_7_7.shuffled-as.sat03-363.cnf
MD5SUMc7f51e1ee7556440ab29e1c4bfe29538
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4264
Number of clauses14751
Sum of the clauses size40035
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 24214
Number of clauses of size 310535
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.42/0.70	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.42/0.70	c INFO: solving HOME/instance-3378022-1305457338.cnf
0.42/0.70	c INFO: computing task features
0.42/0.73	c INFO: computed variable-clause graph statistics
0.42/0.73	c INFO: computed clause balance statistics
0.62/0.97	c INFO: computed variable balance statistics
0.83/1.15	c INFO: computed small-clause counts
0.83/1.15	c INFO: computed Horn-clause counts
0.83/1.19	c INFO: computed variable graph statistics
0.83/1.19	c INFO: collected features for HOME/instance-3378022-1305457338.cnf in 0.51 s
0.91/1.20	c INFO: running lingeling-276@0 for 582 with 2399 remaining (b = 0.57)
588.83/589.06	c INFO: running lingeling-276@585 for 291 with 1813 remaining (b = 0.17)
882.83/882.95	c INFO: running lingeling-276@0 for 194 with 1520 remaining (b = 0.35)
1079.48/1079.59	c INFO: running cryptominisat-2.9.0@0 for 485 with 1324 remaining (b = 0.40)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378022-1305457338/watcher-3378022-1305457338 -o /tmp/evaluation-result-3378022-1305457338/solver-3378022-1305457338 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378022-1305457338.cnf -seed 1060778650 -budget 2400 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.88 4.02 3.77 3/468 7708
/proc/meminfo: memFree=22227652/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=15764 CPUtime=0 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 844 0 0 0 0 0 0 0 25 0 1 0 657334225 16142336 728 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640857600 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/7708/statm: 3941 728 334 364 0 428 0

[startup+0.0578161 s]
/proc/loadavg: 3.88 4.02 3.77 3/468 7708
/proc/meminfo: memFree=22227652/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=29788 CPUtime=0.02 cores=5,7
/proc/7708/stat : 7708 (python) R 7706 7708 5445 0 -1 4202496 1413 0 0 0 2 0 0 0 17 0 1 0 657334225 30502912 1258 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640520389 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7708/statm: 7447 1258 443 364 0 817 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29788

[startup+0.100832 s]
/proc/loadavg: 3.88 4.02 3.77 3/468 7708
/proc/meminfo: memFree=22227652/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=87704 CPUtime=0.06 cores=5,7
/proc/7708/stat : 7708 (python) R 7706 7708 5445 0 -1 4202496 2637 0 0 0 4 2 0 0 17 0 1 0 657334225 89808896 2354 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640857600 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7708/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300787 s]
/proc/loadavg: 3.88 4.02 3.77 3/468 7708
/proc/meminfo: memFree=22227652/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=135748 CPUtime=0.18 cores=5,7
/proc/7708/stat : 7708 (python) R 7706 7708 5445 0 -1 4202496 5971 933 1 0 13 5 0 0 17 0 1 0 657334225 139005952 4148 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640855557 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/7708/statm: 33937 4148 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700686 s]
/proc/loadavg: 3.88 4.02 3.77 3/468 7708
/proc/meminfo: memFree=22227652/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=279484 CPUtime=0.42 cores=5,7
/proc/7708/stat : 7708 (python) R 7706 7708 5445 0 -1 4202496 9520 933 1 0 30 12 0 0 15 0 1 0 657334225 286191616 7191 33554432000 4194304 5683644 140733883928736 18446744073709551615 4421823 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7708/statm: 69871 7191 1761 364 0 5795 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 279484

[startup+1.50051 s]
/proc/loadavg: 3.88 4.02 3.77 5/468 7737
/proc/meminfo: memFree=22236180/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 290588

[startup+3.10025 s]
/proc/loadavg: 3.88 4.02 3.77 5/471 7740
/proc/meminfo: memFree=22205628/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 657334345 287072256 6025 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 13556843134842830847 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6025 354 364 0 6004 0
[pid=7740] ppid=7738 vsize=7232 CPUtime=1.87 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 1585 0 0 0 187 0 0 0 25 0 1 0 657334346 7405568 978 33554432000 4194304 4352236 140735402981280 18446744073709551615 4212550 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/7740/statm: 1808 978 129 39 0 888 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 578164

[startup+6.30067 s]
/proc/loadavg: 3.89 4.02 3.77 5/474 7750
/proc/meminfo: memFree=22009040/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.02 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 884 0 0 0 1 1 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 13556843134842798343 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6048 377 364 0 6004 0
[pid=7740] ppid=7738 vsize=9668 CPUtime=5.04 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 2546 0 0 0 504 0 0 0 25 0 1 0 657334346 9900032 1587 33554432000 4194304 4352236 140735402981280 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/7740/statm: 2417 1587 129 39 0 1497 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 580600

[startup+12.7005 s]
/proc/loadavg: 3.90 4.02 3.77 5/474 7750
/proc/meminfo: memFree=21594784/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.04 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 887 0 0 0 2 2 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 9345796059537834247 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6048 377 364 0 6004 0
[pid=7740] ppid=7738 vsize=9932 CPUtime=11.42 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 3412 0 0 0 1142 0 0 0 25 0 1 0 657334346 10170368 1653 33554432000 4194304 4352236 140735402981280 18446744073709551615 4328022 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/7740/statm: 2483 1653 129 39 0 1563 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.38
Current children cumulated vsize (KiB) 580864

[startup+25.5012 s]
/proc/loadavg: 3.92 4.02 3.77 5/474 7750
/proc/meminfo: memFree=21517776/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.07 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 893 0 0 0 3 4 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 9345796059537834247 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6048 377 364 0 6004 0
[pid=7740] ppid=7738 vsize=11216 CPUtime=24.19 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 5461 0 0 0 2418 1 0 0 25 0 1 0 657334346 11485184 1974 33554432000 4194304 4352236 140735402981280 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/7740/statm: 2804 1974 129 39 0 1884 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.18
Current children cumulated vsize (KiB) 582148

[startup+51.1005 s]
/proc/loadavg: 4.02 4.03 3.78 5/474 7751
/proc/meminfo: memFree=21383920/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.15 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 902 0 0 0 7 8 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 9345796059537834247 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6048 377 364 0 6004 0
[pid=7740] ppid=7738 vsize=14556 CPUtime=49.67 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 9528 0 0 0 4966 1 0 0 25 0 1 0 657334346 14905344 2809 33554432000 4194304 4352236 140735402981280 18446744073709551615 4329279 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/7740/statm: 3639 2809 129 39 0 2719 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.74
Current children cumulated vsize (KiB) 585488

[startup+102.317 s]
/proc/loadavg: 4.01 4.03 3.79 5/474 7755
/proc/meminfo: memFree=21357504/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.33 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 925 0 0 0 17 16 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 9345796059537834247 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6048 377 364 0 6004 0
[pid=7740] ppid=7738 vsize=17252 CPUtime=100.73 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 17370 0 0 0 10071 2 0 0 25 0 1 0 657334346 17666048 3515 33554432000 4194304 4352236 140735402981280 18446744073709551615 4328000 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/7740/statm: 4313 3515 129 39 0 3393 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.98
Current children cumulated vsize (KiB) 588184

[startup+162.3 s]
/proc/loadavg: 4.00 4.02 3.80 5/474 7757
/proc/meminfo: memFree=21260816/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.53 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 943 0 0 0 29 24 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 9345796059537834247 0 0 17 5 0 0 0
/proc/7738/statm: 70086 6048 377 364 0 6004 0
[pid=7740] ppid=7738 vsize=20584 CPUtime=160.53 cores=5,7
/proc/7740/stat : 7740 (lingeling) R 7738 7740 7740 0 -1 4202496 27035 0 0 0 16049 4 0 0 25 0 1 0 657334346 21078016 4348 33554432000 4194304 4352236 140735402981280 18446744073709551615 4328395 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/7740/statm: 5146 4348 129 39 0 4226 0
[pid=7708/tid=7739] ppid=7706 vsize=290588 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 2 0 657334346 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 161.98
Current children cumulated vsize (KiB) 591516

[startup+222.3 s]
/proc/loadavg: 4.00 4.02 3.82 5/474 7758
/proc/meminfo: memFree=21241464/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=290588 CPUtime=0.92 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 10501 933 1 0 80 12 0 0 17 0 2 0 657334225 297562112 7550 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 72647 7550 1875 364 0 8565 0
[pid=7738] ppid=7708 vsize=280344 CPUtime=0.73 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 962 0 0 0 40 33 0 0 18 0 1 0 657334345 287072256 6048 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879631 0 0 16781312 514 9345796059537834247 0 0 17 5 0 0 0

################
# More data... #
################

[startup+1122.3 s]
/proc/loadavg: 3.15 3.22 3.49 4/462 7845
/proc/meminfo: memFree=21053764/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=311100 CPUtime=0.94 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 12134 933 1 0 82 12 0 0 19 0 4 0 657334225 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 77775 7563 1880 364 0 13687 0
[pid=7738] ppid=7708 vsize=290588 CPUtime=2.88 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 1204 0 0 0 145 143 0 0 18 0 2 0 657334345 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7738/statm: 72647 6093 417 364 0 8565 0
[pid=7740] ppid=7738 vsize=37044 CPUtime=879.07 cores=5,7
/proc/7740/stat : 7740 (lingeling) T 7738 7740 7740 0 -1 4202496 98078 0 0 0 87893 14 0 0 25 0 1 0 657334346 37933056 8463 33554432000 4194304 4352236 140735402981280 18446744073709551615 4329086 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7740/statm: 9261 8463 129 39 0 8341 0
[pid=7738/tid=7819] ppid=7708 vsize=290588 CPUtime=0 cores=5,7
/proc/7738/task/7819/stat : 7819 (python) S 7708 7708 5445 0 -1 4202560 43 0 0 0 0 0 0 0 18 0 2 0 657393130 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604460364109056 0 0 -1 7 0 0 0
[pid=7833] ppid=7708 vsize=290600 CPUtime=0.65 cores=5,7
/proc/7833/stat : 7833 (python) S 7708 7708 5445 0 -1 4202560 1112 0 0 0 29 36 0 0 19 0 2 0 657422520 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7833/statm: 72650 6076 400 364 0 8565 0
[pid=7835] ppid=7833 vsize=19212 CPUtime=196.03 cores=5,7
/proc/7835/stat : 7835 (lingeling) T 7833 7835 7835 0 -1 4202496 32037 0 0 0 19597 6 0 0 25 0 1 0 657422521 19673088 4006 33554432000 4194304 4352236 140737011605296 18446744073709551615 4278369 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7835/statm: 4803 4006 129 39 0 3883 0
[pid=7833/tid=7841] ppid=7708 vsize=290600 CPUtime=0 cores=5,7
/proc/7833/task/7841/stat : 7841 (python) S 7708 7708 5445 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657442183 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604457342027904 0 0 -1 7 0 0 0
[pid=7842] ppid=7708 vsize=300856 CPUtime=0.15 cores=5,7
/proc/7842/stat : 7842 (python) S 7708 7708 5445 0 -1 4202560 922 0 0 0 8 7 0 0 15 0 1 0 657442184 308076544 6050 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879686 0 0 16781312 514 16507794904840110340 0 0 17 5 0 0 0
/proc/7842/statm: 75214 6050 371 364 0 11126 0
[pid=7844] ppid=7842 vsize=73472 CPUtime=42.55 cores=5,7
/proc/7844/stat : 7844 (cryptominisat-2) R 7842 7844 7844 0 -1 4202496 35888 0 0 0 4249 6 0 0 25 0 1 0 657442185 75235328 11199 33554432000 4194304 4677096 140737400849120 18446744073709551615 4320016 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7844/statm: 18368 11199 392 118 0 13327 0
[pid=7708/tid=7739] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 4 0 657334346 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7834] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7834/stat : 7834 (python) S 7706 7708 5445 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 4 0 657422520 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7843] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7843/stat : 7843 (python) S 7706 7708 5445 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 4 0 657442184 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1122.27
Current children cumulated vsize (KiB) 1322872

[startup+1182.3 s]
/proc/loadavg: 3.11 3.20 3.46 4/465 7850
/proc/meminfo: memFree=20849844/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=311100 CPUtime=0.94 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 12134 933 1 0 82 12 0 0 19 0 4 0 657334225 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 77775 7563 1880 364 0 13687 0
[pid=7738] ppid=7708 vsize=290588 CPUtime=2.88 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 1204 0 0 0 145 143 0 0 18 0 2 0 657334345 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7738/statm: 72647 6093 417 364 0 8565 0
[pid=7740] ppid=7738 vsize=37044 CPUtime=879.07 cores=5,7
/proc/7740/stat : 7740 (lingeling) T 7738 7740 7740 0 -1 4202496 98078 0 0 0 87893 14 0 0 25 0 1 0 657334346 37933056 8463 33554432000 4194304 4352236 140735402981280 18446744073709551615 4329086 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7740/statm: 9261 8463 129 39 0 8341 0
[pid=7738/tid=7819] ppid=7708 vsize=290588 CPUtime=0 cores=5,7
/proc/7738/task/7819/stat : 7819 (python) S 7708 7708 5445 0 -1 4202560 43 0 0 0 0 0 0 0 18 0 2 0 657393130 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604460364109056 0 0 -1 7 0 0 0
[pid=7833] ppid=7708 vsize=290600 CPUtime=0.65 cores=5,7
/proc/7833/stat : 7833 (python) S 7708 7708 5445 0 -1 4202560 1112 0 0 0 29 36 0 0 19 0 2 0 657422520 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7833/statm: 72650 6076 400 364 0 8565 0
[pid=7835] ppid=7833 vsize=19212 CPUtime=196.03 cores=5,7
/proc/7835/stat : 7835 (lingeling) T 7833 7835 7835 0 -1 4202496 32037 0 0 0 19597 6 0 0 25 0 1 0 657422521 19673088 4006 33554432000 4194304 4352236 140737011605296 18446744073709551615 4278369 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7835/statm: 4803 4006 129 39 0 3883 0
[pid=7833/tid=7841] ppid=7708 vsize=290600 CPUtime=0 cores=5,7
/proc/7833/task/7841/stat : 7841 (python) S 7708 7708 5445 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657442183 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604457342027904 0 0 -1 7 0 0 0
[pid=7842] ppid=7708 vsize=300856 CPUtime=0.37 cores=5,7
/proc/7842/stat : 7842 (python) S 7708 7708 5445 0 -1 4202560 949 0 0 0 18 19 0 0 15 0 1 0 657442184 308076544 6050 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879686 0 0 16781312 514 9345796059537834244 0 0 17 5 0 0 0
/proc/7842/statm: 75214 6050 371 364 0 11126 0
[pid=7844] ppid=7842 vsize=94136 CPUtime=102.38 cores=5,7
/proc/7844/stat : 7844 (cryptominisat-2) R 7842 7844 7844 0 -1 4202496 64450 0 0 0 10227 11 0 0 25 0 1 0 657442185 96395264 16245 33554432000 4194304 4677096 140737400849120 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7844/statm: 23534 16245 392 118 0 18493 0
[pid=7708/tid=7739] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 4 0 657334346 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7834] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7834/stat : 7834 (python) S 7706 7708 5445 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 4 0 657422520 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7843] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7843/stat : 7843 (python) S 7706 7708 5445 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 4 0 657442184 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 1343536

[startup+1242.3 s]
/proc/loadavg: 3.04 3.16 3.43 4/468 7855
/proc/meminfo: memFree=20755152/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=311100 CPUtime=0.94 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 12134 933 1 0 82 12 0 0 19 0 4 0 657334225 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 77775 7563 1880 364 0 13687 0
[pid=7738] ppid=7708 vsize=290588 CPUtime=2.88 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 1204 0 0 0 145 143 0 0 18 0 2 0 657334345 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7738/statm: 72647 6093 417 364 0 8565 0
[pid=7740] ppid=7738 vsize=37044 CPUtime=879.07 cores=5,7
/proc/7740/stat : 7740 (lingeling) T 7738 7740 7740 0 -1 4202496 98078 0 0 0 87893 14 0 0 25 0 1 0 657334346 37933056 8463 33554432000 4194304 4352236 140735402981280 18446744073709551615 4329086 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7740/statm: 9261 8463 129 39 0 8341 0
[pid=7738/tid=7819] ppid=7708 vsize=290588 CPUtime=0 cores=5,7
/proc/7738/task/7819/stat : 7819 (python) S 7708 7708 5445 0 -1 4202560 43 0 0 0 0 0 0 0 18 0 2 0 657393130 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604460364109056 0 0 -1 7 0 0 0
[pid=7833] ppid=7708 vsize=290600 CPUtime=0.65 cores=5,7
/proc/7833/stat : 7833 (python) S 7708 7708 5445 0 -1 4202560 1112 0 0 0 29 36 0 0 19 0 2 0 657422520 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7833/statm: 72650 6076 400 364 0 8565 0
[pid=7835] ppid=7833 vsize=19212 CPUtime=196.03 cores=5,7
/proc/7835/stat : 7835 (lingeling) T 7833 7835 7835 0 -1 4202496 32037 0 0 0 19597 6 0 0 25 0 1 0 657422521 19673088 4006 33554432000 4194304 4352236 140737011605296 18446744073709551615 4278369 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7835/statm: 4803 4006 129 39 0 3883 0
[pid=7833/tid=7841] ppid=7708 vsize=290600 CPUtime=0 cores=5,7
/proc/7833/task/7841/stat : 7841 (python) S 7708 7708 5445 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657442183 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604457342027904 0 0 -1 7 0 0 0
[pid=7842] ppid=7708 vsize=300856 CPUtime=0.57 cores=5,7
/proc/7842/stat : 7842 (python) S 7708 7708 5445 0 -1 4202560 969 0 0 0 28 29 0 0 15 0 1 0 657442184 308076544 6050 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879686 0 0 16781312 514 16507794904840110340 0 0 17 5 0 0 0
/proc/7842/statm: 75214 6050 371 364 0 11126 0
[pid=7844] ppid=7842 vsize=110620 CPUtime=162.21 cores=5,7
/proc/7844/stat : 7844 (cryptominisat-2) R 7842 7844 7844 0 -1 4202496 86588 0 0 0 16204 17 0 0 25 0 1 0 657442185 113274880 20450 33554432000 4194304 4677096 140737400849120 18446744073709551615 4454468 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7844/statm: 27655 20450 392 118 0 22614 0
[pid=7708/tid=7739] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 4 0 657334346 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7834] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7834/stat : 7834 (python) S 7706 7708 5445 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 4 0 657422520 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7843] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7843/stat : 7843 (python) S 7706 7708 5445 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 4 0 657442184 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1242.35
Current children cumulated vsize (KiB) 1360020



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.01 3.13 3.40 4/472 7860
/proc/meminfo: memFree=20271848/32951124 swapFree=56449224/67111528
[pid=7708] ppid=7706 vsize=311100 CPUtime=0.94 cores=5,7
/proc/7708/stat : 7708 (python) S 7706 7708 5445 0 -1 4202496 12134 933 1 0 82 12 0 0 19 0 4 0 657334225 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/7708/statm: 77775 7563 1880 364 0 13687 0
[pid=7738] ppid=7708 vsize=290588 CPUtime=2.88 cores=5,7
/proc/7738/stat : 7738 (python) S 7708 7708 5445 0 -1 4202560 1204 0 0 0 145 143 0 0 18 0 2 0 657334345 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7738/statm: 72647 6093 417 364 0 8565 0
[pid=7740] ppid=7738 vsize=37044 CPUtime=879.07 cores=5,7
/proc/7740/stat : 7740 (lingeling) T 7738 7740 7740 0 -1 4202496 98078 0 0 0 87893 14 0 0 25 0 1 0 657334346 37933056 8463 33554432000 4194304 4352236 140735402981280 18446744073709551615 4329086 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7740/statm: 9261 8463 129 39 0 8341 0
[pid=7738/tid=7819] ppid=7708 vsize=290588 CPUtime=0 cores=5,7
/proc/7738/task/7819/stat : 7819 (python) S 7708 7708 5445 0 -1 4202560 43 0 0 0 0 0 0 0 18 0 2 0 657393130 297562112 6093 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604460364109056 0 0 -1 7 0 0 0
[pid=7833] ppid=7708 vsize=290600 CPUtime=0.65 cores=5,7
/proc/7833/stat : 7833 (python) S 7708 7708 5445 0 -1 4202560 1112 0 0 0 29 36 0 0 19 0 2 0 657422520 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652686283 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/7833/statm: 72650 6076 400 364 0 8565 0
[pid=7835] ppid=7833 vsize=19212 CPUtime=196.03 cores=5,7
/proc/7835/stat : 7835 (lingeling) T 7833 7835 7835 0 -1 4202496 32037 0 0 0 19597 6 0 0 25 0 1 0 657422521 19673088 4006 33554432000 4194304 4352236 140737011605296 18446744073709551615 4278369 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/7835/statm: 4803 4006 129 39 0 3883 0
[pid=7833/tid=7841] ppid=7708 vsize=290600 CPUtime=0 cores=5,7
/proc/7833/task/7841/stat : 7841 (python) S 7708 7708 5445 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657442183 297574400 6076 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 514 18446604457342027904 0 0 -1 7 0 0 0
[pid=7842] ppid=7708 vsize=300856 CPUtime=0.78 cores=5,7
/proc/7842/stat : 7842 (python) S 7708 7708 5445 0 -1 4202560 989 0 0 0 39 39 0 0 15 0 1 0 657442184 308076544 6050 33554432000 4194304 5683644 140733883928736 18446744073709551615 253640879686 0 0 16781312 514 9345796059537834244 0 0 17 5 0 0 0
/proc/7842/statm: 75214 6050 371 364 0 11126 0
[pid=7844] ppid=7842 vsize=111144 CPUtime=219.71 cores=5,7
/proc/7844/stat : 7844 (cryptominisat-2) R 7842 7844 7844 0 -1 4202496 103735 0 0 0 21950 21 0 0 25 0 1 0 657442185 113811456 19632 33554432000 4194304 4677096 140737400849120 18446744073709551615 4320126 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/7844/statm: 27786 19632 392 118 0 22745 0
[pid=7708/tid=7739] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7739/stat : 7739 (python) S 7706 7708 5445 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 4 0 657334346 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7834] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7834/stat : 7834 (python) S 7706 7708 5445 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 4 0 657422520 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
[pid=7708/tid=7843] ppid=7706 vsize=311100 CPUtime=0 cores=5,7
/proc/7708/task/7843/stat : 7843 (python) S 7706 7708 5445 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 4 0 657442184 318566400 7563 33554432000 4194304 5683644 140733883928736 18446744073709551615 253652683185 0 0 16781312 2 18446604454543609984 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1300.06
Current children cumulated vsize (KiB) 1360544

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7708 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=824874
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=131979
# CPU time returned by wait4() is 0.956853
# while last known CPU time is 1300.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.04
CPU time (s): 1300.06
CPU user time (s): 1297.35
CPU system time (s): 2.71
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 1409508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.824874
system time used= 0.131979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13068
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2903
involuntary context switches= 12

runsolver used 5.57615 second user time and 13.455 second system time

The end

Launcher Data 

Begin job on node106 at 2011-05-15 13:02:18
IDJOB=3378022
IDBENCH=84237
IDSOLVER=1858
FILE ID=node106/3378022-1305457338
RUNJOBID= node106-1305456035-7462
PBS_JOBID= 13324871
Free space on /tmp= 73284 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT03/industrial/kukula/addm_bench/am_7_7.shuffled-as.sat03-363.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378022-1305457338/watcher-3378022-1305457338 -o /tmp/evaluation-result-3378022-1305457338/solver-3378022-1305457338 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378022-1305457338.cnf -seed 1060778650 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= c7f51e1ee7556440ab29e1c4bfe29538
RANDOM SEED=1060778650

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22227808 kB
Buffers:        294328 kB
Cached:        6222380 kB
SwapCached:      27544 kB
Active:        2227108 kB
Inactive:      8233308 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22227808 kB
SwapTotal:    67111528 kB
SwapFree:     56449224 kB
Dirty:           31856 kB
Writeback:           0 kB
AnonPages:     3924664 kB
Mapped:          26376 kB
Slab:           130364 kB
PageTables:      63900 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 123490372 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73140 MiB
End job on node106 at 2011-05-15 13:24:00