Trace number 3274931

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000 5003.72

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_12_2_4_cmp.cnf
MD5SUM7ea97a36d5ab6c8a5aa99830d5253591
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark61.2837
Satisfiable
(Un)Satisfiability was proved
Number of variables12584
Number of clauses155712
Sum of the clauses size523920
Maximum clause length100
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 217404
Number of clauses of size 3103200
Number of clauses of size 417828
Number of clauses of size 517000
Number of clauses of size over 5280

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3274931-1304144354/watcher-3274931-1304144354 -o /tmp/evaluation-result-3274931-1304144354/solver-3274931-1304144354 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3274931-1304144354.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.84 3.74 3.77 2/170 3174
/proc/meminfo: memFree=24815020/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0

[startup+0.0716071 s]
/proc/loadavg: 2.84 3.74 3.77 2/170 3174
/proc/meminfo: memFree=24815020/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100601 s]
/proc/loadavg: 2.84 3.74 3.77 2/170 3174
/proc/meminfo: memFree=24815020/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.388811 s]
/proc/loadavg: 2.84 3.74 3.77 2/170 3174
/proc/meminfo: memFree=24815020/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 17 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.16541 s]
/proc/loadavg: 2.84 3.74 3.77 2/170 3174
/proc/meminfo: memFree=24815020/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50036 s]
/proc/loadavg: 2.84 3.74 3.77 2/170 3174
/proc/meminfo: memFree=24815020/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 16 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10108 s]
/proc/loadavg: 2.84 3.74 3.77 9/180 3193
/proc/meminfo: memFree=24380552/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=95960 CPUtime=3.09 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 12889 0 0 0 308 1 0 0 25 0 1 0 604666178 98263040 10753 33554432000 4194304 4587354 140735628419120 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 23990 10753 329 96 0 20552 0
[pid=3176] ppid=3174 vsize=56216 CPUtime=3.09 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 12556 0 0 0 308 1 0 0 25 0 1 0 604666178 57565184 11276 33554432000 4194304 4785740 140735135319328 18446744073709551615 4279827 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 14054 11276 340 145 0 11099 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=3.02 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 302 0 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528620 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=338912 CPUtime=3.09 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 93216 0 0 0 297 12 0 0 25 0 1 0 604666178 347045888 77046 33554432000 4194304 4331988 140733277171968 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 84728 77047 151 34 0 83170 0
[pid=3179] ppid=3174 vsize=158716 CPUtime=11.57 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 19164 1250 0 1 1155 2 0 0 18 0 5 0 604666178 162525184 11769 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 39679 11769 164 40 0 38223 0
[pid=3179/tid=3186] ppid=3174 vsize=158716 CPUtime=2.84 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 1918 1250 0 1 284 0 0 0 25 0 5 0 604666202 162525184 11769 33554432000 4194304 4356188 140733633395008 18446744073709551615 4284190 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=158716 CPUtime=2.83 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 2252 1250 0 1 283 0 0 0 24 0 5 0 604666202 162525184 11769 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=158716 CPUtime=2.83 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 2035 1250 0 1 283 0 0 0 24 0 5 0 604666202 162525184 11769 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=158716 CPUtime=2.84 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 2252 1250 0 1 284 0 0 0 25 0 5 0 604666202 162525184 11769 33554432000 4194304 4356188 140733633395008 18446744073709551615 4298368 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 23.86
Current children cumulated vsize (KiB) 1144416

[startup+6.30052 s]
/proc/loadavg: 3.33 3.83 3.80 9/180 3193
/proc/meminfo: memFree=24291036/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=642792 CPUtime=6.29 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 20123 0 0 0 627 2 0 0 25 0 1 0 604666178 658219008 14076 33554432000 4194304 4587354 140735628419120 18446744073709551615 4353601 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 160698 14076 338 96 0 157260 0
[pid=3176] ppid=3174 vsize=78344 CPUtime=6.28 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 17984 0 0 0 626 2 0 0 25 0 1 0 604666178 80224256 16704 33554432000 4194304 4785740 140735135319328 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 19586 16704 340 145 0 16631 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=6.23 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 622 1 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=395024 CPUtime=6.28 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 171735 0 0 0 605 23 0 0 25 0 1 0 604666178 404504576 87977 33554432000 4194304 4331988 140733277171968 18446744073709551615 4257136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 98756 87977 151 34 0 97198 0
[pid=3179] ppid=3174 vsize=162256 CPUtime=24.35 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 20055 1250 0 1 2433 2 0 0 18 0 5 0 604666178 166150144 12654 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 40564 12654 164 40 0 39108 0
[pid=3179/tid=3186] ppid=3174 vsize=162256 CPUtime=6.04 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 2520 1250 0 1 604 0 0 0 25 0 5 0 604666202 166150144 12654 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=162256 CPUtime=6.03 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 2541 1250 0 1 603 0 0 0 25 0 5 0 604666202 166150144 12654 33554432000 4194304 4356188 140733633395008 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=162256 CPUtime=6.01 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 2035 1250 0 1 601 0 0 0 25 0 5 0 604666202 166150144 12654 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=162256 CPUtime=6.04 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 2252 1250 0 1 604 0 0 0 25 0 5 0 604666202 166150144 12654 33554432000 4194304 4356188 140733633395008 18446744073709551615 4210992 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.43
Current children cumulated vsize (KiB) 1773028

[startup+12.7014 s]
/proc/loadavg: 3.71 3.90 3.82 9/180 3193
/proc/meminfo: memFree=23883388/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=638860 CPUtime=12.7 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 32403 0 0 0 1266 4 0 0 25 0 1 0 604666178 654192640 14772 33554432000 4194304 4587354 140735628419120 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 159715 14772 338 96 0 156277 0
[pid=3176] ppid=3174 vsize=92672 CPUtime=12.69 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 21461 0 0 0 1266 3 0 0 25 0 1 0 604666178 94896128 20181 33554432000 4194304 4785740 140735135319328 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 23168 20181 340 145 0 20213 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=12.63 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 1262 1 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=989244 CPUtime=12.69 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 367341 0 0 0 1218 51 0 0 25 0 1 0 604666178 1012985856 177888 33554432000 4194304 4331988 140733277171968 18446744073709551615 4251674 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 247311 177888 160 34 0 245753 0
[pid=3179] ppid=3174 vsize=166352 CPUtime=49.94 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 21085 1250 0 1 4992 2 0 0 18 0 5 0 604666178 170344448 13678 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 41588 13678 164 40 0 40132 0
[pid=3179/tid=3186] ppid=3174 vsize=166352 CPUtime=12.45 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 2520 1250 0 1 1245 0 0 0 25 0 5 0 604666202 170344448 13678 33554432000 4194304 4356188 140733633395008 18446744073709551615 4210549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=166352 CPUtime=12.44 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 2541 1250 0 1 1244 0 0 0 25 0 5 0 604666202 170344448 13678 33554432000 4194304 4356188 140733633395008 18446744073709551615 4334582 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=166352 CPUtime=12.38 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 2803 1250 0 1 1238 0 0 0 25 0 5 0 604666202 170344448 13678 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=166352 CPUtime=12.44 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 2514 1250 0 1 1244 0 0 0 25 0 5 0 604666202 170344448 13678 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.65
Current children cumulated vsize (KiB) 2381740

[startup+25.5012 s]
/proc/loadavg: 4.74 4.12 3.89 9/180 3193
/proc/meminfo: memFree=23838612/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=707760 CPUtime=25.49 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 63538 0 0 0 2540 9 0 0 25 0 1 0 604666178 724746240 26062 33554432000 4194304 4587354 140735628419120 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 176940 26062 338 96 0 173502 0
[pid=3176] ppid=3174 vsize=111676 CPUtime=25.49 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 26037 0 0 0 2544 5 0 0 25 0 1 0 604666178 114356224 24757 33554432000 4194304 4785740 140735135319328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 27919 24757 340 145 0 24964 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=25.43 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 2542 1 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134530820 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=927776 CPUtime=25.49 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 473277 0 0 0 2482 67 0 0 25 0 1 0 604666178 950042624 171464 33554432000 4194304 4331988 140733277171968 18446744073709551615 4210445 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 231944 171464 172 34 0 230386 0
[pid=3179] ppid=3174 vsize=174216 CPUtime=101.05 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 23065 1250 0 1 10103 2 0 0 18 0 5 0 604666178 178397184 15644 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 43554 15644 164 40 0 42098 0
[pid=3179/tid=3186] ppid=3174 vsize=174216 CPUtime=25.24 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 2520 1250 0 1 2524 0 0 0 25 0 5 0 604666202 178397184 15644 33554432000 4194304 4356188 140733633395008 18446744073709551615 4241535 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=174216 CPUtime=25.23 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 3435 1250 0 1 2523 0 0 0 25 0 5 0 604666202 178397184 15644 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=174216 CPUtime=25.11 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 2803 1250 0 1 2511 0 0 0 25 0 5 0 604666202 178397184 15644 33554432000 4194304 4356188 140733633395008 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=174216 CPUtime=25.24 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 3600 1250 0 1 2524 0 0 0 25 0 5 0 604666202 178397184 15644 33554432000 4194304 4356188 140733633395008 18446744073709551615 4210765 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.95
Current children cumulated vsize (KiB) 2416040

################
# More data... #
################

[pid=3177] ppid=3174 vsize=476288 CPUtime=4782.2 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 478218 2 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=1104244 CPUtime=4782.39 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 519625 0 0 0 478149 90 0 0 25 0 1 0 604666178 1130745856 217812 33554432000 4194304 4331988 140733277171968 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 276061 217812 175 34 0 274503 0
[pid=3179] ppid=3174 vsize=410748 CPUtime=19101.4 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 309349 1250 0 1 1910090 46 0 0 18 0 5 0 604666178 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 102687 74777 164 40 0 101231 0
[pid=3179/tid=3186] ppid=3174 vsize=410748 CPUtime=4782.16 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 70544 1250 0 1 478205 11 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4282096 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=410748 CPUtime=4782.14 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 80491 1250 0 1 478203 11 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4281587 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=410748 CPUtime=4755.14 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 76993 1250 0 1 475503 11 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=410748 CPUtime=4781.7 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 70614 1250 0 1 478159 11 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38230.7
Current children cumulated vsize (KiB) 8308052

[startup+4842.3 s]
/proc/loadavg: 8.20 8.08 7.98 9/180 3344
/proc/meminfo: memFree=22113004/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=5481856 CPUtime=4842.4 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 3129154 0 0 0 483301 939 0 0 25 0 1 0 604666178 5613420544 189441 33554432000 4194304 4587354 140735628419120 18446744073709551615 4231856 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 1370464 189441 338 96 0 1367026 0
[pid=3176] ppid=3174 vsize=820856 CPUtime=4842.38 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 189241 0 0 0 484184 54 0 0 25 0 1 0 604666178 840556544 187961 33554432000 4194304 4785740 140735135319328 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 205214 187961 340 145 0 202259 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=4842.19 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 484217 2 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134530712 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=1104244 CPUtime=4842.4 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 519983 0 0 0 484149 91 0 0 25 0 1 0 604666178 1130745856 218170 33554432000 4194304 4331988 140733277171968 18446744073709551615 4299854 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 276061 218170 175 34 0 274503 0
[pid=3179] ppid=3174 vsize=400508 CPUtime=19340.3 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 315973 1250 0 1 1933985 47 0 0 18 0 5 0 604666178 410120192 72249 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 100127 72249 164 40 0 98671 0
[pid=3179/tid=3186] ppid=3174 vsize=400508 CPUtime=4842.15 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 74640 1250 0 1 484204 11 0 0 25 0 5 0 604666202 410120192 72249 33554432000 4194304 4356188 140733633395008 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=400508 CPUtime=4842.14 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 83019 1250 0 1 484202 12 0 0 25 0 5 0 604666202 410120192 72249 33554432000 4194304 4356188 140733633395008 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=400508 CPUtime=4814.11 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 76993 1250 0 1 481400 11 0 0 25 0 5 0 604666202 410120192 72249 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=400508 CPUtime=4841.68 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 70614 1250 0 1 484157 11 0 0 25 0 5 0 604666202 410120192 72249 33554432000 4194304 4356188 140733633395008 18446744073709551615 4279490 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38709.7
Current children cumulated vsize (KiB) 8302076

[startup+4902.31 s]
/proc/loadavg: 8.14 8.08 7.99 9/180 3346
/proc/meminfo: memFree=22273068/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=5481856 CPUtime=4902.41 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 3169197 0 0 0 489290 951 0 0 25 0 1 0 604666178 5613420544 151364 33554432000 4194304 4587354 140735628419120 18446744073709551615 4244514 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 1370464 151364 338 96 0 1367026 0
[pid=3176] ppid=3174 vsize=829000 CPUtime=4902.39 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 191109 0 0 0 490185 54 0 0 25 0 1 0 604666178 848896000 189829 33554432000 4194304 4785740 140735135319328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 207250 189829 340 145 0 204295 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=4902.19 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 490217 2 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=1104244 CPUtime=4902.4 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 520328 0 0 0 490149 91 0 0 25 0 1 0 604666178 1130745856 218515 33554432000 4194304 4331988 140733277171968 18446744073709551615 4228307 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 276061 218515 175 34 0 274503 0
[pid=3179] ppid=3174 vsize=384124 CPUtime=19580 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 323557 1250 0 1 1957953 48 0 0 18 0 5 0 604666178 393342976 68153 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 96031 68153 164 40 0 94575 0
[pid=3179/tid=3186] ppid=3174 vsize=384124 CPUtime=4902.16 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 77168 1250 0 1 490204 12 0 0 25 0 5 0 604666202 393342976 68153 33554432000 4194304 4356188 140733633395008 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=384124 CPUtime=4902.15 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 83019 1250 0 1 490203 12 0 0 25 0 5 0 604666202 393342976 68153 33554432000 4194304 4356188 140733633395008 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=384124 CPUtime=4873.78 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 79521 1250 0 1 487367 11 0 0 25 0 5 0 604666202 393342976 68153 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=384124 CPUtime=4901.68 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 73142 1250 0 1 490157 11 0 0 25 0 5 0 604666202 393342976 68153 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39189.4
Current children cumulated vsize (KiB) 8293836

[startup+4962.3 s]
/proc/loadavg: 8.11 8.08 7.99 9/180 3347
/proc/meminfo: memFree=22103800/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=5481856 CPUtime=4962.4 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 3206976 0 0 0 495279 961 0 0 25 0 1 0 604666178 5613420544 189045 33554432000 4194304 4587354 140735628419120 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 1370464 189045 338 96 0 1367026 0
[pid=3176] ppid=3174 vsize=831296 CPUtime=4962.38 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 191612 0 0 0 496184 54 0 0 25 0 1 0 604666178 851247104 190332 33554432000 4194304 4785740 140735135319328 18446744073709551615 4287024 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 207824 190332 340 145 0 204869 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=4962.19 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 496217 2 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=1104244 CPUtime=4962.4 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 520671 0 0 0 496149 91 0 0 25 0 1 0 604666178 1130745856 218858 33554432000 4194304 4331988 140733277171968 18446744073709551615 4228290 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 276061 218858 175 34 0 274503 0
[pid=3179] ppid=3174 vsize=404604 CPUtime=19819.7 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 332230 1250 0 1 1981918 49 0 0 18 0 5 0 604666178 414314496 72730 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 101151 72730 164 40 0 99695 0
[pid=3179/tid=3186] ppid=3174 vsize=404604 CPUtime=4962.16 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 77168 1250 0 1 496204 12 0 0 25 0 5 0 604666202 414314496 72730 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=404604 CPUtime=4962.14 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 87115 1250 0 1 496202 12 0 0 25 0 5 0 604666202 414314496 72730 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=404604 CPUtime=4933.46 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 79521 1250 0 1 493335 11 0 0 25 0 5 0 604666202 414314496 72730 33554432000 4194304 4356188 140733633395008 18446744073709551615 4334575 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=404604 CPUtime=4961.68 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 77719 1250 0 1 496156 12 0 0 25 0 5 0 604666202 414314496 72730 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39669
Current children cumulated vsize (KiB) 8316612



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.7 s]
/proc/loadavg: 8.12 8.08 8.00 9/180 3348
/proc/meminfo: memFree=22146312/32950940 swapFree=67111364/67111528
[pid=3174] ppid=3172 vsize=18324 CPUtime=0 cores=0-7
/proc/3174/stat : 3174 (ppfolio) S 3172 3174 3147 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 604666177 18763776 390 33554432000 4194304 4287625 140736483297408 18446744073709551615 215988612623 0 0 4096 65536 3496429938192416767 0 0 17 4 0 0 0
/proc/3174/statm: 4581 390 341 23 0 91 0
[pid=3175] ppid=3174 vsize=5481856 CPUtime=5003.81 cores=0
/proc/3175/stat : 3175 (cryptominisat) R 3174 3174 3147 0 -1 4202496 3235768 0 0 0 499410 971 0 0 25 0 1 0 604666178 5613420544 175659 33554432000 4194304 4587354 140735628419120 18446744073709551615 215988289291 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3175/statm: 1370464 175660 338 96 0 1367026 0
[pid=3176] ppid=3174 vsize=831296 CPUtime=5003.79 cores=1
/proc/3176/stat : 3176 (clasp) R 3174 3174 3147 0 -1 4202496 191618 0 0 0 500325 54 0 0 25 0 1 0 604666178 851247104 190338 33554432000 4194304 4785740 140735135319328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3176/statm: 207824 190338 340 145 0 204869 0
[pid=3177] ppid=3174 vsize=476288 CPUtime=5003.59 cores=2
/proc/3177/stat : 3177 (TNM) R 3174 3174 3147 0 -1 4202496 7039 0 11 0 500357 2 0 0 25 0 1 0 604666178 487718912 6947 33554432000 134512640 134534564 4293013024 18446744073709551615 134528628 0 0 4096 0 0 0 0 17 2 0 0 6
/proc/3177/statm: 119072 6947 95 6 0 117738 0
[pid=3178] ppid=3174 vsize=1104244 CPUtime=5003.8 cores=3
/proc/3178/stat : 3178 (march_hi) R 3174 3174 3147 0 -1 4202496 520920 0 0 0 500289 91 0 0 25 0 1 0 604666178 1130745856 219107 33554432000 4194304 4331988 140733277171968 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3178/statm: 276061 219107 175 34 0 274503 0
[pid=3179] ppid=3174 vsize=410748 CPUtime=19985.1 cores=4-7
/proc/3179/stat : 3179 (plingeling) S 3174 3174 3147 0 -1 4202496 334277 1250 0 1 1998456 49 0 0 18 0 5 0 604666178 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3179/statm: 102687 74777 164 40 0 101231 0
[pid=3179/tid=3186] ppid=3174 vsize=410748 CPUtime=5003.56 cores=4-7
/proc/3179/task/3186/stat : 3186 (plingeling) R 3174 3174 3147 0 -1 4202560 77168 1250 0 1 500344 12 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4283959 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3179/tid=3190] ppid=3174 vsize=410748 CPUtime=5003.55 cores=4-7
/proc/3179/task/3190/stat : 3190 (plingeling) R 3174 3174 3147 0 -1 4202560 88546 1250 0 1 500343 12 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3179/tid=3191] ppid=3174 vsize=410748 CPUtime=4974.63 cores=4-7
/proc/3179/task/3191/stat : 3191 (plingeling) R 3174 3174 3147 0 -1 4202560 80137 1250 0 1 497452 11 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3179/tid=3193] ppid=3174 vsize=410748 CPUtime=5003.08 cores=4-7
/proc/3179/task/3193/stat : 3193 (plingeling) R 3174 3174 3147 0 -1 4202560 77719 1250 0 1 500296 12 0 0 25 0 5 0 604666202 420605952 74777 33554432000 4194304 4356188 140733633395008 18446744073709551615 4331814 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000
Current children cumulated vsize (KiB) 8322756

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3174 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=580340
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=34994
# CPU time returned by wait4() is 5003.62
# while last known CPU time is 40000
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.72
CPU time (s): 40000
CPU user time (s): 39988.4
CPU system time (s): 11.67
CPU usage (%): 799.407
Max. virtual memory (cumulated for all children) (KiB): 13172048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.58
system time used= 0.034994
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7564
page faults= 11
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 345
involuntary context switches= 66659

runsolver used 7.80681 second user time and 19.492 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-30 08:19:14
IDJOB=3274931
IDBENCH=70908
IDSOLVER=1638
FILE ID=node117/3274931-1304144354
RUNJOBID= node117-1304144354-3161
PBS_JOBID= 13170854
Free space on /tmp= 72628 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_12_2_4_cmp.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3274931-1304144354/watcher-3274931-1304144354 -o /tmp/evaluation-result-3274931-1304144354/solver-3274931-1304144354 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3274931-1304144354.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7ea97a36d5ab6c8a5aa99830d5253591
RANDOM SEED=1934324980

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      24815424 kB
Buffers:       1889160 kB
Cached:        5618160 kB
SwapCached:        160 kB
Active:         890636 kB
Inactive:      6680108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      24815424 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           13756 kB
Writeback:           0 kB
AnonPages:       63644 kB
Mapped:          14332 kB
Slab:           500104 kB
PageTables:       4216 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   187908 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72616 MiB
End job on node117 at 2011-04-30 09:42:40