Trace number 3219579

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39972.6 5000.02

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S303265982-092-UNKNOWN.cnf
MD5SUM1b4a544dd042630233219a622c9437c7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark186.925
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219579-1304151210/watcher-3219579-1304151210 -o /tmp/evaluation-result-3219579-1304151210/solver-3219579-1304151210 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3219579-1304151210.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.07 8.01 1/170 26025
/proc/meminfo: memFree=30505548/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 4 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0

[startup+0.019018 s]
/proc/loadavg: 8.11 8.07 8.01 1/170 26025
/proc/meminfo: memFree=30505548/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 4 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100974 s]
/proc/loadavg: 8.11 8.07 8.01 1/170 26025
/proc/meminfo: memFree=30505548/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300936 s]
/proc/loadavg: 8.11 8.07 8.01 1/170 26025
/proc/meminfo: memFree=30505548/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 24 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70086 s]
/proc/loadavg: 8.11 8.07 8.01 1/170 26025
/proc/meminfo: memFree=30505548/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 20 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50071 s]
/proc/loadavg: 8.11 8.07 8.01 9/180 26040
/proc/meminfo: memFree=30455248/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=199128 CPUtime=1.49 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 6229 0 0 0 149 0 0 0 20 0 1 0 526723411 203907072 3261 33554432000 4194304 4587354 140733196325696 18446744073709551615 4250322 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 49782 3261 327 96 0 46344 0
[pid=26027] ppid=26025 vsize=25492 CPUtime=1.49 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 3975 0 0 0 149 0 0 0 20 0 1 0 526723411 26103808 3705 33554432000 4194304 4785740 140737074617264 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 6373 3705 340 145 0 3418 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=1.49 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 149 0 0 0 20 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=15324 CPUtime=1.48 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 6517 0 0 0 148 0 0 0 20 0 1 0 526723411 15691776 1658 33554432000 4194304 4331988 140735744903072 18446744073709551615 4265493 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 3831 1658 174 34 0 2273 0
[pid=26030] ppid=26025 vsize=125772 CPUtime=5.78 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 4129 1249 0 0 578 0 0 0 19 0 5 0 526723411 128790528 3525 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 31443 3525 162 40 0 29987 0
[pid=26030/tid=26037] ppid=26025 vsize=125772 CPUtime=1.43 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 113 1249 0 0 143 0 0 0 23 0 5 0 526723417 128790528 3525 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331007 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=125772 CPUtime=1.43 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 127 1249 0 0 143 0 0 0 23 0 5 0 526723417 128790528 3525 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=125772 CPUtime=1.43 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 99 1249 0 0 143 0 0 0 23 0 5 0 526723417 128790528 3525 33554432000 4194304 4356188 140734576540352 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=125772 CPUtime=1.42 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 106 1249 0 0 142 0 0 0 25 0 5 0 526723417 128790528 3525 33554432000 4194304 4356188 140734576540352 18446744073709551615 4234377 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.73
Current children cumulated vsize (KiB) 844748

[startup+3.1014 s]
/proc/loadavg: 8.18 8.09 8.01 9/180 26040
/proc/meminfo: memFree=30453512/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=193520 CPUtime=3.09 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 10063 0 0 0 308 1 0 0 25 0 1 0 526723411 198164480 3765 33554432000 4194304 4587354 140733196325696 18446744073709551615 4268205 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 48380 3765 337 96 0 44942 0
[pid=26027] ppid=26025 vsize=27472 CPUtime=3.09 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 4453 0 0 0 309 0 0 0 25 0 1 0 526723411 28131328 4183 33554432000 4194304 4785740 140737074617264 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 6868 4183 340 145 0 3913 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=3.09 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 309 0 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=15740 CPUtime=3.08 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 6565 0 0 0 308 0 0 0 25 0 1 0 526723411 16117760 1706 33554432000 4194304 4331988 140735744903072 18446744073709551615 4299840 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 3935 1706 174 34 0 2377 0
[pid=26030] ppid=26025 vsize=127112 CPUtime=12.18 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 4490 1249 0 0 1218 0 0 0 19 0 5 0 526723411 130162688 3868 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 31778 3868 162 40 0 30322 0
[pid=26030/tid=26037] ppid=26025 vsize=127112 CPUtime=3.04 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 188 1249 0 0 304 0 0 0 25 0 5 0 526723417 130162688 3868 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=127112 CPUtime=3.03 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 215 1249 0 0 303 0 0 0 25 0 5 0 526723417 130162688 3868 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332023 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=127112 CPUtime=3.03 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 204 1249 0 0 303 0 0 0 25 0 5 0 526723417 130162688 3868 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331731 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=127112 CPUtime=3.02 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 199 1249 0 0 302 0 0 0 25 0 5 0 526723417 130162688 3868 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.53
Current children cumulated vsize (KiB) 842876

[startup+6.3008 s]
/proc/loadavg: 8.18 8.09 8.01 9/180 26041
/proc/meminfo: memFree=30442128/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=209664 CPUtime=6.29 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 22799 0 0 0 625 4 0 0 25 0 1 0 526723411 214695936 6197 33554432000 4194304 4587354 140733196325696 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 52416 6197 337 96 0 48978 0
[pid=26027] ppid=26025 vsize=31948 CPUtime=6.29 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 5567 0 0 0 629 0 0 0 25 0 1 0 526723411 32714752 5297 33554432000 4194304 4785740 140737074617264 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 7987 5297 340 145 0 5032 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=6.29 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 629 0 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=16684 CPUtime=6.28 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 6731 0 0 0 628 0 0 0 25 0 1 0 526723411 17084416 1872 33554432000 4194304 4331988 140735744903072 18446744073709551615 4299208 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 4171 1872 174 34 0 2613 0
[pid=26030] ppid=26025 vsize=129888 CPUtime=24.97 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 5172 1249 0 0 2496 1 0 0 19 0 5 0 526723411 133005312 4550 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 32472 4550 162 40 0 31016 0
[pid=26030/tid=26037] ppid=26025 vsize=129888 CPUtime=6.24 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 377 1249 0 0 624 0 0 0 25 0 5 0 526723417 133005312 4550 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=129888 CPUtime=6.23 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 343 1249 0 0 623 0 0 0 25 0 5 0 526723417 133005312 4550 33554432000 4194304 4356188 140734576540352 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=129888 CPUtime=6.23 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 372 1249 0 0 623 0 0 0 25 0 5 0 526723417 133005312 4550 33554432000 4194304 4356188 140734576540352 18446744073709551615 4279717 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=129888 CPUtime=6.2 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 396 1249 0 0 620 0 0 0 25 0 5 0 526723417 133005312 4550 33554432000 4194304 4356188 140734576540352 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.12
Current children cumulated vsize (KiB) 867216

[startup+12.7006 s]
/proc/loadavg: 8.15 8.09 8.01 9/180 26041
/proc/meminfo: memFree=30409296/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=205304 CPUtime=12.69 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 28159 0 0 0 1264 5 0 0 25 0 1 0 526723411 210231296 6749 33554432000 4194304 4587354 140733196325696 18446744073709551615 4248773 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 51326 6749 337 96 0 47888 0
[pid=26027] ppid=26025 vsize=36604 CPUtime=12.69 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 6733 0 0 0 1268 1 0 0 25 0 1 0 526723411 37482496 6463 33554432000 4194304 4785740 140737074617264 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 9151 6463 340 145 0 6196 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=12.69 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 1269 0 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=18984 CPUtime=12.68 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 7209 0 0 0 1268 0 0 0 25 0 1 0 526723411 19439616 2350 33554432000 4194304 4331988 140735744903072 18446744073709551615 4284558 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 4746 2350 175 34 0 3188 0
[pid=26030] ppid=26025 vsize=133532 CPUtime=50.53 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 6614 1249 0 0 5052 1 0 0 19 0 5 0 526723411 136736768 5453 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 33383 5453 162 40 0 31927 0
[pid=26030/tid=26037] ppid=26025 vsize=133532 CPUtime=12.63 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 722 1249 0 0 1263 0 0 0 25 0 5 0 526723417 136736768 5453 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=133532 CPUtime=12.63 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 757 1249 0 0 1263 0 0 0 25 0 5 0 526723417 136736768 5453 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=133532 CPUtime=12.63 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 737 1249 0 0 1263 0 0 0 25 0 5 0 526723417 136736768 5453 33554432000 4194304 4356188 140734576540352 18446744073709551615 4274144 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=133532 CPUtime=12.56 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 714 1249 0 0 1256 0 0 0 25 0 5 0 526723417 136736768 5453 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.28
Current children cumulated vsize (KiB) 873456

[startup+25.5011 s]
/proc/loadavg: 8.13 8.08 8.01 9/180 26041
/proc/meminfo: memFree=30419436/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=203464 CPUtime=25.49 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 39209 0 0 0 2543 6 0 0 25 0 1 0 526723411 208347136 4934 33554432000 4194304 4587354 140733196325696 18446744073709551615 212435713723 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=26028] ppid=26025 vsize=460708 CPUtime=4782.01 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 478199 2 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134528488 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=695700 CPUtime=4782.46 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 166060 0 0 0 478134 112 0 0 25 0 1 0 526723411 712396800 161201 33554432000 4194304 4331988 140735744903072 18446744073709551615 4239523 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 173925 161201 175 34 0 172367 0
[pid=26030] ppid=26025 vsize=220892 CPUtime=19102.7 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 493299 1249 0 0 1910196 71 0 0 19 0 5 0 526723411 226193408 27325 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 55223 27325 162 40 0 53767 0
[pid=26030/tid=26037] ppid=26025 vsize=220892 CPUtime=4782.28 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 125113 1249 0 0 478212 16 0 0 25 0 5 0 526723417 226193408 27325 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=220892 CPUtime=4781.74 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 122656 1249 0 0 478155 19 0 0 25 0 5 0 526723417 226193408 27325 33554432000 4194304 4356188 140734576540352 18446744073709551615 4330817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=220892 CPUtime=4782.25 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 117704 1249 0 0 478208 17 0 0 25 0 5 0 526723417 226193408 27325 33554432000 4194304 4356188 140734576540352 18446744073709551615 4210992 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=220892 CPUtime=4756.32 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 124142 1249 0 0 475616 16 0 0 25 0 5 0 526723417 226193408 27325 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38232.1
Current children cumulated vsize (KiB) 2366616

[startup+4842.3 s]
/proc/loadavg: 8.09 8.07 8.00 9/180 26182
/proc/meminfo: memFree=28964584/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=703024 CPUtime=4842.47 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 1954629 0 0 0 483534 713 0 0 25 0 1 0 526723411 719896576 131681 33554432000 4194304 4587354 140733196325696 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 175756 131681 337 96 0 172318 0
[pid=26027] ppid=26025 vsize=271212 CPUtime=4842.46 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 62050 0 0 0 484229 17 0 0 25 0 1 0 526723411 277721088 61662 33554432000 4194304 4785740 140737074617264 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 67803 61662 341 145 0 64848 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=4842.01 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 484199 2 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=695700 CPUtime=4842.47 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 168153 0 0 0 484133 114 0 0 25 0 1 0 526723411 712396800 163294 33554432000 4194304 4331988 140735744903072 18446744073709551615 4228249 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 173925 163294 175 34 0 172367 0
[pid=26030] ppid=26025 vsize=219996 CPUtime=19342.3 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 501107 1249 0 0 1934163 72 0 0 19 0 5 0 526723411 225275904 27101 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 54999 27101 162 40 0 53543 0
[pid=26030/tid=26037] ppid=26025 vsize=219996 CPUtime=4842.28 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 128441 1249 0 0 484211 17 0 0 25 0 5 0 526723417 225275904 27101 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=219996 CPUtime=4841.74 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 122848 1249 0 0 484155 19 0 0 25 0 5 0 526723417 225275904 27101 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=219996 CPUtime=4842.26 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 119752 1249 0 0 484208 18 0 0 25 0 5 0 526723417 225275904 27101 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=219996 CPUtime=4815.99 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 126382 1249 0 0 481583 16 0 0 25 0 5 0 526723417 225275904 27101 33554432000 4194304 4356188 140734576540352 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38711.8
Current children cumulated vsize (KiB) 2368964

[startup+4902.3 s]
/proc/loadavg: 8.08 8.07 8.00 9/180 26183
/proc/meminfo: memFree=28962200/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=703024 CPUtime=4902.47 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 1954629 0 0 0 489534 713 0 0 25 0 1 0 526723411 719896576 131681 33554432000 4194304 4587354 140733196325696 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 175756 131681 337 96 0 172318 0
[pid=26027] ppid=26025 vsize=273664 CPUtime=4902.46 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 62601 0 0 0 490229 17 0 0 25 0 1 0 526723411 280231936 62213 33554432000 4194304 4785740 140737074617264 18446744073709551615 4550330 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 68416 62213 341 145 0 65461 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=4902 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 490198 2 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=695700 CPUtime=4902.46 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 170223 0 0 0 490131 115 0 0 25 0 1 0 526723411 712396800 165364 33554432000 4194304 4331988 140735744903072 18446744073709551615 4265328 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 173925 165364 175 34 0 172367 0
[pid=26030] ppid=26025 vsize=211548 CPUtime=19582 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 501523 1249 0 0 1958131 72 0 0 19 0 5 0 526723411 216625152 24989 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 52887 24989 162 40 0 51431 0
[pid=26030/tid=26037] ppid=26025 vsize=211548 CPUtime=4902.28 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 128441 1249 0 0 490211 17 0 0 25 0 5 0 526723417 216625152 24989 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=211548 CPUtime=4901.74 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 122848 1249 0 0 490155 19 0 0 25 0 5 0 526723417 216625152 24989 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=211548 CPUtime=4902.26 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 119912 1249 0 0 490208 18 0 0 25 0 5 0 526723417 216625152 24989 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=211548 CPUtime=4875.67 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 126638 1249 0 0 487551 16 0 0 25 0 5 0 526723417 216625152 24989 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39191.4
Current children cumulated vsize (KiB) 2362968

[startup+4962.3 s]
/proc/loadavg: 8.08 8.07 8.00 9/180 26185
/proc/meminfo: memFree=28952740/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=703024 CPUtime=4962.47 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 1954629 0 0 0 495533 714 0 0 25 0 1 0 526723411 719896576 131681 33554432000 4194304 4587354 140733196325696 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 175756 131681 337 96 0 172318 0
[pid=26027] ppid=26025 vsize=275584 CPUtime=4962.46 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 63030 0 0 0 496229 17 0 0 25 0 1 0 526723411 282198016 62642 33554432000 4194304 4785740 140737074617264 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 68896 62642 341 145 0 65941 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=4962 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 496198 2 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=695700 CPUtime=4962.47 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 172312 0 0 0 496130 117 0 0 25 0 1 0 526723411 712396800 167453 33554432000 4194304 4331988 140735744903072 18446744073709551615 4265504 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 173925 167453 175 34 0 172367 0
[pid=26030] ppid=26025 vsize=210396 CPUtime=19821.7 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 503603 1249 0 0 1982099 73 0 0 19 0 5 0 526723411 215445504 24701 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 52599 24701 162 40 0 51143 0
[pid=26030/tid=26037] ppid=26025 vsize=210396 CPUtime=4962.28 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 130521 1249 0 0 496211 17 0 0 25 0 5 0 526723417 215445504 24701 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=210396 CPUtime=4961.75 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 122848 1249 0 0 496156 19 0 0 25 0 5 0 526723417 215445504 24701 33554432000 4194304 4356188 140734576540352 18446744073709551615 4282502 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=210396 CPUtime=4962.26 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 119912 1249 0 0 496208 18 0 0 25 0 5 0 526723417 215445504 24701 33554432000 4194304 4356188 140734576540352 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=210396 CPUtime=4935.34 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 126638 1249 0 0 493518 16 0 0 25 0 5 0 526723417 215445504 24701 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39671.1
Current children cumulated vsize (KiB) 2363736



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.11 8.07 8.00 9/180 26186
/proc/meminfo: memFree=28929796/32951124 swapFree=67111416/67111528
[pid=26025] ppid=26023 vsize=18324 CPUtime=0 cores=0-7
/proc/26025/stat : 26025 (ppfolio) S 26023 26025 25743 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 526723411 18763776 389 33554432000 4194304 4287625 140733199748320 18446744073709551615 212436037135 0 0 4096 65536 4295026948800774143 0 0 17 6 0 0 0
/proc/26025/statm: 4581 389 341 23 0 91 0
[pid=26026] ppid=26025 vsize=703024 CPUtime=5000.18 cores=0
/proc/26026/stat : 26026 (cryptominisat) R 26025 26025 25743 0 -1 4202496 1954629 0 0 0 499304 714 0 0 25 0 1 0 526723411 719896576 131681 33554432000 4194304 4587354 140733196325696 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26026/statm: 175756 131681 337 96 0 172318 0
[pid=26027] ppid=26025 vsize=276832 CPUtime=5000.17 cores=1
/proc/26027/stat : 26027 (clasp) R 26025 26025 25743 0 -1 4202496 63322 0 0 0 500000 17 0 0 25 0 1 0 526723411 283475968 62934 33554432000 4194304 4785740 140737074617264 18446744073709551615 4287076 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26027/statm: 69208 62934 341 145 0 66253 0
[pid=26028] ppid=26025 vsize=460708 CPUtime=4999.7 cores=2
/proc/26028/stat : 26028 (TNM) R 26025 26025 25743 0 -1 4202496 1810 0 0 0 499968 2 0 0 25 0 1 0 526723411 471764992 1707 33554432000 134512640 134534564 4288521040 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26028/statm: 115177 1707 95 6 0 113843 0
[pid=26029] ppid=26025 vsize=695700 CPUtime=5000.17 cores=3
/proc/26029/stat : 26029 (march_hi) R 26025 26025 25743 0 -1 4202496 173618 0 0 0 499899 118 0 0 25 0 1 0 526723411 712396800 168759 33554432000 4194304 4331988 140735744903072 18446744073709551615 4210418 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26029/statm: 173925 168759 175 34 0 172367 0
[pid=26030] ppid=26025 vsize=228060 CPUtime=19972.3 cores=4-7
/proc/26030/stat : 26030 (plingeling) S 26025 26025 25743 0 -1 4202496 508019 1249 0 0 1997160 73 0 0 19 0 5 0 526723411 233533440 29117 33554432000 4194304 4356188 140734576540352 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26030/statm: 57015 29117 162 40 0 55559 0
[pid=26030/tid=26037] ppid=26025 vsize=228060 CPUtime=4999.98 cores=4-7
/proc/26030/task/26037/stat : 26037 (plingeling) R 26025 26025 25743 0 -1 4202560 130777 1249 0 0 499981 17 0 0 25 0 5 0 526723417 233533440 29117 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26030/tid=26038] ppid=26025 vsize=228060 CPUtime=4999.46 cores=4-7
/proc/26030/task/26038/stat : 26038 (plingeling) R 26025 26025 25743 0 -1 4202560 124960 1249 0 0 499926 20 0 0 25 0 5 0 526723417 233533440 29117 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26030/tid=26039] ppid=26025 vsize=228060 CPUtime=4999.97 cores=4-7
/proc/26030/task/26039/stat : 26039 (plingeling) R 26025 26025 25743 0 -1 4202560 119912 1249 0 0 499979 18 0 0 25 0 5 0 526723417 233533440 29117 33554432000 4194304 4356188 140734576540352 18446744073709551615 4331129 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26030/tid=26040] ppid=26025 vsize=228060 CPUtime=4972.84 cores=4-7
/proc/26030/task/26040/stat : 26040 (plingeling) R 26025 26025 25743 0 -1 4202560 128686 1249 0 0 497268 16 0 0 25 0 5 0 526723417 233533440 29117 33554432000 4194304 4356188 140734576540352 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39972.6
Current children cumulated vsize (KiB) 2382648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26025 and gives
#  childrusage.ru_utime.tv_sec=4999
#  childrusage.ru_utime.tv_usec=688931
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=31995
# CPU time returned by wait4() is 4999.72
# while last known CPU time is 39972.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39972.6
CPU user time (s): 39963.3
CPU system time (s): 9.24
CPU usage (%): 799.448
Max. virtual memory (cumulated for all children) (KiB): 2382648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.69
system time used= 0.031995
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2329
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 487
involuntary context switches= 14813

runsolver used 7.8658 second user time and 19.409 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-30 10:13:31
IDJOB=3219579
IDBENCH=82613
IDSOLVER=1638
FILE ID=node102/3219579-1304151210
RUNJOBID= node102-1304145614-25757
PBS_JOBID= 13170895
Free space on /tmp= 72468 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S303265982-092-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219579-1304151210/watcher-3219579-1304151210 -o /tmp/evaluation-result-3219579-1304151210/solver-3219579-1304151210 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3219579-1304151210.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1b4a544dd042630233219a622c9437c7
RANDOM SEED=956852236

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30505828 kB
Buffers:        623976 kB
Cached:        1340504 kB
SwapCached:          0 kB
Active:         192928 kB
Inactive:      1835420 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30505828 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:           10924 kB
Writeback:           0 kB
AnonPages:       63920 kB
Mapped:          14544 kB
Slab:           352040 kB
PageTables:       3872 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187612 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72460 MiB
End job on node102 at 2011-04-30 11:36:53