Trace number 3310309

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 35587.1 5100.02

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top23.cnf
MD5SUM6ee28191d649bfeef8c7d8c569a3cd59
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark640.829
Satisfiable
(Un)Satisfiability was proved
Number of variables60823
Number of clauses193450
Sum of the clauses size472824
Maximum clause length2414
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2117689
Number of clauses of size 374473
Number of clauses of size 4275
Number of clauses of size 521
Number of clauses of size over 5991

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310309-1304008983/watcher-3310309-1304008983 -o /tmp/evaluation-result-3310309-1304008983/solver-3310309-1304008983 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310309-1304008983.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.83 7.83 7.92 2/170 24143
/proc/meminfo: memFree=16108948/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512497088 18763776 390 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 2826088480830 0 0 17 6 0 0 0
/proc/24143/statm: 4581 390 341 23 0 91 0

[startup+0.079614 s]
/proc/loadavg: 6.83 7.83 7.92 2/170 24143
/proc/meminfo: memFree=16108948/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 25 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.100608 s]
/proc/loadavg: 6.83 7.83 7.92 2/170 24143
/proc/meminfo: memFree=16108948/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 25 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.300634 s]
/proc/loadavg: 6.83 7.83 7.92 2/170 24143
/proc/meminfo: memFree=16108948/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 25 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700565 s]
/proc/loadavg: 6.83 7.83 7.92 2/170 24143
/proc/meminfo: memFree=16108948/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 25 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.50136 s]
/proc/loadavg: 6.83 7.83 7.92 8/179 24158
/proc/meminfo: memFree=15976816/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 17 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=54828 CPUtime=1.49 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 8639 0 0 0 148 1 0 0 25 0 1 0 512497088 56143872 8442 33554432000 4194304 4587354 140734785398576 18446744073709551615 4421108 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 13707 8442 312 96 0 10269 0
[pid=24145] ppid=24143 vsize=44744 CPUtime=1.48 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 10896 0 0 0 147 1 0 0 20 0 1 0 512497088 45817856 8345 33554432000 4194304 4785740 140734092605888 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 11186 8345 340 145 0 8231 0
[pid=24147] ppid=24143 vsize=129372 CPUtime=1.49 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 68445 0 0 0 140 9 0 0 20 0 1 0 512497088 132476928 14138 33554432000 4194304 4331988 140737424196368 18446744073709551615 268272346939 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 32343 14138 162 34 0 30785 0
[pid=24148] ppid=24143 vsize=102512 CPUtime=4.02 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 17966 1254 0 0 400 2 0 0 18 0 5 0 512497088 104972288 14046 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 25628 14046 156 40 0 24172 0
[pid=24148/tid=24155] ppid=24143 vsize=102512 CPUtime=1.26 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 3100 1254 0 0 126 0 0 0 18 0 5 0 512497111 104972288 14046 33554432000 4194304 4356188 140734101522208 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=102512 CPUtime=0.61 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 1043 1254 0 0 61 0 0 0 22 0 5 0 512497111 104972288 14046 33554432000 4194304 4356188 140734101522208 18446744073709551615 4237473 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=102512 CPUtime=1.26 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 3285 1254 0 0 126 0 0 0 22 0 5 0 512497111 104972288 14046 33554432000 4194304 4356188 140734101522208 18446744073709551615 4321986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=102512 CPUtime=0.64 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 1925 1254 0 0 64 0 0 0 21 0 5 0 512497111 104972288 14046 33554432000 4194304 4356188 140734101522208 18446744073709551615 4261882 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 8.49
Current children cumulated vsize (KiB) 349780

[startup+3.10114 s]
/proc/loadavg: 6.83 7.83 7.92 8/179 24158
/proc/meminfo: memFree=15912460/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=77152 CPUtime=3.09 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 18142 0 0 0 306 3 0 0 25 0 1 0 512497088 79003648 14654 33554432000 4194304 4587354 140734785398576 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 19288 14654 330 96 0 15850 0
[pid=24145] ppid=24143 vsize=45140 CPUtime=3.08 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 11001 0 0 0 307 1 0 0 25 0 1 0 512497088 46223360 8450 33554432000 4194304 4785740 140734092605888 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 11285 8450 340 145 0 8330 0
[pid=24147] ppid=24143 vsize=137392 CPUtime=3.09 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 78033 0 0 0 299 10 0 0 25 0 1 0 512497088 140689408 17644 33554432000 4194304 4331988 140737424196368 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 34348 17644 175 34 0 32790 0
[pid=24148] ppid=24143 vsize=182312 CPUtime=8.82 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 23924 1254 0 0 879 3 0 0 18 0 5 0 512497088 186687488 18425 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 45578 18425 164 40 0 44122 0
[pid=24148/tid=24155] ppid=24143 vsize=182312 CPUtime=2.85 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 5161 1254 0 0 285 0 0 0 21 0 5 0 512497111 186687488 18425 33554432000 4194304 4356188 140734101522208 18446744073709551615 4232856 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=182312 CPUtime=1.41 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 2201 1254 0 0 141 0 0 0 25 0 5 0 512497111 186687488 18425 33554432000 4194304 4356188 140734101522208 18446744073709551615 4296315 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=182312 CPUtime=2.86 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 4602 1254 0 0 286 0 0 0 25 0 5 0 512497111 186687488 18425 33554432000 4194304 4356188 140734101522208 18446744073709551615 4216142 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=182312 CPUtime=1.44 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 3347 1254 0 0 144 0 0 0 23 0 5 0 512497111 186687488 18425 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 18.09
Current children cumulated vsize (KiB) 460320

[startup+6.30057 s]
/proc/loadavg: 6.84 7.82 7.92 8/179 24158
/proc/meminfo: memFree=15855088/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=114656 CPUtime=6.29 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 19018 0 0 0 626 3 0 0 25 0 1 0 512497088 117407744 15510 33554432000 4194304 4587354 140734785398576 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 28664 15510 333 96 0 25226 0
[pid=24145] ppid=24143 vsize=48848 CPUtime=6.29 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 11928 0 0 0 627 2 0 0 25 0 1 0 512497088 50020352 9377 33554432000 4194304 4785740 140734092605888 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 12212 9377 340 145 0 9257 0
[pid=24147] ppid=24143 vsize=145216 CPUtime=6.28 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 79618 0 0 0 618 10 0 0 25 0 1 0 512497088 148701184 19229 33554432000 4194304 4331988 140737424196368 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 36304 19229 175 34 0 34746 0
[pid=24148] ppid=24143 vsize=187120 CPUtime=18.42 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 25783 1254 0 0 1839 3 0 0 18 0 5 0 512497088 191610880 19715 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 46780 19715 164 40 0 45324 0
[pid=24148/tid=24155] ppid=24143 vsize=187120 CPUtime=6.05 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 5161 1254 0 0 605 0 0 0 25 0 5 0 512497111 191610880 19715 33554432000 4194304 4356188 140734101522208 18446744073709551615 4271296 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=187120 CPUtime=3.01 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 3404 1254 0 0 301 0 0 0 25 0 5 0 512497111 191610880 19715 33554432000 4194304 4356188 140734101522208 18446744073709551615 4216906 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=187120 CPUtime=6.06 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 4602 1254 0 0 606 0 0 0 25 0 5 0 512497111 191610880 19715 33554432000 4194304 4356188 140734101522208 18446744073709551615 4211135 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=187120 CPUtime=3.04 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 4003 1254 0 0 304 0 0 0 25 0 5 0 512497111 191610880 19715 33554432000 4194304 4356188 140734101522208 18446744073709551615 4236956 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37.29
Current children cumulated vsize (KiB) 514164

[startup+12.7004 s]
/proc/loadavg: 6.85 7.81 7.91 8/179 24158
/proc/meminfo: memFree=15849408/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=117564 CPUtime=12.69 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 20578 0 0 0 1266 3 0 0 25 0 1 0 512497088 120385536 17056 33554432000 4194304 4587354 140734785398576 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 29391 17056 338 96 0 25953 0
[pid=24145] ppid=24143 vsize=54568 CPUtime=12.69 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 13308 0 0 0 1267 2 0 0 25 0 1 0 512497088 55877632 10757 33554432000 4194304 4785740 140734092605888 18446744073709551615 4552553 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 13642 10757 340 145 0 10687 0
[pid=24147] ppid=24143 vsize=145964 CPUtime=12.68 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 79794 0 0 0 1258 10 0 0 25 0 1 0 512497088 149467136 19405 33554432000 4194304 4331988 140737424196368 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 36491 19405 175 34 0 34933 0
[pid=24148] ppid=24143 vsize=185544 CPUtime=37.61 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 28024 1254 0 0 3758 3 0 0 18 0 5 0 512497088 189997056 19337 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 46386 19337 164 40 0 44930 0
[pid=24148/tid=24155] ppid=24143 vsize=185544 CPUtime=12.45 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 5161 1254 0 0 1245 0 0 0 25 0 5 0 512497111 189997056 19337 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=185544 CPUtime=6.55 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 4785 1254 0 0 655 0 0 0 25 0 5 0 512497111 189997056 19337 33554432000 4194304 4356188 140734101522208 18446744073709551615 4210615 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=185544 CPUtime=12.05 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 4602 1254 0 0 1205 0 0 0 25 0 5 0 512497111 189997056 19337 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=185544 CPUtime=6.3 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 4863 1254 0 0 630 0 0 0 25 0 5 0 512497111 189997056 19337 33554432000 4194304 4356188 140734101522208 18446744073709551615 4210791 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 75.68
Current children cumulated vsize (KiB) 521964

[startup+25.5011 s]
/proc/loadavg: 6.88 7.77 7.90 8/179 24158
/proc/meminfo: memFree=15838096/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=927296 CPUtime=25.49 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 31989 0 0 0 2544 5 0 0 25 0 1 0 512497088 949551104 19974 33554432000 4194304 4587354 140734785398576 18446744073709551615 4364913 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 231824 19974 336 96 0 228386 0
[pid=24145] ppid=24143 vsize=61184 CPUtime=25.49 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 14913 0 0 0 2546 3 0 0 25 0 1 0 512497088 62652416 12362 33554432000 4194304 4785740 140734092605888 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 15296 12362 340 145 0 12341 0
[pid=24147] ppid=24143 vsize=146492 CPUtime=25.49 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 79935 0 0 0 2538 11 0 0 25 0 1 0 512497088 150007808 19546 33554432000 4194304 4331988 140737424196368 18446744073709551615 4263143 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 36623 19546 175 34 0 35065 0
[pid=24148] ppid=24143 vsize=176016 CPUtime=76.01 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 29318 1254 0 0 7598 3 0 0 18 0 5 0 512497088 180240384 17163 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 44004 17163 164 40 0 42548 0
[pid=24148/tid=24155] ppid=24143 vsize=176016 CPUtime=25.25 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 5161 1254 0 0 2525 0 0 0 25 0 5 0 512497111 180240384 17163 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 33784.5
Current children cumulated vsize (KiB) 1970032

[startup+4902.3 s]
/proc/loadavg: 7.01 7.04 7.03 8/179 24312
/proc/meminfo: memFree=15206220/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=1024608 CPUtime=4902.28 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 677527 0 0 0 489994 234 0 0 25 0 1 0 512497088 1049198592 46239 33554432000 4194304 4587354 140734785398576 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 256152 46239 336 96 0 252714 0
[pid=24145] ppid=24143 vsize=337280 CPUtime=4902.4 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 82149 0 0 0 490205 35 0 0 25 0 1 0 512497088 345374720 79598 33554432000 4194304 4785740 140734092605888 18446744073709551615 4552628 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 84320 79598 340 145 0 81365 0
[pid=24147] ppid=24143 vsize=169696 CPUtime=4902.41 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 84536 0 0 0 490227 14 0 0 25 0 1 0 512497088 173768704 24147 33554432000 4194304 4331988 140737424196368 18446744073709551615 4291516 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 42424 24147 175 34 0 40866 0
[pid=24148] ppid=24143 vsize=398232 CPUtime=19497.1 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 914574 1254 0 0 1949574 132 0 0 18 0 5 0 512497088 407789568 75291 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 99558 75291 164 40 0 98102 0
[pid=24148/tid=24155] ppid=24143 vsize=398232 CPUtime=4902.17 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 257205 1254 0 0 490181 36 0 0 25 0 5 0 512497111 407789568 75291 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=398232 CPUtime=4896.25 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 271174 1254 0 0 489586 39 0 0 25 0 5 0 512497111 407789568 75291 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=398232 CPUtime=4838.89 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 232448 1254 0 0 483855 34 0 0 25 0 5 0 512497111 407789568 75291 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=398232 CPUtime=4859.48 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 145134 1254 0 0 485929 19 0 0 25 0 5 0 512497111 407789568 75291 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 34204.2
Current children cumulated vsize (KiB) 1948140

[startup+4962.3 s]
/proc/loadavg: 7.00 7.03 7.02 8/179 24314
/proc/meminfo: memFree=15167120/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=1024608 CPUtime=4962.29 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 679481 0 0 0 495993 236 0 0 25 0 1 0 512497088 1049198592 48146 33554432000 4194304 4587354 140734785398576 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 256152 48146 336 96 0 252714 0
[pid=24145] ppid=24143 vsize=342396 CPUtime=4962.41 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 83370 0 0 0 496205 36 0 0 25 0 1 0 512497088 350613504 80819 33554432000 4194304 4785740 140734092605888 18446744073709551615 4287249 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 85599 80819 340 145 0 82644 0
[pid=24147] ppid=24143 vsize=169696 CPUtime=4962.41 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 84574 0 0 0 496227 14 0 0 25 0 1 0 512497088 173768704 24185 33554432000 4194304 4331988 140737424196368 18446744073709551615 268272084062 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 42424 24185 175 34 0 40866 0
[pid=24148] ppid=24143 vsize=426904 CPUtime=19736.7 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 930958 1254 0 0 1973539 134 0 0 18 0 5 0 512497088 437149696 82459 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 106726 82459 164 40 0 105270 0
[pid=24148/tid=24155] ppid=24143 vsize=426904 CPUtime=4962.18 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 263349 1254 0 0 496181 37 0 0 25 0 5 0 512497111 437149696 82459 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=426904 CPUtime=4956.25 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 278854 1254 0 0 495585 40 0 0 25 0 5 0 512497111 437149696 82459 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=426904 CPUtime=4898.56 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 233472 1254 0 0 489822 34 0 0 25 0 5 0 512497111 437149696 82459 33554432000 4194304 4356188 140734101522208 18446744073709551615 4332162 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=426904 CPUtime=4919.49 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 146670 1254 0 0 491929 20 0 0 25 0 5 0 512497111 437149696 82459 33554432000 4194304 4356188 140734101522208 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 34623.9
Current children cumulated vsize (KiB) 1981928

[startup+5022.3 s]
/proc/loadavg: 7.00 7.02 7.02 8/179 24316
/proc/meminfo: memFree=15153832/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=1062544 CPUtime=5022.28 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 687377 0 0 0 501990 238 0 0 25 0 1 0 512497088 1088045056 53574 33554432000 4194304 4587354 140734785398576 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 265636 53574 336 96 0 262198 0
[pid=24145] ppid=24143 vsize=350316 CPUtime=5022.4 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 85353 0 0 0 502203 37 0 0 25 0 1 0 512497088 358723584 82802 33554432000 4194304 4785740 140734092605888 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 87579 82802 340 145 0 84624 0
[pid=24147] ppid=24143 vsize=169696 CPUtime=5022.41 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 84611 0 0 0 502227 14 0 0 25 0 1 0 512497088 173768704 24222 33554432000 4194304 4331988 140737424196368 18446744073709551615 4263264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 42424 24222 175 34 0 40866 0
[pid=24148] ppid=24143 vsize=411544 CPUtime=19976.4 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 934798 1254 0 0 1997507 135 0 0 18 0 5 0 512497088 421421056 78619 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 102886 78619 164 40 0 101430 0
[pid=24148/tid=24155] ppid=24143 vsize=411544 CPUtime=5022.18 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 263861 1254 0 0 502181 37 0 0 25 0 5 0 512497111 421421056 78619 33554432000 4194304 4356188 140734101522208 18446744073709551615 4279551 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=411544 CPUtime=5016.26 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 279878 1254 0 0 501585 41 0 0 25 0 5 0 512497111 421421056 78619 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=411544 CPUtime=4958.23 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 235008 1254 0 0 495789 34 0 0 25 0 5 0 512497111 421421056 78619 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=411544 CPUtime=4979.49 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 147438 1254 0 0 497929 20 0 0 25 0 5 0 512497111 421421056 78619 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 35043.5
Current children cumulated vsize (KiB) 2012424

[startup+5082.3 s]
/proc/loadavg: 7.00 7.02 7.01 8/179 24317
/proc/meminfo: memFree=15188912/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=1013828 CPUtime=5082.29 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 689951 0 0 0 507988 241 0 0 25 0 1 0 512497088 1038159872 46239 33554432000 4194304 4587354 140734785398576 18446744073709551615 4248794 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 253457 46239 336 96 0 250019 0
[pid=24145] ppid=24143 vsize=353920 CPUtime=5082.4 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 86095 0 0 0 508203 37 0 0 25 0 1 0 512497088 362414080 83544 33554432000 4194304 4785740 140734092605888 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 88480 83544 340 145 0 85525 0
[pid=24147] ppid=24143 vsize=169696 CPUtime=5082.41 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 84642 0 0 0 508227 14 0 0 25 0 1 0 512497088 173768704 24253 33554432000 4194304 4331988 140737424196368 18446744073709551615 268272084153 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 42424 24253 175 34 0 40866 0
[pid=24148] ppid=24143 vsize=398228 CPUtime=20216.1 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 947822 1254 0 0 2021473 136 0 0 18 0 5 0 512497088 407785472 75770 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 99557 75770 164 40 0 98101 0
[pid=24148/tid=24155] ppid=24143 vsize=398228 CPUtime=5082.18 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 265909 1254 0 0 508181 37 0 0 25 0 5 0 512497111 407785472 75770 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=398228 CPUtime=5076.26 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 281414 1254 0 0 507585 41 0 0 25 0 5 0 512497111 407785472 75770 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=398228 CPUtime=5017.9 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 241920 1254 0 0 501755 35 0 0 25 0 5 0 512497111 407785472 75770 33554432000 4194304 4356188 140734101522208 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=398228 CPUtime=5039.49 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 149966 1254 0 0 503929 20 0 0 25 0 5 0 512497111 407785472 75770 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 35463.2
Current children cumulated vsize (KiB) 1953996



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 7.00 7.01 7.01 8/179 24318
/proc/meminfo: memFree=15211728/32950928 swapFree=67111528/67111528
[pid=24143] ppid=24141 vsize=18324 CPUtime=0.01 cores=0-7
/proc/24143/stat : 24143 (ppfolio) S 24141 24143 24117 0 -1 4202496 522 1193 0 0 0 0 0 1 15 0 1 0 512497088 18763776 391 33554432000 4194304 4287625 140734038788448 18446744073709551615 268272709135 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/24143/statm: 4581 391 342 23 0 91 0
[pid=24144] ppid=24143 vsize=1013828 CPUtime=5100 cores=0
/proc/24144/stat : 24144 (cryptominisat) R 24143 24143 24117 0 -1 4202496 689951 0 0 0 509759 241 0 0 25 0 1 0 512497088 1038159872 46239 33554432000 4194304 4587354 140734785398576 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24144/statm: 253457 46239 336 96 0 250019 0
[pid=24145] ppid=24143 vsize=353920 CPUtime=5100.11 cores=1
/proc/24145/stat : 24145 (clasp) R 24143 24143 24117 0 -1 4202496 86095 0 0 0 509974 37 0 0 25 0 1 0 512497088 362414080 83544 33554432000 4194304 4785740 140734092605888 18446744073709551615 4562722 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24145/statm: 88480 83544 340 145 0 85525 0
[pid=24147] ppid=24143 vsize=169696 CPUtime=5100.12 cores=3
/proc/24147/stat : 24147 (march_hi) R 24143 24143 24117 0 -1 4202496 84654 0 0 0 509998 14 0 0 25 0 1 0 512497088 173768704 24265 33554432000 4194304 4331988 140737424196368 18446744073709551615 4237171 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24147/statm: 42424 24265 175 34 0 40866 0
[pid=24148] ppid=24143 vsize=376724 CPUtime=20286.8 cores=4-7
/proc/24148/stat : 24148 (plingeling) S 24143 24143 24117 0 -1 4202496 948846 1254 0 0 2028545 137 0 0 18 0 5 0 512497088 385765376 70170 33554432000 4194304 4356188 140734101522208 18446744073709551615 268284491749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/24148/statm: 94181 70170 164 40 0 92725 0
[pid=24148/tid=24155] ppid=24143 vsize=376724 CPUtime=5099.88 cores=4-7
/proc/24148/task/24155/stat : 24155 (plingeling) R 24143 24143 24117 0 -1 4202560 266421 1254 0 0 509951 37 0 0 25 0 5 0 512497111 385765376 70170 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331309 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24148/tid=24156] ppid=24143 vsize=376724 CPUtime=5093.97 cores=4-7
/proc/24148/task/24156/stat : 24156 (plingeling) R 24143 24143 24117 0 -1 4202560 281926 1254 0 0 509356 41 0 0 25 0 5 0 512497111 385765376 70170 33554432000 4194304 4356188 140734101522208 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24148/tid=24157] ppid=24143 vsize=376724 CPUtime=5035.51 cores=4-7
/proc/24148/task/24157/stat : 24157 (plingeling) R 24143 24143 24117 0 -1 4202560 241920 1254 0 0 503516 35 0 0 25 0 5 0 512497111 385765376 70170 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24148/tid=24158] ppid=24143 vsize=376724 CPUtime=5057.19 cores=4-7
/proc/24148/task/24158/stat : 24158 (plingeling) R 24143 24143 24117 0 -1 4202560 149966 1254 0 0 505699 20 0 0 25 0 5 0 512497111 385765376 70170 33554432000 4194304 4356188 140734101522208 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 35587.1
Current children cumulated vsize (KiB) 1932492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24143 and gives
#  childrusage.ru_utime.tv_sec=10197
#  childrusage.ru_utime.tv_usec=574733
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=592605
# CPU time returned by wait4() is 10200.2
# while last known CPU time is 35587.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 35587.1
CPU user time (s): 35582.8
CPU system time (s): 4.3
CPU usage (%): 697.783
Max. virtual memory (cumulated for all children) (KiB): 2834180

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10197.6
system time used= 2.5926
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 776320
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 611
involuntary context switches= 78131

runsolver used 8.72367 second user time and 19.1021 second system time

The end

Launcher Data 

Begin job on node122 at 2011-04-28 18:43:03
IDJOB=3310309
IDBENCH=83114
IDSOLVER=1638
FILE ID=node122/3310309-1304008983
RUNJOBID= node122-1304008983-24131
PBS_JOBID= 13168847
Free space on /tmp= 71664 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top23.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310309-1304008983/watcher-3310309-1304008983 -o /tmp/evaluation-result-3310309-1304008983/solver-3310309-1304008983 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310309-1304008983.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6ee28191d649bfeef8c7d8c569a3cd59
RANDOM SEED=1464454714

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16109476 kB
Buffers:       1730128 kB
Cached:       14480124 kB
SwapCached:          0 kB
Active:        5275872 kB
Inactive:     10998860 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16109476 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           13376 kB
Writeback:           0 kB
AnonPages:       64408 kB
Mapped:          14524 kB
Slab:           501004 kB
PageTables:       4244 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   185524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71648 MiB
End job on node122 at 2011-04-28 20:08:05