Trace number 3362270

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 20397.8 5100.02

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_2_keyfind_1.cnf
MD5SUM19e0b91e7d093f7cb35b11b46708a49b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses20544
Sum of the clauses size111944
Maximum clause length8
Minimum clause length1
Number of clauses of size 1272
Number of clauses of size 2256
Number of clauses of size 33520
Number of clauses of size 4640
Number of clauses of size 54096
Number of clauses of size over 511760

Solver Data 

0.00/0.00	c Parsing...
0.00/0.01	c ==============================================================================
0.00/0.01	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.01	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.01	c ==============================================================================
0.00/0.01	c |         0 |   20208   111352 |    6062       0        0     nan |  0.000 % |
0.00/0.01	c |         0 |   19440   108792 |      --       0       --      -- |     --   | -256/-512
0.00/0.01	c ==============================================================================
0.00/0.01	c Result  :   #vars: 1600   #clauses: 19440   #literals: 108792
0.00/0.01	c CPU time:   0.014997 s
0.00/0.01	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362270-1305302128/watcher-3362270-1305302128 -o /tmp/evaluation-result-3362270-1305302128/solver-3362270-1305302128 -C 40000 -W 5100 -M 31000 manysat.sh HOME/instance-3362270-1305302128.cnf aimd 1 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.80 3.95 3.91 2/309 2095
/proc/meminfo: memFree=8898384/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 330 0 0 0 0 0 0 0 22 0 1 0 374404086 8908800 250 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/2095/statm: 2175 250 209 178 0 68 0

[startup+0.0505279 s]
/proc/loadavg: 3.80 3.95 3.91 2/309 2095
/proc/meminfo: memFree=8898384/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+0.100961 s]
/proc/loadavg: 3.80 3.95 3.91 2/309 2095
/proc/meminfo: memFree=8898384/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+0.300471 s]
/proc/loadavg: 3.80 3.95 3.91 2/309 2095
/proc/meminfo: memFree=8898384/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+0.700399 s]
/proc/loadavg: 3.80 3.95 3.91 2/309 2095
/proc/meminfo: memFree=8898384/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+1.50026 s]
/proc/loadavg: 3.80 3.95 3.91 5/314 2101
/proc/meminfo: memFree=8874908/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=57716 CPUtime=5.71 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 6160 0 0 0 564 7 0 0 18 0 4 0 374404090 59101184 6110 33554432000 134512640 135305190 4291050896 18446744073709551615 134546754 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 14429 6110 84 194 0 14233 0
[pid=2098/tid=2099] ppid=2095 vsize=57716 CPUtime=1.41 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 909 0 0 0 140 1 0 0 18 0 4 0 374404093 59101184 6110 33554432000 134512640 135305190 4291050896 18446744073709551615 134531165 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=57716 CPUtime=1.41 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 1058 0 0 0 140 1 0 0 18 0 4 0 374404093 59101184 6110 33554432000 134512640 135305190 4291050896 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=57716 CPUtime=1.4 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 1267 0 0 0 139 1 0 0 18 0 4 0 374404093 59101184 6110 33554432000 134512640 135305190 4291050896 18446744073709551615 134528525 0 0 4096 3 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.74
Current children cumulated vsize (KiB) 66416

[startup+3.10098 s]
/proc/loadavg: 3.80 3.95 3.91 5/314 2101
/proc/meminfo: memFree=8868032/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=67484 CPUtime=12.09 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 8595 0 0 0 1200 9 0 0 18 0 4 0 374404090 69103616 8545 33554432000 134512640 135305190 4291050896 18446744073709551615 134528747 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 16871 8545 84 194 0 16675 0
[pid=2098/tid=2099] ppid=2095 vsize=67484 CPUtime=3.02 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 1364 0 0 0 300 2 0 0 21 0 4 0 374404093 69103616 8545 33554432000 134512640 135305190 4291050896 18446744073709551615 134528480 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=67484 CPUtime=3 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 1703 0 0 0 299 1 0 0 18 0 4 0 374404093 69103616 8545 33554432000 134512640 135305190 4291050896 18446744073709551615 134528280 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=67484 CPUtime=2.99 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 1921 0 0 0 297 2 0 0 18 0 4 0 374404093 69103616 8545 33554432000 134512640 135305190 4291050896 18446744073709551615 134528771 0 0 4096 3 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.12
Current children cumulated vsize (KiB) 76184

[startup+6.30043 s]
/proc/loadavg: 3.82 3.95 3.91 5/314 2101
/proc/meminfo: memFree=8854260/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=79104 CPUtime=24.85 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 11305 0 0 0 2472 13 0 0 18 0 4 0 374404090 81002496 11255 33554432000 134512640 135305190 4291050896 18446744073709551615 134528503 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 19776 11255 84 194 0 19580 0
[pid=2098/tid=2099] ppid=2095 vsize=79104 CPUtime=6.21 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 2052 0 0 0 618 3 0 0 20 0 4 0 374404093 81002496 11255 33554432000 134512640 135305190 4291050896 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=79104 CPUtime=6.2 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 2463 0 0 0 618 2 0 0 18 0 4 0 374404093 81002496 11255 33554432000 134512640 135305190 4291050896 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=79104 CPUtime=6.19 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 2587 0 0 0 615 4 0 0 18 0 4 0 374404093 81002496 11255 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.88
Current children cumulated vsize (KiB) 87804

[startup+12.7003 s]
/proc/loadavg: 3.83 3.95 3.91 5/314 2101
/proc/meminfo: memFree=8833404/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=99748 CPUtime=50.4 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 16593 0 0 0 5022 18 0 0 18 0 4 0 374404090 102141952 16543 33554432000 134512640 135305190 4291050896 18446744073709551615 134528410 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 24937 16543 84 194 0 24741 0
[pid=2098/tid=2099] ppid=2095 vsize=99748 CPUtime=12.59 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 3297 0 0 0 1256 3 0 0 25 0 4 0 374404093 102141952 16543 33554432000 134512640 135305190 4291050896 18446744073709551615 134528446 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=99748 CPUtime=12.59 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 3695 0 0 0 1256 3 0 0 18 0 4 0 374404093 102141952 16543 33554432000 134512640 135305190 4291050896 18446744073709551615 134553376 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=99748 CPUtime=12.57 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 3846 0 0 0 1251 6 0 0 18 0 4 0 374404093 102141952 16543 33554432000 134512640 135305190 4291050896 18446744073709551615 134557927 0 0 4096 3 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.43
Current children cumulated vsize (KiB) 108448

[startup+25.501 s]
/proc/loadavg: 3.87 3.95 3.91 5/314 2105
/proc/meminfo: memFree=8819940/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=114284 CPUtime=101.5 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 20033 0 0 0 10127 23 0 0 18 0 4 0 374404090 117026816 19983 33554432000 134512640 135305190 4291050896 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 28571 19983 84 194 0 28375 0
[pid=2098/tid=2099] ppid=2095 vsize=114284 CPUtime=25.37 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 3959 0 0 0 2533 4 0 0 18 0 4 0 374404093 117026816 19983 33554432000 134512640 135305190 4291050896 18446744073709551615 134528392 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=114284 CPUtime=25.37 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 4727 0 0 0 2533 4 0 0 18 0 4 0 374404093 117026816 19983 33554432000 134512640 135305190 4291050896 18446744073709551615 134528562 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=114284 CPUtime=25.34 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 4730 0 0 0 2527 7 0 0 18 0 4 0 374404093 117026816 19983 33554432000 134512640 135305190 4291050896 18446744073709551615 134528329 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.53
Current children cumulated vsize (KiB) 122984

[startup+51.1005 s]
/proc/loadavg: 3.91 3.95 3.91 5/314 2105
/proc/meminfo: memFree=8794808/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=140860 CPUtime=203.84 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 26794 0 0 0 20355 29 0 0 18 0 4 0 374404090 144240640 26744 33554432000 134512640 135305190 4291050896 18446744073709551615 134528503 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 35215 26744 84 194 0 35019 0
[pid=2098/tid=2099] ppid=2095 vsize=140860 CPUtime=50.96 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 5417 0 0 0 5091 5 0 0 25 0 4 0 374404093 144240640 26744 33554432000 134512640 135305190 4291050896 18446744073709551615 134528224 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=140860 CPUtime=50.95 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 7082 0 0 0 5090 5 0 0 18 0 4 0 374404093 144240640 26744 33554432000 134512640 135305190 4291050896 18446744073709551615 134528406 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=140860 CPUtime=50.93 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 5921 0 0 0 5083 10 0 0 18 0 4 0 374404093 144240640 26744 33554432000 134512640 135305190 4291050896 18446744073709551615 134528415 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.87
Current children cumulated vsize (KiB) 149560

[startup+102.312 s]
/proc/loadavg: 3.96 3.96 3.91 5/314 2107
/proc/meminfo: memFree=8755188/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=180472 CPUtime=408.58 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 36068 0 0 0 40821 37 0 0 18 0 4 0 374404090 184803328 36018 33554432000 134512640 135305190 4291050896 18446744073709551615 134528341 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 45118 36018 84 194 0 44922 0
[pid=2098/tid=2099] ppid=2095 vsize=180472 CPUtime=102.15 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 7283 0 0 0 10209 6 0 0 25 0 4 0 374404093 184803328 36018 33554432000 134512640 135305190 4291050896 18446744073709551615 134528327 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=180472 CPUtime=102.14 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 10795 0 0 0 10207 7 0 0 22 0 4 0 374404093 184803328 36018 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=180472 CPUtime=102.11 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 7709 0 0 0 10197 14 0 0 19 0 4 0 374404093 184803328 36018 33554432000 134512640 135305190 4291050896 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 408.61
Current children cumulated vsize (KiB) 189172

[startup+162.301 s]
/proc/loadavg: 3.98 3.97 3.91 5/314 2108
/proc/meminfo: memFree=8723896/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=210996 CPUtime=648.49 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 43904 0 0 0 64805 44 0 0 19 0 4 0 374404090 216059904 43854 33554432000 134512640 135305190 4291050896 18446744073709551615 134528477 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 52749 43854 84 194 0 52553 0
[pid=2098/tid=2099] ppid=2095 vsize=210996 CPUtime=162.12 cores=0-7

################
# More data... #
################

/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 32189 0 0 0 466127 54 0 0 25 0 4 0 374404093 942555136 215871 33554432000 134512640 135305190 4291050896 18446744073709551615 134528571 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18647.1
Current children cumulated vsize (KiB) 929164

[startup+4722.31 s]
/proc/loadavg: 4.00 4.00 3.96 5/314 2251
/proc/meminfo: memFree=8017520/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=938772 CPUtime=18887.1 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 220283 0 0 0 1888481 226 0 0 20 0 4 0 374404090 961302528 220056 33554432000 134512640 135305190 4291050896 18446744073709551615 134528274 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 234693 220056 84 194 0 234497 0
[pid=2098/tid=2099] ppid=2095 vsize=938772 CPUtime=4721.83 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 29790 0 0 0 472154 29 0 0 25 0 4 0 374404093 961302528 220056 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=938772 CPUtime=4721.46 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 122532 0 0 0 472043 103 0 0 19 0 4 0 374404093 961302528 220056 33554432000 134512640 135305190 4291050896 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=938772 CPUtime=4721.82 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 32699 0 0 0 472128 54 0 0 25 0 4 0 374404093 961302528 220056 33554432000 134512640 135305190 4291050896 18446744073709551615 134547909 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 18887.1
Current children cumulated vsize (KiB) 947472

[startup+4782.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/314 2253
/proc/meminfo: memFree=8000012/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=958416 CPUtime=19127 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 224666 0 0 0 1912473 229 0 0 25 0 4 0 374404090 981417984 224439 33554432000 134512640 135305190 4291050896 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 239604 224439 84 194 0 239408 0
[pid=2098/tid=2099] ppid=2095 vsize=958416 CPUtime=4781.82 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 30373 0 0 0 478152 30 0 0 25 0 4 0 374404093 981417984 224439 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=958416 CPUtime=4781.45 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 124956 0 0 0 478040 105 0 0 24 0 4 0 374404093 981417984 224439 33554432000 134512640 135305190 4291050896 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=958416 CPUtime=4781.82 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 33446 0 0 0 478127 55 0 0 25 0 4 0 374404093 981417984 224439 33554432000 134512640 135305190 4291050896 18446744073709551615 134528536 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19127
Current children cumulated vsize (KiB) 967116

[startup+4842.3 s]
/proc/loadavg: 4.05 4.01 3.97 5/314 2254
/proc/meminfo: memFree=7987104/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=970872 CPUtime=19367 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 227801 0 0 0 1936470 233 0 0 25 0 4 0 374404090 994172928 227574 33554432000 134512640 135305190 4291050896 18446744073709551615 134528256 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 242718 227574 84 194 0 242522 0
[pid=2098/tid=2099] ppid=2095 vsize=970872 CPUtime=4841.83 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 30877 0 0 0 484152 31 0 0 25 0 4 0 374404093 994172928 227574 33554432000 134512640 135305190 4291050896 18446744073709551615 134528415 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=970872 CPUtime=4841.45 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 126620 0 0 0 484038 107 0 0 25 0 4 0 374404093 994172928 227574 33554432000 134512640 135305190 4291050896 18446744073709551615 134555240 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=970872 CPUtime=4841.81 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 34038 0 0 0 484126 55 0 0 19 0 4 0 374404093 994172928 227574 33554432000 134512640 135305190 4291050896 18446744073709551615 134528256 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19367.1
Current children cumulated vsize (KiB) 979572

[startup+4902.3 s]
/proc/loadavg: 4.02 4.01 3.97 5/314 2256
/proc/meminfo: memFree=7971836/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=985852 CPUtime=19607 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 231619 0 0 0 1960460 237 0 0 25 0 4 0 374404090 1009512448 231392 33554432000 134512640 135305190 4291050896 18446744073709551615 134528376 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 246463 231392 84 194 0 246267 0
[pid=2098/tid=2099] ppid=2095 vsize=985852 CPUtime=4901.82 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 31234 0 0 0 490151 31 0 0 25 0 4 0 374404093 1009512448 231392 33554432000 134512640 135305190 4291050896 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=985852 CPUtime=4901.44 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 129321 0 0 0 490035 109 0 0 20 0 4 0 374404093 1009512448 231392 33554432000 134512640 135305190 4291050896 18446744073709551615 134541978 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=985852 CPUtime=4901.77 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 34379 0 0 0 490120 57 0 0 25 0 4 0 374404093 1009512448 231392 33554432000 134512640 135305190 4291050896 18446744073709551615 134547670 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19607
Current children cumulated vsize (KiB) 994552

[startup+4962.3 s]
/proc/loadavg: 4.00 4.00 3.97 5/314 2257
/proc/meminfo: memFree=7969216/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=990296 CPUtime=19847 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 232218 0 0 0 1984459 238 0 0 25 0 4 0 374404090 1014063104 231991 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 247574 231991 84 194 0 247378 0
[pid=2098/tid=2099] ppid=2095 vsize=990296 CPUtime=4961.83 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 31496 0 0 0 496151 32 0 0 25 0 4 0 374404093 1014063104 231991 33554432000 134512640 135305190 4291050896 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=990296 CPUtime=4961.43 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 129365 0 0 0 496033 110 0 0 18 0 4 0 374404093 1014063104 231991 33554432000 134512640 135305190 4291050896 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=990296 CPUtime=4961.77 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 34379 0 0 0 496120 57 0 0 25 0 4 0 374404093 1014063104 231991 33554432000 134512640 135305190 4291050896 18446744073709551615 134528520 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19847
Current children cumulated vsize (KiB) 998996

[startup+5022.3 s]
/proc/loadavg: 4.00 4.00 3.97 5/314 2259
/proc/meminfo: memFree=7966356/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=993264 CPUtime=20087 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 232974 0 0 0 2008458 239 0 0 25 0 4 0 374404090 1017102336 232747 33554432000 134512640 135305190 4291050896 18446744073709551615 134528480 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 248316 232747 84 194 0 248120 0
[pid=2098/tid=2099] ppid=2095 vsize=993264 CPUtime=5021.83 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 31732 0 0 0 502151 32 0 0 25 0 4 0 374404093 1017102336 232747 33554432000 134512640 135305190 4291050896 18446744073709551615 134528248 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=993264 CPUtime=5021.43 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 129448 0 0 0 502033 110 0 0 19 0 4 0 374404093 1017102336 232747 33554432000 134512640 135305190 4291050896 18446744073709551615 134528392 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=993264 CPUtime=5021.77 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 34379 0 0 0 502120 57 0 0 25 0 4 0 374404093 1017102336 232747 33554432000 134512640 135305190 4291050896 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20087
Current children cumulated vsize (KiB) 1001964

[startup+5082.3 s]
/proc/loadavg: 4.00 4.00 3.97 5/314 2261
/proc/meminfo: memFree=7963732/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=995780 CPUtime=20327 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 233629 0 0 0 2032458 239 0 0 25 0 4 0 374404090 1019678720 233402 33554432000 134512640 135305190 4291050896 18446744073709551615 134528376 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 248945 233402 84 194 0 248749 0
[pid=2098/tid=2099] ppid=2095 vsize=995780 CPUtime=5081.83 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 31979 0 0 0 508151 32 0 0 25 0 4 0 374404093 1019678720 233402 33554432000 134512640 135305190 4291050896 18446744073709551615 134528254 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=995780 CPUtime=5081.42 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 129458 0 0 0 508032 110 0 0 25 0 4 0 374404093 1019678720 233402 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=995780 CPUtime=5081.77 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 34379 0 0 0 508120 57 0 0 25 0 4 0 374404093 1019678720 233402 33554432000 134512640 135305190 4291050896 18446744073709551615 134528562 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20327
Current children cumulated vsize (KiB) 1004480



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 4.00 4.00 3.97 5/314 2261
/proc/meminfo: memFree=7962368/32951124 swapFree=46575252/67111528
[pid=2095] ppid=2093 vsize=8700 CPUtime=0.03 cores=0-7
/proc/2095/stat : 2095 (manysat.sh) S 2093 2095 1806 0 -1 4202496 357 757 0 0 0 0 3 0 22 0 1 0 374404086 8908800 253 33554432000 4194304 4922060 140735662268960 18446744073709551615 268660481157 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/2095/statm: 2175 253 209 178 0 68 0
[pid=2098] ppid=2095 vsize=997164 CPUtime=20397.8 cores=0-7
/proc/2098/stat : 2098 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202496 233941 0 0 0 2039539 239 0 0 25 0 4 0 374404090 1021095936 233714 33554432000 134512640 135305190 4291050896 18446744073709551615 134547978 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/2098/statm: 249291 233714 84 194 0 249095 0
[pid=2098/tid=2099] ppid=2095 vsize=997164 CPUtime=5099.54 cores=0-7
/proc/2098/task/2099/stat : 2099 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 32154 0 0 0 509922 32 0 0 25 0 4 0 374404093 1021095936 233714 33554432000 134512640 135305190 4291050896 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=2098/tid=2100] ppid=2095 vsize=997164 CPUtime=5099.13 cores=0-7
/proc/2098/task/2100/stat : 2100 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 129477 0 0 0 509803 110 0 0 18 0 4 0 374404093 1021095936 233714 33554432000 134512640 135305190 4291050896 18446744073709551615 134538175 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=2098/tid=2101] ppid=2095 vsize=997164 CPUtime=5099.48 cores=0-7
/proc/2098/task/2101/stat : 2101 (manysat1.1_stat) R 2095 2095 1806 0 -1 4202560 34379 0 0 0 509891 57 0 0 25 0 4 0 374404093 1021095936 233714 33554432000 134512640 135305190 4291050896 18446744073709551615 134528392 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20397.8
Current children cumulated vsize (KiB) 1005864

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2095 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=32994
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=5999
# CPU time returned by wait4() is 0.038993
# while last known CPU time is 20397.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 20397.8
CPU user time (s): 20395.4
CPU system time (s): 2.39
CPU usage (%): 399.955
Max. virtual memory (cumulated for all children) (KiB): 1005864

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.032994
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1114
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 4

runsolver used 14.8087 second user time and 36.2065 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-13 17:55:28
IDJOB=3362270
IDBENCH=83410
IDSOLVER=1839
FILE ID=node107/3362270-1305302128
RUNJOBID= node107-1305296396-1820
PBS_JOBID= 13321446
Free space on /tmp= 41280 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_2_keyfind_1.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362270-1305302128/watcher-3362270-1305302128 -o /tmp/evaluation-result-3362270-1305302128/solver-3362270-1305302128 -C 40000 -W 5100 -M 31000  manysat.sh HOME/instance-3362270-1305302128.cnf aimd 1

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 19e0b91e7d093f7cb35b11b46708a49b
RANDOM SEED=1787235454

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8898788 kB
Buffers:        266240 kB
Cached:       18841200 kB
SwapCached:      10016 kB
Active:        6711484 kB
Inactive:     16678772 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8898788 kB
SwapTotal:    67111528 kB
SwapFree:     46575252 kB
Dirty:            1940 kB
Writeback:          12 kB
AnonPages:     4280560 kB
Mapped:          18964 kB
Slab:           527784 kB
PageTables:      68676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 64909164 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 41276 MiB
End job on node107 at 2011-05-13 19:20:30