Trace number 3362268

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 20396.4 5100.02

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_3_keyfind_1.cnf
MD5SUMff59ad0e88befc51bfa041e45143dc53
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2808
Number of clauses30432
Sum of the clauses size167020
Maximum clause length8
Minimum clause length1
Number of clauses of size 1280
Number of clauses of size 2384
Number of clauses of size 35024
Number of clauses of size 4960
Number of clauses of size 56144
Number of clauses of size over 517640

Solver Data 

0.00/0.00	c Parsing...
0.00/0.02	c ==============================================================================
0.00/0.02	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.02	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.02	c ==============================================================================
0.00/0.02	c |         0 |   30056   166260 |    9016       0        0     nan |  0.000 % |
0.00/0.02	c |         0 |   29288   163700 |      --       0       --      -- |     --   | -256/-512
0.00/0.02	c ==============================================================================
0.00/0.02	c Result  :   #vars: 2400   #clauses: 29288   #literals: 163700
0.00/0.02	c CPU time:   0.023996 s
0.00/0.02	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362268-1305301837/watcher-3362268-1305301837 -o /tmp/evaluation-result-3362268-1305301837/solver-3362268-1305301837 -C 40000 -W 5100 -M 31000 manysat.sh HOME/instance-3362268-1305301837.cnf aimd 1 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.93 3.90 2/284 31291
/proc/meminfo: memFree=10574756/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 330 0 0 0 0 0 0 0 25 0 1 0 641786469 8908800 250 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31291/statm: 2175 250 209 178 0 68 0

[startup+0.0955601 s]
/proc/loadavg: 3.68 3.93 3.90 2/284 31291
/proc/meminfo: memFree=10574756/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 8700

[startup+0.100577 s]
/proc/loadavg: 3.68 3.93 3.90 2/284 31291
/proc/meminfo: memFree=10574756/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 8700

[startup+0.300542 s]
/proc/loadavg: 3.68 3.93 3.90 2/284 31291
/proc/meminfo: memFree=10574756/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 8700

[startup+0.704459 s]
/proc/loadavg: 3.68 3.93 3.90 2/284 31291
/proc/meminfo: memFree=10574756/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 8700

[startup+1.5003 s]
/proc/loadavg: 3.68 3.93 3.90 5/289 31298
/proc/meminfo: memFree=10547188/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=63104 CPUtime=5.54 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 7667 0 0 0 547 7 0 0 18 0 4 0 641786475 64618496 7616 33554432000 134512640 135305190 4288370448 18446744073709551615 134839991 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 15776 7616 84 194 0 15580 0
[pid=31294/tid=31295] ppid=31291 vsize=63104 CPUtime=1.37 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 1109 0 0 0 136 1 0 0 18 0 4 0 641786479 64618496 7616 33554432000 134512640 135305190 4288370448 18446744073709551615 134528408 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=63104 CPUtime=1.36 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 1253 0 0 0 135 1 0 0 18 0 4 0 641786479 64618496 7616 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=63104 CPUtime=1.37 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 1413 0 0 0 136 1 0 0 18 0 4 0 641786479 64618496 7616 33554432000 134512640 135305190 4288370448 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.59
Current children cumulated vsize (KiB) 71804

[startup+3.10102 s]
/proc/loadavg: 3.68 3.93 3.90 5/289 31298
/proc/meminfo: memFree=10540616/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=71964 CPUtime=11.92 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 9799 0 0 0 1180 12 0 0 18 0 4 0 641786475 73691136 9748 33554432000 134512640 135305190 4288370448 18446744073709551615 134528329 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 17991 9748 84 194 0 17795 0
[pid=31294/tid=31295] ppid=31291 vsize=71964 CPUtime=2.97 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 1491 0 0 0 295 2 0 0 18 0 4 0 641786479 73691136 9748 33554432000 134512640 135305190 4288370448 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=71964 CPUtime=2.95 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 1930 0 0 0 293 2 0 0 18 0 4 0 641786479 73691136 9748 33554432000 134512640 135305190 4288370448 18446744073709551615 134561671 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=71964 CPUtime=2.97 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 1960 0 0 0 293 4 0 0 18 0 4 0 641786479 73691136 9748 33554432000 134512640 135305190 4288370448 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.97
Current children cumulated vsize (KiB) 80664

[startup+6.30045 s]
/proc/loadavg: 3.70 3.93 3.90 5/289 31298
/proc/meminfo: memFree=10526376/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=83380 CPUtime=24.68 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 12455 0 0 0 2452 16 0 0 18 0 4 0 641786475 85381120 12404 33554432000 134512640 135305190 4288370448 18446744073709551615 134528332 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 20845 12404 84 194 0 20649 0
[pid=31294/tid=31295] ppid=31291 vsize=83380 CPUtime=6.16 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 2060 0 0 0 614 2 0 0 18 0 4 0 641786479 85381120 12404 33554432000 134512640 135305190 4288370448 18446744073709551615 134528329 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=83380 CPUtime=6.15 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 2603 0 0 0 611 4 0 0 19 0 4 0 641786479 85381120 12404 33554432000 134512640 135305190 4288370448 18446744073709551615 134528571 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=83380 CPUtime=6.16 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 2581 0 0 0 611 5 0 0 18 0 4 0 641786479 85381120 12404 33554432000 134512640 135305190 4288370448 18446744073709551615 134547909 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.73
Current children cumulated vsize (KiB) 92080

[startup+12.7003 s]
/proc/loadavg: 3.73 3.94 3.90 5/289 31298
/proc/meminfo: memFree=10509420/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=99936 CPUtime=50.24 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 16612 0 0 0 5000 24 0 0 18 0 4 0 641786475 102334464 16561 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 24984 16561 84 194 0 24788 0
[pid=31294/tid=31295] ppid=31291 vsize=99936 CPUtime=12.55 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 3073 0 0 0 1251 4 0 0 18 0 4 0 641786479 102334464 16561 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=99936 CPUtime=12.53 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 3569 0 0 0 1247 6 0 0 18 0 4 0 641786479 102334464 16561 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=99936 CPUtime=12.55 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 3572 0 0 0 1248 7 0 0 18 0 4 0 641786479 102334464 16561 33554432000 134512640 135305190 4288370448 18446744073709551615 134528392 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.29
Current children cumulated vsize (KiB) 108636

[startup+25.5011 s]
/proc/loadavg: 3.95 3.97 3.92 5/289 31298
/proc/meminfo: memFree=10490096/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=119516 CPUtime=101.31 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 21484 0 0 0 10096 35 0 0 20 0 4 0 641786475 122384384 21433 33554432000 134512640 135305190 4288370448 18446744073709551615 134557259 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 29879 21433 84 194 0 29683 0
[pid=31294/tid=31295] ppid=31291 vsize=119516 CPUtime=25.33 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 4275 0 0 0 2526 7 0 0 18 0 4 0 641786479 122384384 21433 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=119516 CPUtime=25.31 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 5360 0 0 0 2521 10 0 0 20 0 4 0 641786479 122384384 21433 33554432000 134512640 135305190 4288370448 18446744073709551615 134528415 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=119516 CPUtime=25.32 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 4553 0 0 0 2523 9 0 0 18 0 4 0 641786479 122384384 21433 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.36
Current children cumulated vsize (KiB) 128216

[startup+51.1005 s]
/proc/loadavg: 3.96 3.97 3.92 5/289 31299
/proc/meminfo: memFree=10467016/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=143168 CPUtime=203.58 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 27473 0 0 0 20311 47 0 0 21 0 4 0 641786475 146604032 27422 33554432000 134512640 135305190 4288370448 18446744073709551615 134528406 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 35792 27422 84 194 0 35596 0
[pid=31294/tid=31295] ppid=31291 vsize=143168 CPUtime=50.89 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 5768 0 0 0 5080 9 0 0 18 0 4 0 641786479 146604032 27422 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=143168 CPUtime=50.89 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 7608 0 0 0 5075 14 0 0 18 0 4 0 641786479 146604032 27422 33554432000 134512640 135305190 4288370448 18446744073709551615 134541974 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=143168 CPUtime=50.87 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 5438 0 0 0 5076 11 0 0 18 0 4 0 641786479 146604032 27422 33554432000 134512640 135305190 4288370448 18446744073709551615 134561695 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.63
Current children cumulated vsize (KiB) 151868

[startup+102.31 s]
/proc/loadavg: 3.98 3.97 3.92 5/289 31300
/proc/meminfo: memFree=10430532/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=178452 CPUtime=408.23 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 36161 0 0 0 40760 63 0 0 25 0 4 0 641786475 182734848 36110 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 44613 36110 84 194 0 44417 0
[pid=31294/tid=31295] ppid=31291 vsize=178452 CPUtime=102.02 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 7584 0 0 0 10190 12 0 0 19 0 4 0 641786479 182734848 36110 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=178452 CPUtime=102.07 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 10386 0 0 0 10188 19 0 0 25 0 4 0 641786479 182734848 36110 33554432000 134512640 135305190 4288370448 18446744073709551615 134528347 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=178452 CPUtime=102.05 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 7494 0 0 0 10190 15 0 0 18 0 4 0 641786479 182734848 36110 33554432000 134512640 135305190 4288370448 18446744073709551615 134528322 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.28
Current children cumulated vsize (KiB) 187152

[startup+162.301 s]
/proc/loadavg: 3.99 3.97 3.92 5/289 31302
/proc/meminfo: memFree=10401468/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=207296 CPUtime=648.07 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 43341 0 0 0 64731 76 0 0 25 0 4 0 641786475 212271104 43290 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 51824 43290 84 194 0 51628 0
[pid=31294/tid=31295] ppid=31291 vsize=207296 CPUtime=161.99 cores=0-7

################
# More data... #
################

/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 42695 0 0 0 466063 78 0 0 25 0 4 0 641786479 1002745856 230536 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 18645.7
Current children cumulated vsize (KiB) 987944

[startup+4722.31 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31447
/proc/meminfo: memFree=9628376/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1000196 CPUtime=18885.7 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 236000 0 0 0 1888197 372 0 0 25 0 4 0 641786475 1024200704 235861 33554432000 134512640 135305190 4288370448 18446744073709551615 134528455 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 250049 235861 84 194 0 249853 0
[pid=31294/tid=31295] ppid=31291 vsize=1000196 CPUtime=4721.46 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 38454 0 0 0 472091 55 0 0 25 0 4 0 641786479 1024200704 235861 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1000196 CPUtime=4721.52 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 108071 0 0 0 471994 158 0 0 25 0 4 0 641786479 1024200704 235861 33554432000 134512640 135305190 4288370448 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1000196 CPUtime=4721.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 43097 0 0 0 472064 78 0 0 18 0 4 0 641786479 1024200704 235861 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 18885.7
Current children cumulated vsize (KiB) 1008896

[startup+4782.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31449
/proc/meminfo: memFree=9592884/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1036532 CPUtime=19125.7 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 244977 0 0 0 1912185 381 0 0 25 0 4 0 641786475 1061408768 244838 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 259133 244838 84 194 0 258937 0
[pid=31294/tid=31295] ppid=31291 vsize=1036532 CPUtime=4781.46 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 39060 0 0 0 478090 56 0 0 25 0 4 0 641786479 1061408768 244838 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1036532 CPUtime=4781.5 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 115772 0 0 0 477985 165 0 0 25 0 4 0 641786479 1061408768 244838 33554432000 134512640 135305190 4288370448 18446744073709551615 134530636 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1036532 CPUtime=4781.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 43456 0 0 0 478063 79 0 0 18 0 4 0 641786479 1061408768 244838 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19125.7
Current children cumulated vsize (KiB) 1045232

[startup+4842.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31451
/proc/meminfo: memFree=9580572/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1048444 CPUtime=19365.7 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 247921 0 0 0 1936181 384 0 0 25 0 4 0 641786475 1073606656 247782 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 262111 247782 84 194 0 261915 0
[pid=31294/tid=31295] ppid=31291 vsize=1048444 CPUtime=4841.46 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 39476 0 0 0 484090 56 0 0 25 0 4 0 641786479 1073606656 247782 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1048444 CPUtime=4841.51 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 118002 0 0 0 483982 169 0 0 25 0 4 0 641786479 1073606656 247782 33554432000 134512640 135305190 4288370448 18446744073709551615 134551697 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1048444 CPUtime=4841.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 43588 0 0 0 484063 79 0 0 25 0 4 0 641786479 1073606656 247782 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19365.7
Current children cumulated vsize (KiB) 1057144

[startup+4902.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31452
/proc/meminfo: memFree=9556860/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1072992 CPUtime=19605.7 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 253905 0 0 0 1960178 389 0 0 25 0 4 0 641786475 1098743808 253766 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 268248 253766 84 194 0 268052 0
[pid=31294/tid=31295] ppid=31291 vsize=1072992 CPUtime=4901.46 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 40499 0 0 0 490090 56 0 0 25 0 4 0 641786479 1098743808 253766 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1072992 CPUtime=4901.5 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 121339 0 0 0 489979 171 0 0 25 0 4 0 641786479 1098743808 253766 33554432000 134512640 135305190 4288370448 18446744073709551615 134528455 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1072992 CPUtime=4901.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 44433 0 0 0 490062 80 0 0 19 0 4 0 641786479 1098743808 253766 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19605.7
Current children cumulated vsize (KiB) 1081692

[startup+4962.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31454
/proc/meminfo: memFree=9545900/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1083724 CPUtime=19845.7 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 256615 0 0 0 1984175 391 0 0 25 0 4 0 641786475 1109733376 256476 33554432000 134512640 135305190 4288370448 18446744073709551615 134528256 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 270931 256476 84 194 0 270735 0
[pid=31294/tid=31295] ppid=31291 vsize=1083724 CPUtime=4961.47 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 41026 0 0 0 496090 57 0 0 25 0 4 0 641786479 1109733376 256476 33554432000 134512640 135305190 4288370448 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1083724 CPUtime=4961.5 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 123071 0 0 0 495977 173 0 0 25 0 4 0 641786479 1109733376 256476 33554432000 134512640 135305190 4288370448 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1083724 CPUtime=4961.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 44667 0 0 0 496062 80 0 0 21 0 4 0 641786479 1109733376 256476 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19845.7
Current children cumulated vsize (KiB) 1092424

[startup+5022.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31455
/proc/meminfo: memFree=9529492/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1101236 CPUtime=20085.7 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 260815 0 0 0 2008171 396 0 0 25 0 4 0 641786475 1127665664 260676 33554432000 134512640 135305190 4288370448 18446744073709551615 134548034 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 275309 260676 84 194 0 275113 0
[pid=31294/tid=31295] ppid=31291 vsize=1101236 CPUtime=5021.47 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 41516 0 0 0 502090 57 0 0 25 0 4 0 641786479 1127665664 260676 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1101236 CPUtime=5021.5 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 126197 0 0 0 501973 177 0 0 25 0 4 0 641786479 1127665664 260676 33554432000 134512640 135305190 4288370448 18446744073709551615 134528237 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1101236 CPUtime=5021.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 44953 0 0 0 502062 80 0 0 24 0 4 0 641786479 1127665664 260676 33554432000 134512640 135305190 4288370448 18446744073709551615 134528319 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 20085.7
Current children cumulated vsize (KiB) 1109936

[startup+5082.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31457
/proc/meminfo: memFree=9523144/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1107328 CPUtime=20325.5 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 262248 0 0 0 2032149 400 0 0 25 0 4 0 641786475 1133903872 262109 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 276832 262109 84 194 0 276636 0
[pid=31294/tid=31295] ppid=31291 vsize=1107328 CPUtime=5081.3 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 41635 0 0 0 508071 59 0 0 25 0 4 0 641786479 1133903872 262109 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1107328 CPUtime=5081.49 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 126885 0 0 0 507970 179 0 0 19 0 4 0 641786479 1133903872 262109 33554432000 134512640 135305190 4288370448 18446744073709551615 134528187 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1107328 CPUtime=5081.42 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 45172 0 0 0 508062 80 0 0 21 0 4 0 641786479 1133903872 262109 33554432000 134512640 135305190 4288370448 18446744073709551615 134528568 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 20325.5
Current children cumulated vsize (KiB) 1116028



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 4.00 4.00 3.96 5/289 31457
/proc/meminfo: memFree=9522256/32951124 swapFree=52307768/67111528
[pid=31291] ppid=31289 vsize=8700 CPUtime=0.05 cores=0-7
/proc/31291/stat : 31291 (manysat.sh) S 31289 31291 31009 0 -1 4202496 357 1116 0 0 0 0 5 0 25 0 1 0 641786469 8908800 253 33554432000 4194304 4922060 140736829863824 18446744073709551615 218370776197 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/31291/statm: 2175 253 209 178 0 68 0
[pid=31294] ppid=31291 vsize=1108152 CPUtime=20396.3 cores=0-7
/proc/31294/stat : 31294 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202496 262455 0 0 0 2039232 400 0 0 25 0 4 0 641786475 1134747648 262316 33554432000 134512640 135305190 4288370448 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/31294/statm: 277038 262316 84 194 0 276842 0
[pid=31294/tid=31295] ppid=31291 vsize=1108152 CPUtime=5099.01 cores=0-7
/proc/31294/task/31295/stat : 31295 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 41635 0 0 0 509842 59 0 0 25 0 4 0 641786479 1134747648 262316 33554432000 134512640 135305190 4288370448 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31294/tid=31296] ppid=31291 vsize=1108152 CPUtime=5099.19 cores=0-7
/proc/31294/task/31296/stat : 31296 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 126900 0 0 0 509740 179 0 0 18 0 4 0 641786479 1134747648 262316 33554432000 134512640 135305190 4288370448 18446744073709551615 134528410 0 0 4096 3 0 0 0 -1 1 0 0 0
[pid=31294/tid=31297] ppid=31291 vsize=1108152 CPUtime=5099.12 cores=0-7
/proc/31294/task/31297/stat : 31297 (manysat1.1_stat) R 31291 31291 31009 0 -1 4202560 45220 0 0 0 509832 80 0 0 22 0 4 0 641786479 1134747648 262316 33554432000 134512640 135305190 4288370448 18446744073709551615 134528774 0 0 4096 3 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 20396.4
Current children cumulated vsize (KiB) 1116852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31291 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=51992
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.055991
# while last known CPU time is 20396.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 20396.4
CPU user time (s): 20392.4
CPU system time (s): 4
CPU usage (%): 399.927
Max. virtual memory (cumulated for all children) (KiB): 1116852

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.051992
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1473
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 4

runsolver used 13.366 second user time and 33.011 second system time

The end

Launcher Data 

Begin job on node101 at 2011-05-13 17:50:37
IDJOB=3362268
IDBENCH=83408
IDSOLVER=1839
FILE ID=node101/3362268-1305301837
RUNJOBID= node101-1305296397-31023
PBS_JOBID= 13321452
Free space on /tmp= 37512 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_3_keyfind_1.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362268-1305301837/watcher-3362268-1305301837 -o /tmp/evaluation-result-3362268-1305301837/solver-3362268-1305301837 -C 40000 -W 5100 -M 31000  manysat.sh HOME/instance-3362268-1305301837.cnf aimd 1

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ff59ad0e88befc51bfa041e45143dc53
RANDOM SEED=336339370

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10574780 kB
Buffers:        267608 kB
Cached:       12026176 kB
SwapCached:      14848 kB
Active:       11613992 kB
Inactive:     10333836 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10574780 kB
SwapTotal:    67111528 kB
SwapFree:     52307768 kB
Dirty:            2344 kB
Writeback:           0 kB
AnonPages:     9651792 kB
Mapped:          14520 kB
Slab:           301052 kB
PageTables:      62136 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 41977060 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 37508 MiB
End job on node101 at 2011-05-13 19:15:39