Trace number 3362276

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 20399 5100.02

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_4_keyfind_1.cnf
MD5SUM07ea67092ce3fd4529e72f69434e3f99
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1808
Number of clauses9968
Sum of the clauses size39152
Maximum clause length5
Minimum clause length1
Number of clauses of size 1144
Number of clauses of size 2320
Number of clauses of size 33904
Number of clauses of size 41344
Number of clauses of size 54256
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |    9760    38688 |    2927       0        0     nan |  0.000 % |
0.00/0.00	c |         0 |    9376    37408 |      --       0       --      -- |     --   | -128/-256
0.00/0.00	c ==============================================================================
0.00/0.00	c Result  :   #vars: 1600   #clauses: 9376   #literals: 37408
0.00/0.00	c CPU time:   0.007998 s
0.00/0.00	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362276-1305302338/watcher-3362276-1305302338 -o /tmp/evaluation-result-3362276-1305302338/solver-3362276-1305302338 -C 40000 -W 5100 -M 31000 manysat.sh HOME/instance-3362276-1305302338.cnf aimd 1 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.00 3.94 1/288 28154
/proc/meminfo: memFree=6433368/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 329 0 0 0 0 0 0 0 23 0 1 0 641833479 8908800 249 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/28154/statm: 2175 249 209 178 0 68 0

[startup+0.070897 s]
/proc/loadavg: 4.00 4.00 3.94 1/288 28154
/proc/meminfo: memFree=6433368/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.12523 s]
/proc/loadavg: 4.00 4.00 3.94 1/288 28154
/proc/meminfo: memFree=6433368/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.3002 s]
/proc/loadavg: 4.00 4.00 3.94 1/288 28154
/proc/meminfo: memFree=6433368/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.701126 s]
/proc/loadavg: 4.00 4.00 3.94 1/288 28154
/proc/meminfo: memFree=6433368/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+1.50091 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28160
/proc/meminfo: memFree=6422176/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=45476 CPUtime=5.85 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 2928 0 0 0 584 1 0 0 18 0 4 0 641833481 46567424 2881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528600 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 11369 2881 84 194 0 11173 0
[pid=28157/tid=28158] ppid=28154 vsize=45476 CPUtime=1.46 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 461 0 0 0 146 0 0 0 18 0 4 0 641833482 46567424 2881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=45476 CPUtime=1.45 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 517 0 0 0 145 0 0 0 18 0 4 0 641833482 46567424 2881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528242 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=45476 CPUtime=1.46 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 597 0 0 0 146 0 0 0 18 0 4 0 641833482 46567424 2881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.86
Current children cumulated vsize (KiB) 54176

[startup+3.10061 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28160
/proc/meminfo: memFree=6418140/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=52428 CPUtime=12.25 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 4533 0 0 0 1222 3 0 0 18 0 4 0 641833481 53686272 4486 33554432000 134512640 135305190 4292685072 18446744073709551615 134528455 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 13107 4487 84 194 0 12911 0
[pid=28157/tid=28158] ppid=28154 vsize=52428 CPUtime=3.05 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 858 0 0 0 305 0 0 0 20 0 4 0 641833482 53686272 4487 33554432000 134512640 135305190 4292685072 18446744073709551615 134840070 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=52428 CPUtime=3.05 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 876 0 0 0 305 0 0 0 19 0 4 0 641833482 53686272 4487 33554432000 134512640 135305190 4292685072 18446744073709551615 134553555 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=52428 CPUtime=3.06 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 1016 0 0 0 305 1 0 0 18 0 4 0 641833482 53686272 4487 33554432000 134512640 135305190 4292685072 18446744073709551615 134570407 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.26
Current children cumulated vsize (KiB) 61128

[startup+6.301 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28160
/proc/meminfo: memFree=6404832/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=62664 CPUtime=25.04 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 7274 0 0 0 2500 4 0 0 18 0 4 0 641833481 64167936 7211 33554432000 134512640 135305190 4292685072 18446744073709551615 134557813 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 15666 7211 84 194 0 15470 0
[pid=28157/tid=28158] ppid=28154 vsize=62664 CPUtime=6.25 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 1475 0 0 0 625 0 0 0 25 0 4 0 641833482 64167936 7211 33554432000 134512640 135305190 4292685072 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=62664 CPUtime=6.25 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 1435 0 0 0 625 0 0 0 20 0 4 0 641833482 64167936 7211 33554432000 134512640 135305190 4292685072 18446744073709551615 134528310 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=62664 CPUtime=6.25 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 1812 0 0 0 624 1 0 0 18 0 4 0 641833482 64167936 7211 33554432000 134512640 135305190 4292685072 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.05
Current children cumulated vsize (KiB) 71364

[startup+12.7008 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28161
/proc/meminfo: memFree=6391964/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=76984 CPUtime=50.63 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 10788 0 0 0 5058 5 0 0 18 0 4 0 641833481 78831616 10725 33554432000 134512640 135305190 4292685072 18446744073709551615 134528256 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 19246 10725 84 194 0 19050 0
[pid=28157/tid=28158] ppid=28154 vsize=76984 CPUtime=12.65 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 2268 0 0 0 1264 1 0 0 21 0 4 0 641833482 78831616 10725 33554432000 134512640 135305190 4292685072 18446744073709551615 134528573 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=76984 CPUtime=12.64 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 2304 0 0 0 1264 0 0 0 18 0 4 0 641833482 78831616 10725 33554432000 134512640 135305190 4292685072 18446744073709551615 134840070 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=76984 CPUtime=12.65 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 2769 0 0 0 1263 2 0 0 18 0 4 0 641833482 78831616 10725 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.64
Current children cumulated vsize (KiB) 85684

[startup+25.5003 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28161
/proc/meminfo: memFree=6373328/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=93556 CPUtime=101.82 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 15035 0 0 0 10173 9 0 0 25 0 4 0 641833481 95801344 14972 33554432000 134512640 135305190 4292685072 18446744073709551615 134528536 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 23389 14972 84 194 0 23193 0
[pid=28157/tid=28158] ppid=28154 vsize=93556 CPUtime=25.44 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 3158 0 0 0 2543 1 0 0 25 0 4 0 641833482 95801344 14972 33554432000 134512640 135305190 4292685072 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=93556 CPUtime=25.45 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 3585 0 0 0 2543 2 0 0 18 0 4 0 641833482 95801344 14972 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=93556 CPUtime=25.45 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 3771 0 0 0 2542 3 0 0 18 0 4 0 641833482 95801344 14972 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 102256

[startup+51.1005 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28162
/proc/meminfo: memFree=6348364/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=118872 CPUtime=204.19 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 21423 0 0 0 20405 14 0 0 25 0 4 0 641833481 121724928 21360 33554432000 134512640 135305190 4292685072 18446744073709551615 134528418 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 29718 21360 84 194 0 29522 0
[pid=28157/tid=28158] ppid=28154 vsize=118872 CPUtime=51.03 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 4550 0 0 0 5101 2 0 0 25 0 4 0 641833482 121724928 21360 33554432000 134512640 135305190 4292685072 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=118872 CPUtime=51.04 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 5365 0 0 0 5100 4 0 0 25 0 4 0 641833482 121724928 21360 33554432000 134512640 135305190 4292685072 18446744073709551615 134551620 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=118872 CPUtime=51.05 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 5369 0 0 0 5101 4 0 0 25 0 4 0 641833482 121724928 21360 33554432000 134512640 135305190 4292685072 18446744073709551615 134530636 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.2
Current children cumulated vsize (KiB) 127572

[startup+102.311 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28163
/proc/meminfo: memFree=6325632/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=141944 CPUtime=409 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 26884 0 0 0 40880 20 0 0 25 0 4 0 641833481 145350656 26821 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 35486 26821 84 194 0 35290 0
[pid=28157/tid=28158] ppid=28154 vsize=141944 CPUtime=102.24 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 5843 0 0 0 10220 4 0 0 25 0 4 0 641833482 145350656 26821 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=141944 CPUtime=102.24 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 7048 0 0 0 10219 5 0 0 25 0 4 0 641833482 145350656 26821 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=141944 CPUtime=102.24 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 6811 0 0 0 10219 5 0 0 25 0 4 0 641833482 145350656 26821 33554432000 134512640 135305190 4292685072 18446744073709551615 134528557 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 409.01
Current children cumulated vsize (KiB) 150644

[startup+162.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/293 28173
/proc/meminfo: memFree=6280252/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=188916 CPUtime=648.92 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 38639 0 0 0 64863 29 0 0 25 0 4 0 641833481 193449984 38576 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 47229 38576 84 194 0 47033 0
[pid=28157/tid=28158] ppid=28154 vsize=188916 CPUtime=162.22 cores=0-7

################
# More data... #
################

/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 39695 0 0 0 466138 70 0 0 25 0 4 0 641833482 882900992 203159 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 18648.2
Current children cumulated vsize (KiB) 870908

[startup+4722.31 s]
/proc/loadavg: 4.00 4.00 4.00 5/293 28310
/proc/meminfo: memFree=5611196/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=868868 CPUtime=18888.3 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 205021 0 0 0 1888551 276 0 0 25 0 4 0 641833481 889720832 204958 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 217217 204958 84 194 0 217021 0
[pid=28157/tid=28158] ppid=28154 vsize=868868 CPUtime=4722.07 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40577 0 0 0 472167 40 0 0 25 0 4 0 641833482 889720832 204958 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=868868 CPUtime=4721.96 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 86008 0 0 0 472086 110 0 0 25 0 4 0 641833482 889720832 204958 33554432000 134512640 135305190 4292685072 18446744073709551615 134528329 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=868868 CPUtime=4722.1 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40076 0 0 0 472137 73 0 0 25 0 4 0 641833482 889720832 204958 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 18888.3
Current children cumulated vsize (KiB) 877568

[startup+4782.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/293 28312
/proc/meminfo: memFree=5605704/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=875436 CPUtime=19128.2 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 206516 0 0 0 1912546 278 0 0 25 0 4 0 641833481 896446464 206453 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 218859 206453 84 194 0 218663 0
[pid=28157/tid=28158] ppid=28154 vsize=875436 CPUtime=4782.06 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40890 0 0 0 478166 40 0 0 25 0 4 0 641833482 896446464 206453 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=875436 CPUtime=4781.95 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 86635 0 0 0 478084 111 0 0 25 0 4 0 641833482 896446464 206453 33554432000 134512640 135305190 4292685072 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=875436 CPUtime=4782.09 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40222 0 0 0 478136 73 0 0 25 0 4 0 641833482 896446464 206453 33554432000 134512640 135305190 4292685072 18446744073709551615 134558360 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 19128.2
Current children cumulated vsize (KiB) 884136

[startup+4842.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/293 28313
/proc/meminfo: memFree=5591912/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=889332 CPUtime=19368.2 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 209845 0 0 0 1936541 284 0 0 25 0 4 0 641833481 910675968 209782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 222333 209782 84 194 0 222137 0
[pid=28157/tid=28158] ppid=28154 vsize=889332 CPUtime=4842.07 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 41313 0 0 0 484166 41 0 0 25 0 4 0 641833482 910675968 209782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=889332 CPUtime=4841.94 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 88911 0 0 0 484081 113 0 0 25 0 4 0 641833482 910675968 209782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528329 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=889332 CPUtime=4842.09 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40399 0 0 0 484136 73 0 0 25 0 4 0 641833482 910675968 209782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 19368.3
Current children cumulated vsize (KiB) 898032

[startup+4902.3 s]
/proc/loadavg: 4.05 4.01 4.00 5/293 28315
/proc/meminfo: memFree=5580100/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=901024 CPUtime=19608.2 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 212845 0 0 0 1960529 288 0 0 25 0 4 0 641833481 922648576 212782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528274 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 225256 212782 84 194 0 225060 0
[pid=28157/tid=28158] ppid=28154 vsize=901024 CPUtime=4902 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 41636 0 0 0 490158 42 0 0 25 0 4 0 641833482 922648576 212782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=901024 CPUtime=4901.94 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 91211 0 0 0 490078 116 0 0 25 0 4 0 641833482 922648576 212782 33554432000 134512640 135305190 4292685072 18446744073709551615 134552874 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=901024 CPUtime=4902.1 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40656 0 0 0 490136 74 0 0 25 0 4 0 641833482 922648576 212782 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 19608.2
Current children cumulated vsize (KiB) 909724

[startup+4962.3 s]
/proc/loadavg: 4.02 4.01 4.00 5/293 28317
/proc/meminfo: memFree=5579576/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=901668 CPUtime=19848.2 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 212968 0 0 0 1984529 288 0 0 25 0 4 0 641833481 923308032 212881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 225417 212881 84 194 0 225221 0
[pid=28157/tid=28158] ppid=28154 vsize=901668 CPUtime=4962 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 41636 0 0 0 496158 42 0 0 25 0 4 0 641833482 923308032 212881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=901668 CPUtime=4961.93 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 91230 0 0 0 496077 116 0 0 25 0 4 0 641833482 923308032 212881 33554432000 134512640 135305190 4292685072 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=901668 CPUtime=4962.1 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40699 0 0 0 496136 74 0 0 25 0 4 0 641833482 923308032 212881 33554432000 134512640 135305190 4292685072 18446744073709551615 134542147 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 19848.2
Current children cumulated vsize (KiB) 910368

[startup+5022.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/293 28318
/proc/meminfo: memFree=5579416/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=902028 CPUtime=20088.2 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 213080 0 0 0 2008528 289 0 0 25 0 4 0 641833481 923676672 212993 33554432000 134512640 135305190 4292685072 18446744073709551615 134528256 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 225507 212993 84 194 0 225311 0
[pid=28157/tid=28158] ppid=28154 vsize=902028 CPUtime=5021.99 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 41636 0 0 0 502157 42 0 0 25 0 4 0 641833482 923676672 212993 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=902028 CPUtime=5021.93 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 91231 0 0 0 502076 117 0 0 25 0 4 0 641833482 923676672 212993 33554432000 134512640 135305190 4292685072 18446744073709551615 134538173 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=902028 CPUtime=5022.1 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40703 0 0 0 502136 74 0 0 25 0 4 0 641833482 923676672 212993 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 20088.2
Current children cumulated vsize (KiB) 910728

[startup+5082.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/293 28320
/proc/meminfo: memFree=5578512/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=902916 CPUtime=20328.2 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 213278 0 0 0 2032528 290 0 0 25 0 4 0 641833481 924585984 213191 33554432000 134512640 135305190 4292685072 18446744073709551615 134528256 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 225729 213191 84 194 0 225533 0
[pid=28157/tid=28158] ppid=28154 vsize=902916 CPUtime=5082.01 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 41636 0 0 0 508158 43 0 0 25 0 4 0 641833482 924585984 213191 33554432000 134512640 135305190 4292685072 18446744073709551615 134528254 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=902916 CPUtime=5081.93 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 91298 0 0 0 508076 117 0 0 25 0 4 0 641833482 924585984 213191 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=902916 CPUtime=5082.1 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40712 0 0 0 508136 74 0 0 25 0 4 0 641833482 924585984 213191 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 20328.2
Current children cumulated vsize (KiB) 911616



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 4.00 4.00 4.00 5/293 28320
/proc/meminfo: memFree=5577996/32950928 swapFree=67083212/67111528
[pid=28154] ppid=28152 vsize=8700 CPUtime=0.01 cores=0-7
/proc/28154/stat : 28154 (manysat.sh) S 28152 28154 27694 0 -1 4202496 357 429 0 0 0 0 1 0 23 0 1 0 641833479 8908800 252 33554432000 4194304 4922060 140735591878288 18446744073709551615 208080051333 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28154/statm: 2175 252 209 178 0 68 0
[pid=28157] ppid=28154 vsize=903784 CPUtime=20399 cores=0-7
/proc/28157/stat : 28157 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202496 213424 0 0 0 2039612 290 0 0 25 0 4 0 641833481 925474816 213337 33554432000 134512640 135305190 4292685072 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 5 0 0 0
/proc/28157/statm: 225946 213337 84 194 0 225750 0
[pid=28157/tid=28158] ppid=28154 vsize=903784 CPUtime=5099.72 cores=0-7
/proc/28157/task/28158/stat : 28158 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 41636 0 0 0 509929 43 0 0 25 0 4 0 641833482 925474816 213337 33554432000 134512640 135305190 4292685072 18446744073709551615 134528548 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=28157/tid=28159] ppid=28154 vsize=903784 CPUtime=5099.64 cores=0-7
/proc/28157/task/28159/stat : 28159 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 91313 0 0 0 509847 117 0 0 25 0 4 0 641833482 925474816 213337 33554432000 134512640 135305190 4292685072 18446744073709551615 134528536 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=28157/tid=28160] ppid=28154 vsize=903784 CPUtime=5099.81 cores=0-7
/proc/28157/task/28160/stat : 28160 (manysat1.1_stat) R 28154 28154 27694 0 -1 4202560 40773 0 0 0 509907 74 0 0 25 0 4 0 641833482 925474816 213337 33554432000 134512640 135305190 4292685072 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 20399
Current children cumulated vsize (KiB) 912484

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28154 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=15997
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.016996
# while last known CPU time is 20399
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 20399
CPU user time (s): 20396.1
CPU system time (s): 2.9
CPU usage (%): 399.979
Max. virtual memory (cumulated for all children) (KiB): 912484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.015997
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 786
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 4

runsolver used 13.5129 second user time and 32.868 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-13 17:58:58
IDJOB=3362276
IDBENCH=83416
IDSOLVER=1839
FILE ID=node127/3362276-1305302338
RUNJOBID= node127-1305296393-27708
PBS_JOBID= 13321426
Free space on /tmp= 41888 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_4_keyfind_1.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362276-1305302338/watcher-3362276-1305302338 -o /tmp/evaluation-result-3362276-1305302338/solver-3362276-1305302338 -C 40000 -W 5100 -M 31000  manysat.sh HOME/instance-3362276-1305302338.cnf aimd 1

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 07ea67092ce3fd4529e72f69434e3f99
RANDOM SEED=746116265

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       6433648 kB
Buffers:        238708 kB
Cached:        9965200 kB
SwapCached:       1620 kB
Active:       18594108 kB
Inactive:      7443304 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       6433648 kB
SwapTotal:    67111528 kB
SwapFree:     67083212 kB
Dirty:            1584 kB
Writeback:           0 kB
AnonPages:    15832696 kB
Mapped:          25988 kB
Slab:           370032 kB
PageTables:      46556 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 44315568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 41884 MiB
End job on node127 at 2011-05-13 19:24:00