Trace number 3362269

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 4800.17 1203.93

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_2_keyfind_1.cnf
MD5SUM19e0b91e7d093f7cb35b11b46708a49b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses20544
Sum of the clauses size111944
Maximum clause length8
Minimum clause length1
Number of clauses of size 1272
Number of clauses of size 2256
Number of clauses of size 33520
Number of clauses of size 4640
Number of clauses of size 54096
Number of clauses of size over 511760

Solver Data 

0.00/0.00	c Parsing...
0.00/0.01	c ==============================================================================
0.00/0.01	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.01	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.01	c ==============================================================================
0.00/0.01	c |         0 |   20208   111352 |    6062       0        0     nan |  0.000 % |
0.00/0.01	c |         0 |   19440   108792 |      --       0       --      -- |     --   | -256/-512
0.00/0.01	c ==============================================================================
0.00/0.01	c Result  :   #vars: 1600   #clauses: 19440   #literals: 108792
0.00/0.01	c CPU time:   0.015997 s
0.00/0.01	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362269-1305300700/watcher-3362269-1305300700 -o /tmp/evaluation-result-3362269-1305300700/solver-3362269-1305300700 -C 4800 -W 1300 -M 15500 manysat.sh HOME/instance-3362269-1305300700.cnf aimd 1 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.13 8.01 5/368 26639
/proc/meminfo: memFree=20908472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 622485606 8908800 250 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/26639/statm: 2175 250 209 178 0 68 0

[startup+0.0907361 s]
/proc/loadavg: 8.08 8.13 8.01 5/368 26639
/proc/meminfo: memFree=20908472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+0.225364 s]
/proc/loadavg: 8.08 8.13 8.01 5/368 26639
/proc/meminfo: memFree=20908472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+0.455954 s]
/proc/loadavg: 8.08 8.13 8.01 5/368 26639
/proc/meminfo: memFree=20908472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+0.729414 s]
/proc/loadavg: 8.08 8.13 8.01 5/368 26639
/proc/meminfo: memFree=20908472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+1.81925 s]
/proc/loadavg: 8.08 8.13 8.01 5/368 26639
/proc/meminfo: memFree=20908472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 8700

[startup+3.10112 s]
/proc/loadavg: 8.15 8.15 8.01 10/373 26645
/proc/meminfo: memFree=20875692/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=69224 CPUtime=12.09 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 9142 0 0 0 1203 6 0 0 25 0 4 0 622485610 70885376 9093 33554432000 134512640 135305190 4290702800 18446744073709551615 134695249 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 17306 9093 84 194 0 17110 0
[pid=26642/tid=26643] ppid=26639 vsize=69224 CPUtime=3 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 1741 0 0 0 299 1 0 0 21 0 4 0 622485613 70885376 9093 33554432000 134512640 135305190 4290702800 18446744073709551615 134531188 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=69224 CPUtime=3.01 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 1841 0 0 0 300 1 0 0 24 0 4 0 622485613 70885376 9093 33554432000 134512640 135305190 4290702800 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=69224 CPUtime=3.01 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 2014 0 0 0 300 1 0 0 25 0 4 0 622485613 70885376 9093 33554432000 134512640 135305190 4290702800 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.12
Current children cumulated vsize (KiB) 77924

[startup+6.30045 s]
/proc/loadavg: 8.15 8.15 8.01 10/373 26678
/proc/meminfo: memFree=21361372/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=79252 CPUtime=24.82 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 11591 0 0 0 2473 9 0 0 21 0 4 0 622485610 81154048 11542 33554432000 134512640 135305190 4290702800 18446744073709551615 134551681 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 19813 11542 84 194 0 19617 0
[pid=26642/tid=26643] ppid=26639 vsize=79252 CPUtime=6.14 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 2341 0 0 0 612 2 0 0 21 0 4 0 622485613 81154048 11542 33554432000 134512640 135305190 4290702800 18446744073709551615 134528771 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=79252 CPUtime=6.21 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 2371 0 0 0 620 1 0 0 25 0 4 0 622485613 81154048 11542 33554432000 134512640 135305190 4290702800 18446744073709551615 134528851 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=79252 CPUtime=6.2 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 2749 0 0 0 618 2 0 0 22 0 4 0 622485613 81154048 11542 33554432000 134512640 135305190 4290702800 18446744073709551615 134547909 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.85
Current children cumulated vsize (KiB) 87952

[startup+12.7002 s]
/proc/loadavg: 8.20 8.16 8.02 9/373 26678
/proc/meminfo: memFree=21318808/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=93700 CPUtime=50.32 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 14935 0 0 0 5020 12 0 0 25 0 4 0 622485610 95948800 14886 33554432000 134512640 135305190 4290702800 18446744073709551615 134528418 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 23425 14886 84 194 0 23229 0
[pid=26642/tid=26643] ppid=26639 vsize=93700 CPUtime=12.46 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 3104 0 0 0 1243 3 0 0 25 0 4 0 622485613 95948800 14886 33554432000 134512640 135305190 4290702800 18446744073709551615 134528548 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=93700 CPUtime=12.61 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 3099 0 0 0 1259 2 0 0 25 0 4 0 622485613 95948800 14886 33554432000 134512640 135305190 4290702800 18446744073709551615 134554809 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=93700 CPUtime=12.6 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 3751 0 0 0 1257 3 0 0 25 0 4 0 622485613 95948800 14886 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.35
Current children cumulated vsize (KiB) 102400

[startup+25.5008 s]
/proc/loadavg: 8.17 8.15 8.01 10/373 26679
/proc/meminfo: memFree=21275832/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=117900 CPUtime=101.31 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 20825 0 0 0 10112 19 0 0 25 0 4 0 622485610 120729600 20776 33554432000 134512640 135305190 4290702800 18446744073709551615 134528536 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 29475 20776 84 194 0 29279 0
[pid=26642/tid=26643] ppid=26639 vsize=117900 CPUtime=25.09 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 4459 0 0 0 2504 5 0 0 25 0 4 0 622485613 120729600 20776 33554432000 134512640 135305190 4290702800 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=117900 CPUtime=25.4 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 4810 0 0 0 2537 3 0 0 25 0 4 0 622485613 120729600 20776 33554432000 134512640 135305190 4290702800 18446744073709551615 134528455 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=117900 CPUtime=25.37 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 5038 0 0 0 2533 4 0 0 25 0 4 0 622485613 120729600 20776 33554432000 134512640 135305190 4290702800 18446744073709551615 134548012 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.34
Current children cumulated vsize (KiB) 126600

[startup+51.101 s]
/proc/loadavg: 8.11 8.14 8.01 10/373 26679
/proc/meminfo: memFree=21232392/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=142624 CPUtime=203.33 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 27035 0 0 0 20310 23 0 0 25 0 4 0 622485610 146046976 26986 33554432000 134512640 135305190 4290702800 18446744073709551615 134547909 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 35656 26986 84 194 0 35460 0
[pid=26642/tid=26643] ppid=26639 vsize=142624 CPUtime=50.37 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 6174 0 0 0 5031 6 0 0 25 0 4 0 622485613 146046976 26986 33554432000 134512640 135305190 4290702800 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=142624 CPUtime=50.98 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 6018 0 0 0 5094 4 0 0 25 0 4 0 622485613 146046976 26986 33554432000 134512640 135305190 4290702800 18446744073709551615 134541967 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=142624 CPUtime=50.95 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 6782 0 0 0 5089 6 0 0 25 0 4 0 622485613 146046976 26986 33554432000 134512640 135305190 4290702800 18446744073709551615 134528458 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.36
Current children cumulated vsize (KiB) 151324

[startup+102.313 s]
/proc/loadavg: 8.12 8.14 8.02 10/373 26681
/proc/meminfo: memFree=21151396/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=189308 CPUtime=407.49 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 38298 0 0 0 40716 33 0 0 25 0 4 0 622485610 193851392 38249 33554432000 134512640 135305190 4290702800 18446744073709551615 134551651 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 47327 38249 84 194 0 47131 0
[pid=26642/tid=26643] ppid=26639 vsize=189308 CPUtime=100.94 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 7823 0 0 0 10086 8 0 0 25 0 4 0 622485613 193851392 38249 33554432000 134512640 135305190 4290702800 18446744073709551615 134528875 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=189308 CPUtime=102.19 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 10148 0 0 0 10211 8 0 0 25 0 4 0 622485613 193851392 38249 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=189308 CPUtime=102.15 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 9523 0 0 0 10207 8 0 0 25 0 4 0 622485613 193851392 38249 33554432000 134512640 135305190 4290702800 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.52
Current children cumulated vsize (KiB) 198008

[startup+162.301 s]
/proc/loadavg: 8.08 8.13 8.02 10/373 26682
/proc/meminfo: memFree=21106608/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=217252 CPUtime=646.67 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 45342 0 0 0 64626 41 0 0 25 0 4 0 622485610 222466048 45293 33554432000 134512640 135305190 4290702800 18446744073709551615 134548055 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 54313 45293 84 194 0 54117 0
[pid=26642/tid=26643] ppid=26639 vsize=217252 CPUtime=160.21 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 8882 0 0 0 16012 9 0 0 25 0 4 0 622485613 222466048 45293 33554432000 134512640 135305190 4290702800 18446744073709551615 134528506 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=217252 CPUtime=162.16 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 12845 0 0 0 16205 11 0 0 25 0 4 0 622485613 222466048 45293 33554432000 134512640 135305190 4290702800 18446744073709551615 134528382 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=217252 CPUtime=162.11 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 11048 0 0 0 16201 10 0 0 25 0 4 0 622485613 222466048 45293 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 646.7
Current children cumulated vsize (KiB) 225952

[startup+222.301 s]

################
# More data... #
################

/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 21847 0 0 0 76180 21 0 0 25 0 4 0 622485613 437919744 96226 33554432000 134512640 135305190 4290702800 18446744073709551615 134528571 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3039.19
Current children cumulated vsize (KiB) 436356

[startup+822.3 s]
/proc/loadavg: 8.10 8.12 8.05 10/373 26700
/proc/meminfo: memFree=20745272/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=434732 CPUtime=3278.4 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 97968 0 0 0 327746 94 0 0 25 0 4 0 622485610 445165568 97919 33554432000 134512640 135305190 4290702800 18446744073709551615 134528477 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 108683 97919 84 194 0 108487 0
[pid=26642/tid=26643] ppid=26639 vsize=434732 CPUtime=813.51 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 17080 0 0 0 81335 16 0 0 25 0 4 0 622485613 445165568 97919 33554432000 134512640 135305190 4290702800 18446744073709551615 134528237 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=434732 CPUtime=821.97 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 34569 0 0 0 82162 35 0 0 25 0 4 0 622485613 445165568 97919 33554432000 134512640 135305190 4290702800 18446744073709551615 134528455 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=434732 CPUtime=822 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 22783 0 0 0 82178 22 0 0 25 0 4 0 622485613 445165568 97919 33554432000 134512640 135305190 4290702800 18446744073709551615 134528256 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3278.43
Current children cumulated vsize (KiB) 443432

[startup+882.301 s]
/proc/loadavg: 8.08 8.11 8.05 10/373 26702
/proc/meminfo: memFree=20709400/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=453752 CPUtime=3517.69 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 102753 0 0 0 351670 99 0 0 25 0 4 0 622485610 464642048 102704 33554432000 134512640 135305190 4290702800 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 113438 102704 84 194 0 113242 0
[pid=26642/tid=26643] ppid=26639 vsize=453752 CPUtime=872.81 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 17803 0 0 0 87264 17 0 0 25 0 4 0 622485613 464642048 102704 33554432000 134512640 135305190 4290702800 18446744073709551615 134528237 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=453752 CPUtime=881.95 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 36913 0 0 0 88158 37 0 0 25 0 4 0 622485613 464642048 102704 33554432000 134512640 135305190 4290702800 18446744073709551615 134528415 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=453752 CPUtime=882 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 23873 0 0 0 88177 23 0 0 25 0 4 0 622485613 464642048 102704 33554432000 134512640 135305190 4290702800 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3517.72
Current children cumulated vsize (KiB) 462452

[startup+942.301 s]
/proc/loadavg: 8.03 8.09 8.04 10/373 26703
/proc/meminfo: memFree=20646000/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=497408 CPUtime=3756.97 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 113912 0 0 0 375588 109 0 0 25 0 4 0 622485610 509345792 113863 33554432000 134512640 135305190 4290702800 18446744073709551615 134528224 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 124352 113863 84 194 0 124156 0
[pid=26642/tid=26643] ppid=26639 vsize=497408 CPUtime=932.1 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 19526 0 0 0 93193 17 0 0 25 0 4 0 622485613 509345792 113863 33554432000 134512640 135305190 4290702800 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=497408 CPUtime=941.94 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 43074 0 0 0 94149 45 0 0 25 0 4 0 622485613 509345792 113863 33554432000 134512640 135305190 4290702800 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=497408 CPUtime=942.01 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 24999 0 0 0 94177 24 0 0 25 0 4 0 622485613 509345792 113863 33554432000 134512640 135305190 4290702800 18446744073709551615 134528455 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3757
Current children cumulated vsize (KiB) 506108

[startup+1002.3 s]
/proc/loadavg: 8.05 8.08 8.04 10/373 26705
/proc/meminfo: memFree=20618444/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=513624 CPUtime=3996.14 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 117533 0 0 0 399501 113 0 0 25 0 4 0 622485610 525950976 117484 33554432000 134512640 135305190 4290702800 18446744073709551615 134528503 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 128406 117484 84 194 0 128210 0
[pid=26642/tid=26643] ppid=26639 vsize=513624 CPUtime=991.33 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 20355 0 0 0 99114 19 0 0 25 0 4 0 622485613 525950976 117484 33554432000 134512640 135305190 4290702800 18446744073709551615 134528301 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=513624 CPUtime=1001.92 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 44574 0 0 0 100145 47 0 0 25 0 4 0 622485613 525950976 117484 33554432000 134512640 135305190 4290702800 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=513624 CPUtime=1002 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 25634 0 0 0 100176 24 0 0 25 0 4 0 622485613 525950976 117484 33554432000 134512640 135305190 4290702800 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3996.17
Current children cumulated vsize (KiB) 522324

[startup+1062.3 s]
/proc/loadavg: 8.05 8.08 8.04 10/373 26706
/proc/meminfo: memFree=20609356/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=517028 CPUtime=4235.44 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 118397 0 0 0 423430 114 0 0 25 0 4 0 622485610 529436672 118348 33554432000 134512640 135305190 4290702800 18446744073709551615 134528480 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 129257 118348 84 194 0 129061 0
[pid=26642/tid=26643] ppid=26639 vsize=517028 CPUtime=1050.63 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 20355 0 0 0 105044 19 0 0 25 0 4 0 622485613 529436672 118348 33554432000 134512640 135305190 4290702800 18446744073709551615 134551620 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=517028 CPUtime=1061.9 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 44620 0 0 0 106143 47 0 0 25 0 4 0 622485613 529436672 118348 33554432000 134512640 135305190 4290702800 18446744073709551615 134528256 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=517028 CPUtime=1062 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 26452 0 0 0 106176 24 0 0 25 0 4 0 622485613 529436672 118348 33554432000 134512640 135305190 4290702800 18446744073709551615 134528338 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4235.47
Current children cumulated vsize (KiB) 525728

[startup+1122.3 s]
/proc/loadavg: 8.09 8.09 8.05 10/373 26708
/proc/meminfo: memFree=20607212/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=517472 CPUtime=4474.67 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 118524 0 0 0 447351 116 0 0 25 0 4 0 622485610 529891328 118475 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 129368 118475 84 194 0 129172 0
[pid=26642/tid=26643] ppid=26639 vsize=517472 CPUtime=1109.92 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 20356 0 0 0 110973 19 0 0 25 0 4 0 622485613 529891328 118475 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=517472 CPUtime=1121.88 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 44715 0 0 0 112140 48 0 0 25 0 4 0 622485613 529891328 118475 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=517472 CPUtime=1121.98 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 26452 0 0 0 112173 25 0 0 25 0 4 0 622485613 529891328 118475 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4474.7
Current children cumulated vsize (KiB) 526172

[startup+1182.3 s]
/proc/loadavg: 8.17 8.12 8.06 10/373 26710
/proc/meminfo: memFree=20593664/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=518736 CPUtime=4713.95 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 118789 0 0 0 471279 116 0 0 25 0 4 0 622485610 531185664 118740 33554432000 134512640 135305190 4290702800 18446744073709551615 134528274 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 129684 118740 84 194 0 129488 0
[pid=26642/tid=26643] ppid=26639 vsize=518736 CPUtime=1169.22 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 20417 0 0 0 116903 19 0 0 25 0 4 0 622485613 531185664 118740 33554432000 134512640 135305190 4290702800 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=518736 CPUtime=1181.87 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 44759 0 0 0 118138 49 0 0 25 0 4 0 622485613 531185664 118740 33554432000 134512640 135305190 4290702800 18446744073709551615 134528415 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=518736 CPUtime=1181.98 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 26473 0 0 0 118173 25 0 0 25 0 4 0 622485613 531185664 118740 33554432000 134512640 135305190 4290702800 18446744073709551615 134528310 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4713.98
Current children cumulated vsize (KiB) 527436



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 8.19 8.12 8.06 9/373 26710
/proc/meminfo: memFree=20584472/32951124 swapFree=66341972/67111528
[pid=26639] ppid=26637 vsize=8700 CPUtime=0.03 cores=0,2,4,6
/proc/26639/stat : 26639 (manysat.sh) S 26637 26639 25977 0 -1 4202496 357 757 0 0 0 0 3 0 25 0 1 0 622485606 8908800 253 33554432000 4194304 4922060 140736044152496 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/26639/statm: 2175 253 209 178 0 68 0
[pid=26642] ppid=26639 vsize=520348 CPUtime=4800.14 cores=0,2,4,6
/proc/26642/stat : 26642 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202496 119130 0 0 0 479897 117 0 0 25 0 4 0 622485610 532836352 119081 33554432000 134512640 135305190 4290702800 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 2 0 0 0
/proc/26642/statm: 130087 119081 84 194 0 129891 0
[pid=26642/tid=26643] ppid=26639 vsize=520348 CPUtime=1190.56 cores=0,2,4,6
/proc/26642/task/26643/stat : 26643 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 20488 0 0 0 119037 19 0 0 25 0 4 0 622485613 532836352 119081 33554432000 134512640 135305190 4290702800 18446744073709551615 134528265 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=26642/tid=26644] ppid=26639 vsize=520348 CPUtime=1203.48 cores=0,2,4,6
/proc/26642/task/26644/stat : 26644 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 44790 0 0 0 120299 49 0 0 25 0 4 0 622485613 532836352 119081 33554432000 134512640 135305190 4290702800 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=26642/tid=26645] ppid=26639 vsize=520348 CPUtime=1203.59 cores=0,2,4,6
/proc/26642/task/26645/stat : 26645 (manysat1.1_stat) R 26639 26639 25977 0 -1 4202560 26524 0 0 0 120334 25 0 0 25 0 4 0 622485613 532836352 119081 33554432000 134512640 135305190 4290702800 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 529048

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26639 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=36994
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.038993
# while last known CPU time is 4800.17
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1203.93
CPU time (s): 4800.17
CPU user time (s): 4799
CPU system time (s): 1.17
CPU usage (%): 398.71
Max. virtual memory (cumulated for all children) (KiB): 529048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.036994
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1114
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 5

runsolver used 4.04038 second user time and 10.1974 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-13 17:31:40
IDJOB=3362269
IDBENCH=83410
IDSOLVER=1838
FILE ID=node141/3362269-1305300700
RUNJOBID= node141-1305296391-25995
PBS_JOBID= 13321412
Free space on /tmp= 48904 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_2_keyfind_1.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362269-1305300700/watcher-3362269-1305300700 -o /tmp/evaluation-result-3362269-1305300700/solver-3362269-1305300700 -C 4800 -W 1300 -M 15500  manysat.sh HOME/instance-3362269-1305300700.cnf aimd 1

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 19e0b91e7d093f7cb35b11b46708a49b
RANDOM SEED=2072664073

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20908760 kB
Buffers:        212440 kB
Cached:        5885308 kB
SwapCached:      22860 kB
Active:        3561876 kB
Inactive:      8255364 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20908760 kB
SwapTotal:    67111528 kB
SwapFree:     66341972 kB
Dirty:            2000 kB
Writeback:           0 kB
AnonPages:     5702572 kB
Mapped:          19896 kB
Slab:           124236 kB
PageTables:      39348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 86771092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 48928 MiB
End job on node141 at 2011-05-13 17:51:46