Trace number 3386422

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4063.94 1300.05

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
32/aes_32_5_keyfind_1.cnf
MD5SUM3f4ea4cf17e734bbe947db7c1dc9fde7
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1116
Number of clauses4312
Sum of the clauses size13688
Maximum clause length5
Minimum clause length1
Number of clauses of size 184
Number of clauses of size 2200
Number of clauses of size 33008
Number of clauses of size 4920
Number of clauses of size 5100
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386422-1305582133/watcher-3386422-1305582133 -o /tmp/evaluation-result-3386422-1305582133/solver-3386422-1305582133 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386422-1305582133.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.06 3/324 20599
/proc/meminfo: memFree=24371184/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=50424 CPUtime=0.01 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 733 0 0 0 1 0 0 0 21 0 4 0 748443885 51634176 670 33554432000 4194304 4625164 140735175810848 18446744073709551615 47492452632492 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 12606 670 304 106 0 8109 0
[pid=20599/tid=20600] ppid=20597 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 748443886 51634176 670 33554432000 4194304 4625164 140735175810848 18446744073709551615 260020452337 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 748443886 51634176 670 33554432000 4194304 4625164 140735175810848 18446744073709551615 260020452337 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 4 0 748443886 51634176 670 33554432000 4194304 4625164 140735175810848 18446744073709551615 47492452632498 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.0934631 s]
/proc/loadavg: 2.00 2.00 2.06 3/324 20599
/proc/meminfo: memFree=24371184/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=184332 CPUtime=0.26 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 2694 0 0 0 26 0 0 0 22 0 4 0 748443885 188755968 1789 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512021 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 46083 1789 342 106 0 41586 0
[pid=20599/tid=20600] ppid=20597 vsize=184332 CPUtime=0.03 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 171 0 0 0 3 0 0 0 23 0 4 0 748443886 188755968 1789 33554432000 4194304 4625164 140735175810848 18446744073709551615 4462600 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=184332 CPUtime=0.07 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 436 0 0 0 7 0 0 0 23 0 4 0 748443886 188755968 1789 33554432000 4194304 4625164 140735175810848 18446744073709551615 4464896 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=184332 CPUtime=0.08 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 631 0 0 0 8 0 0 0 18 0 4 0 748443886 188755968 1789 33554432000 4194304 4625164 140735175810848 18446744073709551615 4291632 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 184332

[startup+0.10046 s]
/proc/loadavg: 2.00 2.00 2.06 3/324 20599
/proc/meminfo: memFree=24371184/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=249560 CPUtime=0.29 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 2890 0 0 0 29 0 0 0 22 0 4 0 748443885 255549440 1908 33554432000 4194304 4625164 140735175810848 18446744073709551615 4519394 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 62390 1908 342 106 0 57893 0
[pid=20599/tid=20600] ppid=20597 vsize=249560 CPUtime=0.03 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 313 0 0 0 3 0 0 0 23 0 4 0 748443886 255549440 1909 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=249560 CPUtime=0.08 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 440 0 0 0 8 0 0 0 23 0 4 0 748443886 255549440 1910 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=249560 CPUtime=0.09 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 679 0 0 0 9 0 0 0 18 0 4 0 748443886 255549440 1910 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 249560

[startup+0.300424 s]
/proc/loadavg: 2.00 2.00 2.06 3/324 20599
/proc/meminfo: memFree=24371184/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=250688 CPUtime=1.08 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 4477 0 0 0 108 0 0 0 22 0 4 0 748443885 256704512 2375 33554432000 4194304 4625164 140735175810848 18446744073709551615 4356358 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 62672 2375 343 106 0 58175 0
[pid=20599/tid=20600] ppid=20597 vsize=250688 CPUtime=0.23 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 542 0 0 0 23 0 0 0 23 0 4 0 748443886 256704512 2375 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352822 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=250688 CPUtime=0.28 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 489 0 0 0 28 0 0 0 23 0 4 0 748443886 256704512 2375 33554432000 4194304 4625164 140735175810848 18446744073709551615 4467253 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=250688 CPUtime=0.29 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 1698 0 0 0 29 0 0 0 18 0 4 0 748443886 256704512 2375 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.08
Current children cumulated vsize (KiB) 250688

[startup+0.700353 s]
/proc/loadavg: 2.00 2.00 2.06 3/324 20599
/proc/meminfo: memFree=24371184/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=252804 CPUtime=2.69 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 7873 0 0 0 268 1 0 0 24 0 4 0 748443885 258871296 3291 33554432000 4194304 4625164 140735175810848 18446744073709551615 4357391 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 63201 3292 343 106 0 58704 0
[pid=20599/tid=20600] ppid=20597 vsize=252804 CPUtime=0.63 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 827 0 0 0 63 0 0 0 25 0 4 0 748443886 258871296 3292 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352186 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=252804 CPUtime=0.68 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 804 0 0 0 68 0 0 0 25 0 4 0 748443886 258871296 3292 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=252804 CPUtime=0.69 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 4064 0 0 0 69 0 0 0 18 0 4 0 748443886 258871296 3292 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.69
Current children cumulated vsize (KiB) 252804

[startup+1.50021 s]
/proc/loadavg: 2.00 2.00 2.06 11/336 20616
/proc/meminfo: memFree=24240384/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=256840 CPUtime=5.87 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 12474 0 0 0 586 1 0 0 25 0 4 0 748443885 263004160 4472 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 64210 4472 344 106 0 59713 0
[pid=20599/tid=20600] ppid=20597 vsize=256840 CPUtime=1.43 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 1268 0 0 0 143 0 0 0 25 0 4 0 748443886 263004160 4472 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352305 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=256840 CPUtime=1.47 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 1242 0 0 0 147 0 0 0 25 0 4 0 748443886 263004160 4472 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=256840 CPUtime=1.48 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 7403 0 0 0 148 0 0 0 19 0 4 0 748443886 263004160 4472 33554432000 4194304 4625164 140735175810848 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.87
Current children cumulated vsize (KiB) 256840

[startup+3.10092 s]
/proc/loadavg: 2.00 2.00 2.06 11/336 20616
/proc/meminfo: memFree=24171440/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=260968 CPUtime=12.26 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 16257 0 0 0 1224 2 0 0 25 0 4 0 748443885 267231232 6665 33554432000 4194304 4625164 140735175810848 18446744073709551615 4306608 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 65242 6665 345 106 0 60745 0
[pid=20599/tid=20600] ppid=20597 vsize=260968 CPUtime=3.03 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 2264 0 0 0 303 0 0 0 25 0 4 0 748443886 267231232 6665 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=260968 CPUtime=3.06 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 2213 0 0 0 306 0 0 0 25 0 4 0 748443886 267231232 6665 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=260968 CPUtime=3.08 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 8821 0 0 0 308 0 0 0 25 0 4 0 748443886 267231232 6665 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352688 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.26
Current children cumulated vsize (KiB) 260968

[startup+6.30033 s]
/proc/loadavg: 2.64 2.13 2.10 11/336 20616
/proc/meminfo: memFree=24140652/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=269432 CPUtime=25.03 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 26640 0 0 0 2499 4 0 0 25 0 4 0 748443885 275898368 9844 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 67358 9844 348 106 0 62861 0
[pid=20599/tid=20600] ppid=20597 vsize=269432 CPUtime=6.23 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3319 0 0 0 623 0 0 0 25 0 4 0 748443886 275898368 9844 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=269432 CPUtime=6.23 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3347 0 0 0 622 1 0 0 25 0 4 0 748443886 275898368 9844 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=269432 CPUtime=6.28 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 15833 0 0 0 627 1 0 0 25 0 4 0 748443886 275898368 9844 33554432000 4194304 4625164 140735175810848 18446744073709551615 4334491 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.03
Current children cumulated vsize (KiB) 269432

[startup+12.7012 s]
/proc/loadavg: 3.23 2.26 2.15 11/336 20617
/proc/meminfo: memFree=24070108/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=281348 CPUtime=50.57 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 71594 0 0 0 5045 12 0 0 25 0 4 0 748443885 288100352 14311 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 70337 14311 345 106 0 65840 0
[pid=20599/tid=20600] ppid=20597 vsize=281348 CPUtime=12.63 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 5149 0 0 0 1262 1 0 0 25 0 4 0 748443886 288100352 14311 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351967 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=281348 CPUtime=12.56 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 5220 0 0 0 1255 1 0 0 25 0 4 0 748443886 288100352 14311 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=281348 CPUtime=12.69 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 55640 0 0 0 1261 8 0 0 25 0 4 0 748443886 288100352 14311 33554432000 4194304 4625164 140735175810848 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.57
Current children cumulated vsize (KiB) 281348

[startup+25.5008 s]
/proc/loadavg: 4.73 2.64 2.27 11/336 20617
/proc/meminfo: memFree=23995916/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=295200 CPUtime=98.57 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 140501 0 0 0 9832 25 0 0 25 0 4 0 748443885 302284800 21835 33554432000 4194304 4625164 140735175810848 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 73800 21835 392 106 0 69303 0
[pid=20599/tid=20600] ppid=20597 vsize=295200 CPUtime=25.43 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 7374 0 0 0 2541 2 0 0 25 0 4 0 748443886 302284800 21835 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=295200 CPUtime=25.21 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 7674 0 0 0 2520 1 0 0 25 0 4 0 748443886 302284800 21835 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=295200 CPUtime=25.49 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 117405 0 0 0 2531 18 0 0 25 0 4 0 748443886 302284800 21835 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 98.57
Current children cumulated vsize (KiB) 295200

[startup+51.1011 s]
/proc/loadavg: 6.60 3.25 2.48 11/336 20618
/proc/meminfo: memFree=23894028/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=315632 CPUtime=187.8 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 226934 0 0 0 18739 41 0 0 25 0 4 0 748443885 323207168 30990 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 78908 30990 348 106 0 74411 0
[pid=20599/tid=20600] ppid=20597 vsize=315632 CPUtime=51.03 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 11352 0 0 0 5101 2 0 0 25 0 4 0 748443886 323207168 30990 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=315632 CPUtime=50.55 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 12649 0 0 0 5051 4 0 0 25 0 4 0 748443886 323207168 30990 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=315632 CPUtime=51.09 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 194407 0 0 0 5078 31 0 0 25 0 4 0 748443886 323207168 30990 33554432000 4194304 4625164 140735175810848 18446744073709551615 4565134 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 187.8
Current children cumulated vsize (KiB) 315632

[startup+102.313 s]
/proc/loadavg: 8.56 4.30 2.88 11/336 20649
/proc/meminfo: memFree=23923072/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=341868 CPUtime=367.46 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 385247 0 0 0 36678 68 0 0 25 0 4 0 748443885 350072832 48012 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 85467 48012 516 106 0 80970 0
[pid=20599/tid=20600] ppid=20597 vsize=341868 CPUtime=102.24 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 17213 0 0 0 10221 3 0 0 25 0 4 0 748443886 350072832 48012 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=341868 CPUtime=101.21 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 18264 0 0 0 10114 7 0 0 25 0 4 0 748443886 350072832 48012 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=341868 CPUtime=102.3 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 332548 0 0 0 10177 53 0 0 25 0 4 0 748443886 350072832 48012 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 367.46
Current children cumulated vsize (KiB) 341868

[startup+162.301 s]

################
# More data... #
################

[pid=20599] ppid=20597 vsize=828224 CPUtime=2258.98 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 2845906 0 0 0 225415 483 0 0 25 0 4 0 748443885 848101376 150221 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512758 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 207056 150221 345 106 0 202559 0
[pid=20599/tid=20600] ppid=20597 vsize=828224 CPUtime=529.92 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 43555 0 0 0 52981 11 0 0 25 0 4 0 748443886 848101376 150221 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=828224 CPUtime=476.18 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 46659 0 0 0 47599 19 0 0 25 0 4 0 748443886 848101376 150221 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=828224 CPUtime=631.64 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 2624684 0 0 0 62735 429 0 0 25 0 4 0 748443886 848101376 150221 33554432000 4194304 4625164 140735175810848 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2258.98
Current children cumulated vsize (KiB) 828224

[startup+762.313 s]
/proc/loadavg: 10.11 9.48 6.55 11/336 20667
/proc/meminfo: memFree=19534136/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=853276 CPUtime=2456.74 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 3118393 0 0 0 245144 530 0 0 25 0 4 0 748443885 873754624 158831 33554432000 4194304 4625164 140735175810848 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 213319 158831 345 106 0 208822 0
[pid=20599/tid=20600] ppid=20597 vsize=853276 CPUtime=589.93 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 45349 0 0 0 58981 12 0 0 25 0 4 0 748443886 873754624 158831 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=853276 CPUtime=506.34 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 58534 0 0 0 50613 21 0 0 25 0 4 0 748443886 873754624 158831 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=853276 CPUtime=679.22 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 2880193 0 0 0 67450 472 0 0 25 0 4 0 748443886 873754624 158831 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2456.74
Current children cumulated vsize (KiB) 853276

[startup+822.301 s]
/proc/loadavg: 10.08 9.59 6.77 11/336 20668
/proc/meminfo: memFree=19469572/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=881356 CPUtime=2636.05 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 3289659 0 0 0 263046 559 0 0 25 0 4 0 748443885 902508544 166249 33554432000 4194304 4625164 140735175810848 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 220339 166249 345 106 0 215842 0
[pid=20599/tid=20600] ppid=20597 vsize=881356 CPUtime=624.05 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 57302 0 0 0 62391 14 0 0 25 0 4 0 748443886 902508544 166249 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=881356 CPUtime=561.37 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 61107 0 0 0 56115 22 0 0 25 0 4 0 748443886 902508544 166249 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=881356 CPUtime=709.41 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3035322 0 0 0 70442 499 0 0 25 0 4 0 748443886 902508544 166249 33554432000 4194304 4625164 140735175810848 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2636.05
Current children cumulated vsize (KiB) 881356

[startup+882.301 s]
/proc/loadavg: 10.06 9.67 6.97 11/336 20670
/proc/meminfo: memFree=19259332/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=913288 CPUtime=2815.4 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 3472306 0 0 0 280952 588 0 0 25 0 4 0 748443885 935206912 172396 33554432000 4194304 4625164 140735175810848 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 228322 172396 346 106 0 223825 0
[pid=20599/tid=20600] ppid=20597 vsize=913288 CPUtime=654.07 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 57697 0 0 0 65393 14 0 0 25 0 4 0 748443886 935206912 172396 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=913288 CPUtime=620.7 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 79341 0 0 0 62047 23 0 0 25 0 4 0 748443886 935206912 172396 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352098 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=913288 CPUtime=739.39 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3198874 0 0 0 73414 525 0 0 25 0 4 0 748443886 935206912 172396 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2815.4
Current children cumulated vsize (KiB) 913288

[startup+942.301 s]
/proc/loadavg: 10.13 9.76 7.17 11/336 20671
/proc/meminfo: memFree=18020868/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=913288 CPUtime=2994.76 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 3645918 0 0 0 298863 613 0 0 25 0 4 0 748443885 935206912 176742 33554432000 4194304 4625164 140735175810848 18446744073709551615 4393124 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 228322 176742 345 106 0 223825 0
[pid=20599/tid=20600] ppid=20597 vsize=913288 CPUtime=690.85 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 58479 0 0 0 69070 15 0 0 25 0 4 0 748443886 935206912 176742 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=913288 CPUtime=673.41 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 80454 0 0 0 67317 24 0 0 25 0 4 0 748443886 935206912 176742 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=913288 CPUtime=769.26 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3369692 0 0 0 76377 549 0 0 25 0 4 0 748443886 935206912 176742 33554432000 4194304 4625164 140735175810848 18446744073709551615 4547431 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2994.76
Current children cumulated vsize (KiB) 913288

[startup+1002.3 s]
/proc/loadavg: 10.23 9.85 7.36 11/336 20673
/proc/meminfo: memFree=17783364/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=978824 CPUtime=3174.09 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 3810241 0 0 0 316770 639 0 0 25 0 4 0 748443885 1002315776 182141 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 244706 182141 345 106 0 240209 0
[pid=20599/tid=20600] ppid=20597 vsize=978824 CPUtime=725.23 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 59957 0 0 0 72507 16 0 0 25 0 4 0 748443886 1002315776 182141 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=978824 CPUtime=728.72 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 81742 0 0 0 72847 25 0 0 25 0 4 0 748443886 1002315776 182141 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=978824 CPUtime=798.9 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3530421 0 0 0 79318 572 0 0 25 0 4 0 748443886 1002315776 182143 33554432000 4194304 4625164 140735175810848 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3174.09
Current children cumulated vsize (KiB) 978824

[startup+1062.3 s]
/proc/loadavg: 10.08 9.87 7.52 11/336 20675
/proc/meminfo: memFree=17703188/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=1024652 CPUtime=3353.42 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 4005809 0 0 0 334668 674 0 0 25 0 4 0 748443885 1049243648 189339 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 256163 189339 345 106 0 251666 0
[pid=20599/tid=20600] ppid=20597 vsize=1024652 CPUtime=765.02 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 61254 0 0 0 76484 18 0 0 25 0 4 0 748443886 1049243648 189339 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=1024652 CPUtime=778.94 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 83865 0 0 0 77868 26 0 0 25 0 4 0 748443886 1049243648 189339 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=1024652 CPUtime=828.22 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3698122 0 0 0 82222 600 0 0 25 0 4 0 748443886 1049243648 189339 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339868 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3353.42
Current children cumulated vsize (KiB) 1024652

[startup+1122.3 s]
/proc/loadavg: 10.21 9.94 7.69 11/336 20676
/proc/meminfo: memFree=17660340/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=1024652 CPUtime=3532.74 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 4175251 0 0 0 352569 705 0 0 25 0 4 0 748443885 1049243648 194137 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 256163 194137 351 106 0 251666 0
[pid=20599/tid=20600] ppid=20597 vsize=1024652 CPUtime=809.31 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 62216 0 0 0 80912 19 0 0 25 0 4 0 748443886 1049243648 194137 33554432000 4194304 4625164 140735175810848 18446744073709551615 4339628 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=1024652 CPUtime=826.48 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 84641 0 0 0 82621 27 0 0 25 0 4 0 748443886 1049243648 194137 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=1024652 CPUtime=857.64 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 3864474 0 0 0 85135 629 0 0 25 0 4 0 748443886 1049243648 194137 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351958 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3532.74
Current children cumulated vsize (KiB) 1024652

[startup+1182.3 s]
/proc/loadavg: 10.22 9.98 7.84 11/336 20687
/proc/meminfo: memFree=17549700/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=1082372 CPUtime=3712.08 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 4373823 0 0 0 370469 739 0 0 25 0 4 0 748443885 1108348928 201581 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512190 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 270593 201581 345 106 0 266096 0
[pid=20599/tid=20600] ppid=20597 vsize=1082372 CPUtime=842.98 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 63198 0 0 0 84278 20 0 0 25 0 4 0 748443886 1108348928 201581 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=1082372 CPUtime=882.84 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 85904 0 0 0 88256 28 0 0 25 0 4 0 748443886 1108348928 201581 33554432000 4194304 4625164 140735175810848 18446744073709551615 4352855 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=1082372 CPUtime=886.95 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 4035277 0 0 0 88038 657 0 0 25 0 4 0 748443886 1108348928 201581 33554432000 4194304 4625164 140735175810848 18446744073709551615 260020093031 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3712.08
Current children cumulated vsize (KiB) 1082372

[startup+1242.3 s]
/proc/loadavg: 10.29 10.03 7.99 12/336 20688
/proc/meminfo: memFree=17352100/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=1082576 CPUtime=3891.4 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 4530553 0 0 0 388372 768 0 0 25 0 4 0 748443885 1108557824 206871 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 270644 206871 345 106 0 266147 0
[pid=20599/tid=20600] ppid=20597 vsize=1082576 CPUtime=890.3 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 64351 0 0 0 89008 22 0 0 25 0 4 0 748443886 1108557824 206871 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=1082576 CPUtime=926.27 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 86547 0 0 0 92597 30 0 0 25 0 4 0 748443886 1108557824 206871 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=1082576 CPUtime=915.9 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 4188765 0 0 0 90908 682 0 0 25 0 4 0 748443886 1108557824 206871 33554432000 4194304 4625164 140735175810848 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3891.4
Current children cumulated vsize (KiB) 1082576



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.22 10.05 8.12 11/336 20690
/proc/meminfo: memFree=17310488/32951124 swapFree=67083432/67111528
[pid=20599] ppid=20597 vsize=1149324 CPUtime=4063.88 cores=1,3,5,7
/proc/20599/stat : 20599 (SArTagnan) R 20597 20599 20571 0 -1 4202496 4681765 0 0 0 405596 792 0 0 25 0 4 0 748443885 1176907776 211743 33554432000 4194304 4625164 140735175810848 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/20599/statm: 287331 211743 345 106 0 282834 0
[pid=20599/tid=20600] ppid=20597 vsize=1149324 CPUtime=924.08 cores=1,3,5,7
/proc/20599/task/20600/stat : 20600 (SArTagnan) R 20597 20599 20571 0 -1 4202560 65266 0 0 0 92384 24 0 0 25 0 4 0 748443886 1176907776 211743 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20599/tid=20601] ppid=20597 vsize=1149324 CPUtime=978.77 cores=1,3,5,7
/proc/20599/task/20601/stat : 20601 (SArTagnan) R 20597 20599 20571 0 -1 4202560 87258 0 0 0 97846 31 0 0 25 0 4 0 748443886 1176907776 211743 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20599/tid=20602] ppid=20597 vsize=1149324 CPUtime=944.41 cores=1,3,5,7
/proc/20599/task/20602/stat : 20602 (SArTagnan) R 20597 20599 20571 0 -1 4202560 4336860 0 0 0 93737 704 0 0 25 0 4 0 748443886 1176907776 211743 33554432000 4194304 4625164 140735175810848 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4063.88
Current children cumulated vsize (KiB) 1149324

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.05
CPU time (s): 4063.94
CPU user time (s): 4055.98
CPU system time (s): 7.96079
CPU usage (%): 312.598
Max. virtual memory (cumulated for all children) (KiB): 1168436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4055.98
system time used= 7.96079
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4681765
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 672
involuntary context switches= 29643

runsolver used 4.06438 second user time and 10.0405 second system time

The end

Launcher Data 

Begin job on node110 at 2011-05-16 23:42:13
IDJOB=3386422
IDBENCH=83430
IDSOLVER=1871
FILE ID=node110/3386422-1305582133
RUNJOBID= node110-1305582132-20590
PBS_JOBID= 13350306
Free space on /tmp= 73504 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/32/aes_32_5_keyfind_1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386422-1305582133/watcher-3386422-1305582133 -o /tmp/evaluation-result-3386422-1305582133/solver-3386422-1305582133 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386422-1305582133.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3f4ea4cf17e734bbe947db7c1dc9fde7
RANDOM SEED=1854898254

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24371224 kB
Buffers:        290588 kB
Cached:        3221896 kB
SwapCached:       1416 kB
Active:        5089896 kB
Inactive:      3160204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24371224 kB
SwapTotal:    67111528 kB
SwapFree:     67083432 kB
Dirty:             448 kB
Writeback:           0 kB
AnonPages:     4735476 kB
Mapped:          27944 kB
Slab:           236080 kB
PageTables:      29244 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77241048 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node110 at 2011-05-17 00:03:55