Trace number 3290095

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.43 1201.78

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_2_keyfind_1.cnf
MD5SUM1024a3346322fdba0a20b51f99eae4c0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1000
Number of clauses5176
Sum of the clauses size20024
Maximum clause length5
Minimum clause length1
Number of clauses of size 1136
Number of clauses of size 2160
Number of clauses of size 32080
Number of clauses of size 4672
Number of clauses of size 52128
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290095-1304096589/watcher-3290095-1304096589 -o /tmp/evaluation-result-3290095-1304096589/solver-3290095-1304096589 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3290095-1304096589.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.10 5.63 6.99 2/176 3742
/proc/meminfo: memFree=30661208/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=50608 CPUtime=0 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 786 0 0 0 0 0 0 0 21 0 4 0 253850181 51822592 723 33554432000 4194304 4623224 140733945973648 18446744073709551615 47200839825330 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 12652 723 306 105 0 8156 0
[pid=3740/tid=3743] ppid=3738 vsize=50608 CPUtime=0 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 253850182 51822592 723 33554432000 4194304 4623224 140733945973648 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=50608 CPUtime=0 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 253850182 51822592 723 33554432000 4194304 4623224 140733945973648 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=50608 CPUtime=0 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 253850182 51822592 723 33554432000 4194304 4623224 140733945973648 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0

[startup+0.423506 s]
/proc/loadavg: 4.10 5.63 6.99 2/176 3742
/proc/meminfo: memFree=30661208/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=255420 CPUtime=3.25 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 9534 0 0 0 324 1 0 0 19 0 4 0 253850181 261550080 4116 33554432000 4194304 4623224 140733945973648 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 63855 4116 343 105 0 59359 0
[pid=3740/tid=3743] ppid=3738 vsize=255420 CPUtime=0.81 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1576 0 0 0 81 0 0 0 25 0 4 0 253850182 261550080 4116 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=255420 CPUtime=0.8 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1493 0 0 0 80 0 0 0 18 0 4 0 253850182 261550080 4116 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=255420 CPUtime=0.8 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 4106 0 0 0 80 0 0 0 19 0 4 0 253850182 261550080 4116 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.25
Current children cumulated vsize (KiB) 255420

[startup+0.91908 s]
/proc/loadavg: 4.10 5.63 6.99 2/176 3742
/proc/meminfo: memFree=30661208/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=255736 CPUtime=3.65 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 10094 0 0 0 364 1 0 0 19 0 4 0 253850181 261873664 4407 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510635 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 63934 4408 344 105 0 59438 0
[pid=3740/tid=3743] ppid=3738 vsize=255736 CPUtime=0.91 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1656 0 0 0 91 0 0 0 25 0 4 0 253850182 261873664 4408 33554432000 4194304 4623224 140733945973648 18446744073709551615 268660323361 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=255736 CPUtime=0.9 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1537 0 0 0 90 0 0 0 19 0 4 0 253850182 261873664 4408 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376883 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=255736 CPUtime=0.9 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 4515 0 0 0 90 0 0 0 19 0 4 0 253850182 261873664 4408 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376646 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.65
Current children cumulated vsize (KiB) 255736

[startup+1.00107 s]
/proc/loadavg: 4.10 5.63 6.99 2/176 3742
/proc/meminfo: memFree=30661208/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=255736 CPUtime=3.97 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 10826 0 0 0 396 1 0 0 19 0 4 0 253850181 261873664 4672 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510098 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 63934 4672 344 105 0 59438 0
[pid=3740/tid=3743] ppid=3738 vsize=255736 CPUtime=0.99 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1730 0 0 0 99 0 0 0 25 0 4 0 253850182 261873664 4672 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=255736 CPUtime=0.99 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1565 0 0 0 99 0 0 0 19 0 4 0 253850182 261873664 4672 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=255736 CPUtime=0.98 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 5125 0 0 0 98 0 0 0 19 0 4 0 253850182 261873664 4672 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.97
Current children cumulated vsize (KiB) 255736

[startup+1.10105 s]
/proc/loadavg: 4.10 5.63 6.99 2/176 3742
/proc/meminfo: memFree=30661208/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=257008 CPUtime=4.37 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 12405 0 0 0 436 1 0 0 19 0 4 0 253850181 263176192 4917 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 64252 4917 344 105 0 59756 0
[pid=3740/tid=3743] ppid=3738 vsize=257008 CPUtime=1.09 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1810 0 0 0 109 0 0 0 25 0 4 0 253850182 263176192 4917 33554432000 4194304 4623224 140733945973648 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=257008 CPUtime=1.08 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 1975 0 0 0 108 0 0 0 19 0 4 0 253850182 263176192 4917 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=257008 CPUtime=1.08 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 5951 0 0 0 108 0 0 0 19 0 4 0 253850182 263176192 4917 33554432000 4194304 4623224 140733945973648 18446744073709551615 4549260 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.37
Current children cumulated vsize (KiB) 257008

[startup+1.50098 s]
/proc/loadavg: 4.10 5.63 6.99 2/176 3742
/proc/meminfo: memFree=30661208/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=258192 CPUtime=5.97 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 17230 0 0 0 596 1 0 0 20 0 4 0 253850181 264388608 5829 33554432000 4194304 4623224 140733945973648 18446744073709551615 4327743 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 64548 5829 344 105 0 60052 0
[pid=3740/tid=3743] ppid=3738 vsize=258192 CPUtime=1.49 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 2442 0 0 0 149 0 0 0 25 0 4 0 253850182 264388608 5829 33554432000 4194304 4623224 140733945973648 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=258192 CPUtime=1.48 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 2214 0 0 0 148 0 0 0 20 0 4 0 253850182 264388608 5829 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=258192 CPUtime=1.49 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 9609 0 0 0 148 1 0 0 20 0 4 0 253850182 264388608 5829 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376883 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 258192

[startup+3.1007 s]
/proc/loadavg: 4.42 5.67 6.99 10/184 3750
/proc/meminfo: memFree=30593280/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=267012 CPUtime=12.36 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 33898 0 0 0 1232 4 0 0 25 0 4 0 253850181 273420288 9652 33554432000 4194304 4623224 140733945973648 18446744073709551615 4416149 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 66753 9652 344 105 0 62257 0
[pid=3740/tid=3743] ppid=3738 vsize=267012 CPUtime=3.08 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 5239 0 0 0 308 0 0 0 25 0 4 0 253850182 273420288 9652 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=267012 CPUtime=3.08 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 3749 0 0 0 308 0 0 0 25 0 4 0 253850182 273420288 9652 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=267012 CPUtime=3.07 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 21261 0 0 0 305 2 0 0 25 0 4 0 253850182 273420288 9652 33554432000 4194304 4623224 140733945973648 18446744073709551615 4549345 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 267012

[startup+6.30714 s]
/proc/loadavg: 4.70 5.71 7.00 10/184 3750
/proc/meminfo: memFree=30551664/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=269104 CPUtime=25.17 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 54515 0 0 0 2510 7 0 0 25 0 4 0 253850181 275562496 14700 33554432000 4194304 4623224 140733945973648 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 67276 14700 350 105 0 62780 0
[pid=3740/tid=3743] ppid=3738 vsize=269104 CPUtime=6.29 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 7831 0 0 0 628 1 0 0 25 0 4 0 253850182 275562496 14700 33554432000 4194304 4623224 140733945973648 18446744073709551615 4466432 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=269104 CPUtime=6.29 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 5689 0 0 0 629 0 0 0 25 0 4 0 253850182 275562496 14700 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=269104 CPUtime=6.26 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 35980 0 0 0 622 4 0 0 25 0 4 0 253850182 275562496 14700 33554432000 4194304 4623224 140733945973648 18446744073709551615 4330860 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.17
Current children cumulated vsize (KiB) 269104

[startup+12.701 s]
/proc/loadavg: 4.97 5.75 7.01 9/184 3750
/proc/meminfo: memFree=30482860/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=293200 CPUtime=50.71 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 97007 0 0 0 5058 13 0 0 25 0 4 0 253850181 300236800 25911 33554432000 4194304 4623224 140733945973648 18446744073709551615 4415995 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 73300 25911 396 105 0 68804 0
[pid=3740/tid=3743] ppid=3738 vsize=293200 CPUtime=12.68 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 16153 0 0 0 1266 2 0 0 20 0 4 0 253850182 300236800 25911 33554432000 4194304 4623224 140733945973648 18446744073709551615 4377451 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=293200 CPUtime=12.69 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 10979 0 0 0 1267 2 0 0 25 0 4 0 253850182 300236800 25911 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=293200 CPUtime=12.63 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 62817 0 0 0 1256 7 0 0 25 0 4 0 253850182 300236800 25911 33554432000 4194304 4623224 140733945973648 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 293200

[startup+25.5008 s]
/proc/loadavg: 5.43 5.82 7.02 10/184 3750
/proc/meminfo: memFree=30397408/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=301680 CPUtime=101.84 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 142142 0 0 0 10165 19 0 0 25 0 4 0 253850181 308920320 36427 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 75420 36427 491 105 0 70924 0
[pid=3740/tid=3743] ppid=3738 vsize=301680 CPUtime=25.48 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 17566 0 0 0 2546 2 0 0 25 0 4 0 253850182 308920320 36427 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=301680 CPUtime=25.49 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 15872 0 0 0 2546 3 0 0 25 0 4 0 253850182 308920320 36427 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376646 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=301680 CPUtime=25.35 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 98570 0 0 0 2524 11 0 0 25 0 4 0 253850182 308920320 36427 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 301680

[startup+51.1003 s]
/proc/loadavg: 6.47 6.03 7.05 10/184 3751
/proc/meminfo: memFree=30234324/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=325536 CPUtime=204.1 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 282660 0 0 0 20369 41 0 0 25 0 4 0 253850181 333348864 51115 33554432000 4194304 4623224 140733945973648 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 81384 51115 505 105 0 76888 0
[pid=3740/tid=3743] ppid=3738 vsize=325536 CPUtime=51.09 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 24257 0 0 0 5105 4 0 0 25 0 4 0 253850182 333348864 51115 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=325536 CPUtime=51.08 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 22351 0 0 0 5105 3 0 0 25 0 4 0 253850182 333348864 51115 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=325536 CPUtime=50.82 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 214430 0 0 0 5052 30 0 0 25 0 4 0 253850182 333348864 51115 33554432000 4194304 4623224 140733945973648 18446744073709551615 4354512 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 325536

[startup+102.3 s]
/proc/loadavg: 7.55 6.39 7.11 10/184 3752
/proc/meminfo: memFree=29997588/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=507452 CPUtime=408.62 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 408219 0 0 0 40796 66 0 0 25 0 4 0 253850181 519630848 78173 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 126863 78173 954 105 0 122367 0
[pid=3740/tid=3743] ppid=3738 vsize=507452 CPUtime=102.28 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 30060 0 0 0 10220 8 0 0 25 0 4 0 253850182 519630848 78173 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=507452 CPUtime=102.28 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 33742 0 0 0 10223 5 0 0 25 0 4 0 253850182 519630848 78173 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=507452 CPUtime=101.73 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 310519 0 0 0 10127 46 0 0 25 0 4 0 253850182 519630848 78173 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 507452

[startup+162.301 s]

################
# More data... #
################

[pid=3740] ppid=3738 vsize=1241144 CPUtime=2805.42 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 756509 0 0 0 280373 169 0 0 25 0 4 0 253850181 1270931456 250989 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 310286 250989 344 105 0 305790 0
[pid=3740/tid=3743] ppid=3738 vsize=1241144 CPUtime=702.29 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 139968 0 0 0 70176 53 0 0 25 0 4 0 253850182 1270931456 250989 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1241144 CPUtime=702.3 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 88094 0 0 0 70201 29 0 0 25 0 4 0 253850182 1270931456 250989 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1241144 CPUtime=698.49 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 365347 0 0 0 69791 58 0 0 25 0 4 0 253850182 1270931456 250989 33554432000 4194304 4623224 140733945973648 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2805.42
Current children cumulated vsize (KiB) 1241144

[startup+762.301 s]
/proc/loadavg: 8.04 7.86 7.57 10/184 3770
/proc/meminfo: memFree=28183880/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1470228 CPUtime=3045.06 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 849473 0 0 0 304322 184 0 0 25 0 4 0 253850181 1505513472 280214 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 367557 280214 344 105 0 363061 0
[pid=3740/tid=3743] ppid=3738 vsize=1470228 CPUtime=762.28 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 142800 0 0 0 76174 54 0 0 25 0 4 0 253850182 1505513472 280214 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1470228 CPUtime=762.29 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 121527 0 0 0 76196 33 0 0 25 0 4 0 253850182 1505513472 280214 33554432000 4194304 4623224 140733945973648 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1470228 CPUtime=758.16 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 375486 0 0 0 75755 61 0 0 25 0 4 0 253850182 1505513472 280214 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3045.06
Current children cumulated vsize (KiB) 1470228

[startup+822.301 s]
/proc/loadavg: 8.08 7.90 7.60 10/184 3772
/proc/meminfo: memFree=28007408/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1478344 CPUtime=3284.75 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 856440 0 0 0 328287 188 0 0 25 0 4 0 253850181 1513824256 287069 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 369586 287069 344 105 0 365090 0
[pid=3740/tid=3743] ppid=3738 vsize=1478344 CPUtime=822.28 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 145379 0 0 0 82172 56 0 0 25 0 4 0 253850182 1513824256 287069 33554432000 4194304 4623224 140733945973648 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1478344 CPUtime=822.29 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 122178 0 0 0 82195 34 0 0 25 0 4 0 253850182 1513824256 287069 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1478344 CPUtime=817.84 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 377688 0 0 0 81723 61 0 0 25 0 4 0 253850182 1513824256 287069 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.75
Current children cumulated vsize (KiB) 1478344

[startup+882.301 s]
/proc/loadavg: 8.07 7.93 7.63 10/184 3773
/proc/meminfo: memFree=27964360/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1540224 CPUtime=3524.42 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 889226 0 0 0 352248 194 0 0 25 0 4 0 253850181 1577189376 297304 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 385056 297304 344 105 0 380560 0
[pid=3740/tid=3743] ppid=3738 vsize=1540224 CPUtime=882.29 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 147804 0 0 0 88171 58 0 0 25 0 4 0 253850182 1577189376 297304 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1540224 CPUtime=882.29 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 122666 0 0 0 88195 34 0 0 25 0 4 0 253850182 1577189376 297304 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1540224 CPUtime=877.52 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 381897 0 0 0 87689 63 0 0 25 0 4 0 253850182 1577189376 297304 33554432000 4194304 4623224 140733945973648 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.42
Current children cumulated vsize (KiB) 1540224

[startup+942.301 s]
/proc/loadavg: 8.10 7.97 7.66 10/184 3775
/proc/meminfo: memFree=27891684/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1621096 CPUtime=3764.13 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 901103 0 0 0 376214 199 0 0 25 0 4 0 253850181 1660002304 308975 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 405274 308975 344 105 0 400778 0
[pid=3740/tid=3743] ppid=3738 vsize=1621096 CPUtime=942.29 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 149596 0 0 0 94169 60 0 0 25 0 4 0 253850182 1660002304 308975 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1621096 CPUtime=942.3 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 123316 0 0 0 94195 35 0 0 25 0 4 0 253850182 1660002304 308975 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1621096 CPUtime=937.19 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 385808 0 0 0 93656 63 0 0 25 0 4 0 253850182 1660002304 308975 33554432000 4194304 4623224 140733945973648 18446744073709551615 4577436 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3764.13
Current children cumulated vsize (KiB) 1621096

[startup+1002.3 s]
/proc/loadavg: 8.22 8.02 7.69 10/184 3776
/proc/meminfo: memFree=27843304/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1635648 CPUtime=4003.79 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 910751 0 0 0 400176 203 0 0 25 0 4 0 253850181 1674903552 318412 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 408912 318412 344 105 0 404416 0
[pid=3740/tid=3743] ppid=3738 vsize=1635648 CPUtime=1002.3 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 151488 0 0 0 100167 63 0 0 25 0 4 0 253850182 1674903552 318412 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1635648 CPUtime=1002.3 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 124282 0 0 0 100195 35 0 0 25 0 4 0 253850182 1674903552 318412 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1635648 CPUtime=996.86 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 389634 0 0 0 99622 64 0 0 25 0 4 0 253850182 1674903552 318412 33554432000 4194304 4623224 140733945973648 18446744073709551615 4549126 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.79
Current children cumulated vsize (KiB) 1635648

[startup+1062.31 s]
/proc/loadavg: 8.23 8.05 7.72 10/184 3778
/proc/meminfo: memFree=27771252/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1650876 CPUtime=4243.49 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 920380 0 0 0 424142 207 0 0 25 0 4 0 253850181 1690497024 327727 33554432000 4194304 4623224 140733945973648 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 412719 327727 344 105 0 408223 0
[pid=3740/tid=3743] ppid=3738 vsize=1650876 CPUtime=1062.3 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 153721 0 0 0 106165 65 0 0 25 0 4 0 253850182 1690497024 327727 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1650876 CPUtime=1062.3 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 125147 0 0 0 106194 36 0 0 25 0 4 0 253850182 1690497024 327727 33554432000 4194304 4623224 140733945973648 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1650876 CPUtime=1056.55 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 393561 0 0 0 105590 65 0 0 25 0 4 0 253850182 1690497024 327727 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.49
Current children cumulated vsize (KiB) 1650876

[startup+1122.3 s]
/proc/loadavg: 8.22 8.07 7.74 10/184 3780
/proc/meminfo: memFree=27687524/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1664964 CPUtime=4483.14 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 932015 0 0 0 448101 213 0 0 25 0 4 0 253850181 1704923136 339055 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 416241 339055 344 105 0 411745 0
[pid=3740/tid=3743] ppid=3738 vsize=1664964 CPUtime=1122.29 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 155692 0 0 0 112162 67 0 0 25 0 4 0 253850182 1704923136 339055 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1664964 CPUtime=1122.3 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 128213 0 0 0 112191 39 0 0 25 0 4 0 253850182 1704923136 339055 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1664964 CPUtime=1116.21 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 397292 0 0 0 111556 65 0 0 25 0 4 0 253850182 1704923136 339055 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4483.14
Current children cumulated vsize (KiB) 1664964

[startup+1182.3 s]
/proc/loadavg: 8.20 8.08 7.77 10/184 3781
/proc/meminfo: memFree=27595620/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1681096 CPUtime=4722.82 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 945007 0 0 0 472062 220 0 0 25 0 4 0 253850181 1721442304 350796 33554432000 4194304 4623224 140733945973648 18446744073709551615 4510217 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 420274 350796 344 105 0 415778 0
[pid=3740/tid=3743] ppid=3738 vsize=1681096 CPUtime=1182.3 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 157357 0 0 0 118161 69 0 0 25 0 4 0 253850182 1721442304 350796 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1681096 CPUtime=1182.3 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 131377 0 0 0 118188 42 0 0 25 0 4 0 253850182 1721442304 350796 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1681096 CPUtime=1175.88 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 401353 0 0 0 117522 66 0 0 25 0 4 0 253850182 1721442304 350796 33554432000 4194304 4623224 140733945973648 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.82
Current children cumulated vsize (KiB) 1681096



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.14 8.08 7.77 10/184 3782
/proc/meminfo: memFree=27536344/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1784868 CPUtime=4800.33 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 1005453 0 0 0 479805 228 0 0 25 0 4 0 253850181 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4517563 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 446217 359996 344 105 0 441721 0
[pid=3740/tid=3743] ppid=3738 vsize=1784868 CPUtime=1201.7 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 157921 0 0 0 120101 69 0 0 25 0 4 0 253850182 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1784868 CPUtime=1201.71 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 132113 0 0 0 120128 43 0 0 25 0 4 0 253850182 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1784868 CPUtime=1195.19 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 402494 0 0 0 119452 67 0 0 25 0 4 0 253850182 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 1784868

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.14 8.08 7.77 10/184 3782
/proc/meminfo: memFree=27536344/32951124 swapFree=67111524/67111528
[pid=3740] ppid=3738 vsize=1784868 CPUtime=4800.33 cores=0,2,4,6
/proc/3740/stat : 3740 (SArTagnan) R 3738 3740 2974 0 -1 4202496 1005453 0 0 0 479805 228 0 0 25 0 4 0 253850181 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4517563 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/3740/statm: 446217 359996 344 105 0 441721 0
[pid=3740/tid=3743] ppid=3738 vsize=1784868 CPUtime=1201.7 cores=0,2,4,6
/proc/3740/task/3743/stat : 3743 (SArTagnan) R 3738 3740 2974 0 -1 4202560 157921 0 0 0 120101 69 0 0 25 0 4 0 253850182 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=3740/tid=3744] ppid=3738 vsize=1784868 CPUtime=1201.71 cores=0,2,4,6
/proc/3740/task/3744/stat : 3744 (SArTagnan) R 3738 3740 2974 0 -1 4202560 132113 0 0 0 120128 43 0 0 25 0 4 0 253850182 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=3740/tid=3745] ppid=3738 vsize=1784868 CPUtime=1195.19 cores=0,2,4,6
/proc/3740/task/3745/stat : 3745 (SArTagnan) R 3738 3740 2974 0 -1 4202560 402494 0 0 0 119452 67 0 0 25 0 4 0 253850182 1827704832 359996 33554432000 4194304 4623224 140733945973648 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 1784868

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.78
CPU time (s): 4800.43
CPU user time (s): 4798.08
CPU system time (s): 2.35364
CPU usage (%): 399.444
Max. virtual memory (cumulated for all children) (KiB): 1977796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.08
system time used= 2.35364
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1005453
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2869
involuntary context switches= 37874

runsolver used 1.74073 second user time and 4.79227 second system time

The end

Launcher Data 

Begin job on node107 at 2011-04-29 19:03:09
IDJOB=3290095
IDBENCH=83418
IDSOLVER=1656
FILE ID=node107/3290095-1304096589
RUNJOBID= node107-1304096589-3723
PBS_JOBID= 13170575
Free space on /tmp= 71800 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_2_keyfind_1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290095-1304096589/watcher-3290095-1304096589 -o /tmp/evaluation-result-3290095-1304096589/solver-3290095-1304096589 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3290095-1304096589.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1024a3346322fdba0a20b51f99eae4c0
RANDOM SEED=1927378434

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30661528 kB
Buffers:        647400 kB
Cached:        1216284 kB
SwapCached:          4 kB
Active:         137176 kB
Inactive:      1789244 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30661528 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             832 kB
Writeback:           0 kB
AnonPages:       62528 kB
Mapped:          14488 kB
Slab:           300652 kB
PageTables:       4704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   183800 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71800 MiB
End job on node107 at 2011-04-29 19:23:13