Trace number 3290141

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.17 1201.66

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_1_keyfind_1.cnf
MD5SUM9e18e0ee8a56ea2c59fe8e682ff6c747
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark32.783
Satisfiable
(Un)Satisfiability was proved
Number of variables596
Number of clauses2780
Sum of the clauses size10460
Maximum clause length5
Minimum clause length1
Number of clauses of size 1132
Number of clauses of size 280
Number of clauses of size 31168
Number of clauses of size 4336
Number of clauses of size 51064
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290141-1304097121/watcher-3290141-1304097121 -o /tmp/evaluation-result-3290141-1304097121/solver-3290141-1304097121 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3290141-1304097121.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.18 8.15 8.07 5/180 723
/proc/meminfo: memFree=21236668/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=18484 CPUtime=0 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 439 0 0 0 0 0 0 0 25 0 1 0 521310891 18927616 377 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272385803 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/723/statm: 4621 380 300 105 0 125 0
[pid=723/tid=724] ppid=721 vsize=49972 CPUtime=0 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 521310891 51171328 562 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272745457 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=723/tid=725] ppid=721 vsize=49972 CPUtime=0 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 521310891 51171328 562 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272745457 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=723/tid=726] ppid=721 vsize=49972 CPUtime=0 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 521310891 51171328 562 33554432000 4194304 4623224 140735493659552 18446744073709551615 268267720936 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.132256 s]
/proc/loadavg: 8.18 8.15 8.07 5/180 723
/proc/meminfo: memFree=21236668/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=249008 CPUtime=0.5 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 2195 0 0 0 50 0 0 0 25 0 4 0 521310891 254984192 1519 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272356310 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 62252 1519 343 105 0 57756 0
[pid=723/tid=724] ppid=721 vsize=249008 CPUtime=0.12 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 289 0 0 0 12 0 0 0 25 0 4 0 521310891 254984192 1519 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=249008 CPUtime=0.12 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 337 0 0 0 12 0 0 0 25 0 4 0 521310891 254984192 1519 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376634 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=249008 CPUtime=0.12 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 340 0 0 0 12 0 0 0 25 0 4 0 521310891 254984192 1519 33554432000 4194304 4623224 140735493659552 18446744073709551615 4560264 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 249008

[startup+0.200245 s]
/proc/loadavg: 8.18 8.15 8.07 5/180 723
/proc/meminfo: memFree=21236668/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=249568 CPUtime=0.77 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 2994 0 0 0 77 0 0 0 25 0 4 0 521310891 255557632 1877 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510026 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 62392 1877 343 105 0 57896 0
[pid=723/tid=724] ppid=721 vsize=249568 CPUtime=0.19 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 448 0 0 0 19 0 0 0 25 0 4 0 521310891 255557632 1877 33554432000 4194304 4623224 140735493659552 18446744073709551615 4485214 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=249568 CPUtime=0.19 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 600 0 0 0 19 0 0 0 25 0 4 0 521310891 255557632 1877 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=249568 CPUtime=0.19 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 625 0 0 0 19 0 0 0 25 0 4 0 521310891 255557632 1878 33554432000 4194304 4623224 140735493659552 18446744073709551615 4550420 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 249568

[startup+0.300227 s]
/proc/loadavg: 8.18 8.15 8.07 5/180 723
/proc/meminfo: memFree=21236668/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=249760 CPUtime=1.17 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 3653 0 0 0 117 0 0 0 25 0 4 0 521310891 255754240 2096 33554432000 4194304 4623224 140735493659552 18446744073709551615 4384421 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 62440 2096 343 105 0 57944 0
[pid=723/tid=724] ppid=721 vsize=249760 CPUtime=0.29 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 565 0 0 0 29 0 0 0 25 0 4 0 521310891 255754240 2096 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=249760 CPUtime=0.29 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 816 0 0 0 29 0 0 0 25 0 4 0 521310891 255754240 2096 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=249760 CPUtime=0.29 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 920 0 0 0 29 0 0 0 25 0 4 0 521310891 255754240 2096 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376714 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 249760

[startup+0.701158 s]
/proc/loadavg: 8.18 8.15 8.07 5/180 723
/proc/meminfo: memFree=21236668/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=251844 CPUtime=2.78 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 7792 0 0 0 277 1 0 0 25 0 4 0 521310891 257888256 3229 33554432000 4194304 4623224 140735493659552 18446744073709551615 4517548 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 62961 3229 343 105 0 58465 0
[pid=723/tid=724] ppid=721 vsize=251844 CPUtime=0.69 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 1261 0 0 0 69 0 0 0 25 0 4 0 521310891 257888256 3229 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=251844 CPUtime=0.69 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 1315 0 0 0 69 0 0 0 25 0 4 0 521310891 257888256 3229 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=251844 CPUtime=0.68 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 3555 0 0 0 68 0 0 0 25 0 4 0 521310891 257888256 3229 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272356314 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 251844

[startup+1.50102 s]
/proc/loadavg: 8.24 8.16 8.07 9/184 727
/proc/meminfo: memFree=21217920/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=256860 CPUtime=5.97 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 15264 0 0 0 595 2 0 0 25 0 4 0 521310891 263024640 5087 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 64215 5088 343 105 0 59719 0
[pid=723/tid=724] ppid=721 vsize=256860 CPUtime=1.48 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 2095 0 0 0 148 0 0 0 25 0 4 0 521310891 263024640 5088 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376855 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=256860 CPUtime=1.48 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 2039 0 0 0 148 0 0 0 25 0 4 0 521310891 263024640 5088 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=256860 CPUtime=1.48 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 9028 0 0 0 148 0 0 0 25 0 4 0 521310891 263024640 5088 33554432000 4194304 4623224 140735493659552 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 256860

[startup+3.10073 s]
/proc/loadavg: 8.24 8.16 8.07 9/184 727
/proc/meminfo: memFree=21210984/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=262400 CPUtime=12.36 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 21372 0 0 0 1232 4 0 0 25 0 4 0 521310891 268697600 7702 33554432000 4194304 4623224 140735493659552 18446744073709551615 4414815 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 65600 7702 346 105 0 61104 0
[pid=723/tid=724] ppid=721 vsize=262400 CPUtime=3.08 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 3593 0 0 0 307 1 0 0 25 0 4 0 521310891 268697600 7702 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376773 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=262400 CPUtime=3.07 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 3207 0 0 0 307 0 0 0 25 0 4 0 521310891 268697600 7703 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376757 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=262400 CPUtime=3.09 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 11789 0 0 0 308 1 0 0 25 0 4 0 521310891 268697600 7703 33554432000 4194304 4623224 140735493659552 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 262400

[startup+6.30116 s]
/proc/loadavg: 8.24 8.16 8.07 9/184 727
/proc/meminfo: memFree=21192508/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=268704 CPUtime=25.14 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 32265 0 0 0 2508 6 0 0 21 0 4 0 521310891 275152896 11117 33554432000 4194304 4623224 140735493659552 18446744073709551615 4517413 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 67176 11117 357 105 0 62680 0
[pid=723/tid=724] ppid=721 vsize=268704 CPUtime=6.29 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 5648 0 0 0 627 2 0 0 25 0 4 0 521310891 275152896 11117 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=268704 CPUtime=6.25 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 4758 0 0 0 625 0 0 0 25 0 4 0 521310891 275152896 11117 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=268704 CPUtime=6.29 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 18015 0 0 0 627 2 0 0 25 0 4 0 521310891 275152896 11117 33554432000 4194304 4623224 140735493659552 18446744073709551615 4577474 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 268704

[startup+12.701 s]
/proc/loadavg: 8.20 8.16 8.07 9/184 727
/proc/meminfo: memFree=21162884/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=280372 CPUtime=50.71 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 58371 0 0 0 5060 11 0 0 25 0 4 0 521310891 287100928 15951 33554432000 4194304 4623224 140735493659552 18446744073709551615 4366412 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 70093 15951 347 105 0 65597 0
[pid=723/tid=724] ppid=721 vsize=280372 CPUtime=12.68 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 8142 0 0 0 1266 2 0 0 25 0 4 0 521310891 287100928 15951 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272732343 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=280372 CPUtime=12.62 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 7360 0 0 0 1261 1 0 0 25 0 4 0 521310891 287100928 15951 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=280372 CPUtime=12.69 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 38073 0 0 0 1264 5 0 0 25 0 4 0 521310891 287100928 15951 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 280372

[startup+25.5007 s]
/proc/loadavg: 8.17 8.15 8.07 9/184 728
/proc/meminfo: memFree=21126064/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=297872 CPUtime=101.83 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 126585 0 0 0 10159 24 0 0 25 0 4 0 521310891 305020928 22347 33554432000 4194304 4623224 140735493659552 18446744073709551615 4384653 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 74468 22347 344 105 0 69972 0
[pid=723/tid=724] ppid=721 vsize=297872 CPUtime=25.49 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 12923 0 0 0 2545 4 0 0 25 0 4 0 521310891 305020928 22347 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=297872 CPUtime=25.34 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 11159 0 0 0 2532 2 0 0 25 0 4 0 521310891 305020928 22347 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=297872 CPUtime=25.48 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 96012 0 0 0 2533 15 0 0 25 0 4 0 521310891 305020928 22347 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376832 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 297872

[startup+51.1012 s]
/proc/loadavg: 8.17 8.15 8.07 9/184 728
/proc/meminfo: memFree=21060796/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=332892 CPUtime=204.1 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 301950 0 0 0 20355 55 0 0 25 0 4 0 521310891 340881408 33947 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 83223 33947 535 105 0 78727 0
[pid=723/tid=724] ppid=721 vsize=332892 CPUtime=51.08 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 17666 0 0 0 5103 5 0 0 25 0 4 0 521310891 340881408 33947 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=332892 CPUtime=50.81 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 17451 0 0 0 5077 4 0 0 25 0 4 0 521310891 340881408 33947 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=332892 CPUtime=51.09 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 255962 0 0 0 5066 43 0 0 25 0 4 0 521310891 340881408 33947 33554432000 4194304 4623224 140735493659552 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 332892

[startup+102.301 s]
/proc/loadavg: 8.17 8.15 8.08 9/184 730
/proc/meminfo: memFree=20931820/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=406872 CPUtime=408.63 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 509935 0 0 0 40770 93 0 0 25 0 4 0 521310891 416636928 57059 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 101718 57059 981 105 0 97222 0
[pid=723/tid=724] ppid=721 vsize=406872 CPUtime=102.29 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 24309 0 0 0 10223 6 0 0 25 0 4 0 521310891 416636928 57059 33554432000 4194304 4623224 140735493659552 18446744073709551615 4278645 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=406872 CPUtime=101.73 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 27399 0 0 0 10167 6 0 0 25 0 4 0 521310891 416636928 57059 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=406872 CPUtime=102.29 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 433534 0 0 0 10154 75 0 0 25 0 4 0 521310891 416636928 57059 33554432000 4194304 4623224 140735493659552 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 406872

[startup+162.3 s]

################
# More data... #
################

[pid=723] ppid=721 vsize=986776 CPUtime=2805.42 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1792851 0 0 0 280207 335 0 0 25 0 4 0 521310891 1010458624 179697 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 246694 179697 719 105 0 242198 0
[pid=723/tid=724] ppid=721 vsize=986776 CPUtime=702.3 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 80279 0 0 0 70211 19 0 0 25 0 4 0 521310891 1010458624 179697 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=986776 CPUtime=698.48 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 89408 0 0 0 69815 33 0 0 25 0 4 0 521310891 1010458624 179697 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=986776 CPUtime=702.3 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1468704 0 0 0 69975 255 0 0 25 0 4 0 521310891 1010458624 179697 33554432000 4194304 4623224 140735493659552 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2805.42
Current children cumulated vsize (KiB) 986776

[startup+762.301 s]
/proc/loadavg: 4.11 5.85 7.15 5/175 766
/proc/meminfo: memFree=21403312/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=992172 CPUtime=3045.11 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1826158 0 0 0 304165 346 0 0 25 0 4 0 521310891 1015984128 188317 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 248043 188317 719 105 0 243547 0
[pid=723/tid=724] ppid=721 vsize=992172 CPUtime=762.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 82903 0 0 0 76211 20 0 0 25 0 4 0 521310891 1015984128 188317 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=992172 CPUtime=758.17 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 90284 0 0 0 75780 37 0 0 25 0 4 0 521310891 1015984128 188317 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=992172 CPUtime=762.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1470325 0 0 0 75975 256 0 0 25 0 4 0 521310891 1015984128 188317 33554432000 4194304 4623224 140735493659552 18446744073709551615 268272347273 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3045.11
Current children cumulated vsize (KiB) 992172

[startup+822.301 s]
/proc/loadavg: 4.04 5.51 6.95 5/175 768
/proc/meminfo: memFree=21379708/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=992172 CPUtime=3284.8 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1862062 0 0 0 328123 357 0 0 25 0 4 0 521310891 1015984128 194066 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 248043 194066 660 105 0 243547 0
[pid=723/tid=724] ppid=721 vsize=992172 CPUtime=822.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 84612 0 0 0 82210 21 0 0 25 0 4 0 521310891 1015984128 194066 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=992172 CPUtime=817.85 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 91058 0 0 0 81746 39 0 0 25 0 4 0 521310891 1015984128 194066 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=992172 CPUtime=822.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1483751 0 0 0 81973 258 0 0 25 0 4 0 521310891 1015984128 194066 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.8
Current children cumulated vsize (KiB) 992172

[startup+882.306 s]
/proc/loadavg: 4.09 5.25 6.77 5/175 770
/proc/meminfo: memFree=21367012/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=993212 CPUtime=3524.52 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1865979 0 0 0 352092 360 0 0 25 0 4 0 521310891 1017049088 197318 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 248303 197318 635 105 0 243807 0
[pid=723/tid=724] ppid=721 vsize=993212 CPUtime=882.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 85624 0 0 0 88208 23 0 0 25 0 4 0 521310891 1017049088 197318 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377056 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=993212 CPUtime=877.55 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 91914 0 0 0 87715 40 0 0 25 0 4 0 521310891 1017049088 197318 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=993212 CPUtime=882.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1484238 0 0 0 87973 258 0 0 25 0 4 0 521310891 1017049088 197318 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.52
Current children cumulated vsize (KiB) 993212

[startup+942.301 s]
/proc/loadavg: 4.10 5.04 6.60 5/175 771
/proc/meminfo: memFree=21346128/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1002952 CPUtime=3764.2 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1878951 0 0 0 376054 366 0 0 25 0 4 0 521310891 1027022848 202496 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 250738 202496 635 105 0 246242 0
[pid=723/tid=724] ppid=721 vsize=1002952 CPUtime=942.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 86506 0 0 0 94205 26 0 0 25 0 4 0 521310891 1027022848 202496 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1002952 CPUtime=937.24 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 92104 0 0 0 93684 40 0 0 25 0 4 0 521310891 1027022848 202496 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1002952 CPUtime=942.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1486660 0 0 0 93972 259 0 0 25 0 4 0 521310891 1027022848 202496 33554432000 4194304 4623224 140735493659552 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3764.2
Current children cumulated vsize (KiB) 1002952

[startup+1002.3 s]
/proc/loadavg: 4.03 4.84 6.43 5/175 773
/proc/meminfo: memFree=21315968/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1057344 CPUtime=4003.9 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1933082 0 0 0 400010 380 0 0 25 0 4 0 521310891 1082720256 209989 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 264336 209989 635 105 0 259840 0
[pid=723/tid=724] ppid=721 vsize=1057344 CPUtime=1002.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 87931 0 0 0 100202 29 0 0 25 0 4 0 521310891 1082720256 209989 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1057344 CPUtime=996.95 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 92937 0 0 0 99654 41 0 0 25 0 4 0 521310891 1082720256 209989 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1057344 CPUtime=1002.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1488806 0 0 0 99972 259 0 0 25 0 4 0 521310891 1082720256 209989 33554432000 4194304 4623224 140735493659552 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.9
Current children cumulated vsize (KiB) 1057344

[startup+1062.3 s]
/proc/loadavg: 4.01 4.69 6.27 5/175 774
/proc/meminfo: memFree=21279728/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1112316 CPUtime=4243.6 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 1996191 0 0 0 423964 396 0 0 25 0 4 0 521310891 1139011584 219099 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 278079 219099 635 105 0 273583 0
[pid=723/tid=724] ppid=721 vsize=1112316 CPUtime=1062.3 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 88665 0 0 0 106199 31 0 0 25 0 4 0 521310891 1139011584 219099 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1112316 CPUtime=1056.63 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 93173 0 0 0 105622 41 0 0 25 0 4 0 521310891 1139011584 219099 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1112316 CPUtime=1062.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1491194 0 0 0 105971 260 0 0 25 0 4 0 521310891 1139011584 219099 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.6
Current children cumulated vsize (KiB) 1112316

[startup+1122.3 s]
/proc/loadavg: 4.06 4.58 6.13 5/175 776
/proc/meminfo: memFree=21263192/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1120088 CPUtime=4483.29 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 2030050 0 0 0 447924 405 0 0 25 0 4 0 521310891 1146970112 223222 33554432000 4194304 4623224 140735493659552 18446744073709551615 4414904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 280022 223222 635 105 0 275526 0
[pid=723/tid=724] ppid=721 vsize=1120088 CPUtime=1122.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 89705 0 0 0 112198 33 0 0 25 0 4 0 521310891 1146970112 223222 33554432000 4194304 4623224 140735493659552 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1120088 CPUtime=1116.32 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 93334 0 0 0 111591 41 0 0 25 0 4 0 521310891 1146970112 223222 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1120088 CPUtime=1122.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1493375 0 0 0 111970 261 0 0 25 0 4 0 521310891 1146970112 223222 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376708 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4483.29
Current children cumulated vsize (KiB) 1120088

[startup+1182.3 s]
/proc/loadavg: 4.07 4.48 6.00 5/175 778
/proc/meminfo: memFree=21229676/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1247516 CPUtime=4722.99 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 2092527 0 0 0 471881 418 0 0 25 0 4 0 521310891 1277456384 231693 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 311879 231693 635 105 0 307383 0
[pid=723/tid=724] ppid=721 vsize=1247516 CPUtime=1182.31 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 118124 0 0 0 118192 39 0 0 25 0 4 0 521310891 1277456384 231693 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1247516 CPUtime=1176.02 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 93661 0 0 0 117560 42 0 0 25 0 4 0 521310891 1277456384 231693 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1247516 CPUtime=1182.31 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1495853 0 0 0 117969 262 0 0 25 0 4 0 521310891 1277456384 231693 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.99
Current children cumulated vsize (KiB) 1247516



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 4.05 4.45 5.96 5/175 778
/proc/meminfo: memFree=21220488/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1251244 CPUtime=4800.09 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 2105518 0 0 0 479586 423 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 312811 233806 635 105 0 308315 0
[pid=723/tid=724] ppid=721 vsize=1251244 CPUtime=1201.62 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 118369 0 0 0 120121 41 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376617 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1251244 CPUtime=1195.21 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 93824 0 0 0 119479 42 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1251244 CPUtime=1201.62 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1496723 0 0 0 119900 262 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 1251244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.6 s]
/proc/loadavg: 4.05 4.45 5.96 5/175 778
/proc/meminfo: memFree=21220488/32950928 swapFree=67111524/67111528
[pid=723] ppid=721 vsize=1251244 CPUtime=4800.09 cores=1,3,5,7
/proc/723/stat : 723 (SArTagnan) R 721 723 384 0 -1 4202496 2105518 0 0 0 479586 423 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/723/statm: 312811 233806 635 105 0 308315 0
[pid=723/tid=724] ppid=721 vsize=1251244 CPUtime=1201.62 cores=1,3,5,7
/proc/723/task/724/stat : 724 (SArTagnan) R 721 723 384 0 -1 4202560 118369 0 0 0 120121 41 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376617 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=723/tid=725] ppid=721 vsize=1251244 CPUtime=1195.21 cores=1,3,5,7
/proc/723/task/725/stat : 725 (SArTagnan) R 721 723 384 0 -1 4202560 93824 0 0 0 119479 42 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=723/tid=726] ppid=721 vsize=1251244 CPUtime=1201.62 cores=1,3,5,7
/proc/723/task/726/stat : 726 (SArTagnan) R 721 723 384 0 -1 4202560 1496723 0 0 0 119900 262 0 0 25 0 4 0 521310891 1281273856 233806 33554432000 4194304 4623224 140735493659552 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 1251244

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.66
CPU time (s): 4800.17
CPU user time (s): 4795.9
CPU system time (s): 4.27535
CPU usage (%): 399.463
Max. virtual memory (cumulated for all children) (KiB): 1347420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.9
system time used= 4.27535
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2105518
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 343
involuntary context switches= 24633

runsolver used 1.83372 second user time and 4.55131 second system time

The end

Launcher Data 

Begin job on node122 at 2011-04-29 19:12:01
IDJOB=3290141
IDBENCH=83420
IDSOLVER=1656
FILE ID=node122/3290141-1304097121
RUNJOBID= node122-1304094031-403
PBS_JOBID= 13170588
Free space on /tmp= 71664 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_1_keyfind_1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290141-1304097121/watcher-3290141-1304097121 -o /tmp/evaluation-result-3290141-1304097121/solver-3290141-1304097121 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3290141-1304097121.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9e18e0ee8a56ea2c59fe8e682ff6c747
RANDOM SEED=199364841

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      21236824 kB
Buffers:       1629584 kB
Cached:        8552980 kB
SwapCached:          4 kB
Active:        2014700 kB
Inactive:      9149464 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      21236824 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             432 kB
Writeback:           0 kB
AnonPages:      981244 kB
Mapped:          15652 kB
Slab:           485968 kB
PageTables:       6228 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1243648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71664 MiB
End job on node122 at 2011-04-29 19:32:05