Trace number 3386053

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.52 1204.87

General information on the benchmark

NameSAT05/crafted/sorge05/QG7/
gensys-icl007.shuffled-as.sat05-3133.cnf
MD5SUM88361752c7b0c05e849791aafdd7bdba
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark220.275
Satisfiable
(Un)Satisfiability was proved
Number of variables762
Number of clauses17262
Sum of the clauses size76511
Maximum clause length13
Minimum clause length1
Number of clauses of size 142
Number of clauses of size 21135
Number of clauses of size 38742
Number of clauses of size 4236
Number of clauses of size 5256
Number of clauses of size over 56851

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386053-1305583339/watcher-3386053-1305583339 -o /tmp/evaluation-result-3386053-1305583339/solver-3386053-1305583339 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386053-1305583339.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.09 8.98 7.39 6/482 1722
/proc/meminfo: memFree=11023712/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=19256 CPUtime=0 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 559 0 0 0 0 0 0 0 23 0 1 0 748564563 19718144 498 33554432000 4194304 4625164 140736525880464 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1722/statm: 4814 498 299 106 0 317 0
[pid=1722/tid=1723] ppid=1720 vsize=53548 CPUtime=0 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 748564565 54833152 1285 33554432000 4194304 4625164 140736525880464 18446744073709551615 216735235057 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=53548 CPUtime=0 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 748564565 54833152 1285 33554432000 4194304 4625164 140736525880464 18446744073709551615 216735235057 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=53548 CPUtime=0 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 748564565 54833152 1285 33554432000 4194304 4625164 140736525880464 18446744073709551615 216735235057 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.100906 s]
/proc/loadavg: 9.09 8.98 7.39 6/482 1722
/proc/meminfo: memFree=11023712/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=186200 CPUtime=0.33 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 2935 0 0 0 33 0 0 0 25 0 4 0 748564563 190668800 1919 33554432000 4194304 4625164 140736525880464 18446744073709551615 4329101 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 46550 1919 339 106 0 42053 0
[pid=1722/tid=1723] ppid=1720 vsize=186200 CPUtime=0.07 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 188 0 0 0 7 0 0 0 25 0 4 0 748564565 190668800 1919 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=186200 CPUtime=0.07 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 183 0 0 0 7 0 0 0 25 0 4 0 748564565 190668800 1919 33554432000 4194304 4625164 140736525880464 18446744073709551615 4465125 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=186200 CPUtime=0.08 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 355 0 0 0 8 0 0 0 25 0 4 0 748564565 190668800 1919 33554432000 4194304 4625164 140736525880464 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.33
Current children cumulated vsize (KiB) 186200

[startup+0.200889 s]
/proc/loadavg: 9.09 8.98 7.39 6/482 1722
/proc/meminfo: memFree=11023712/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=186680 CPUtime=0.73 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 3748 0 0 0 73 0 0 0 25 0 4 0 748564563 191160320 2331 33554432000 4194304 4625164 140736525880464 18446744073709551615 4513915 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 46670 2331 339 106 0 42173 0
[pid=1722/tid=1723] ppid=1720 vsize=186680 CPUtime=0.17 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 404 0 0 0 17 0 0 0 25 0 4 0 748564565 191160320 2331 33554432000 4194304 4625164 140736525880464 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=186680 CPUtime=0.17 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 244 0 0 0 17 0 0 0 25 0 4 0 748564565 191160320 2331 33554432000 4194304 4625164 140736525880464 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=186680 CPUtime=0.18 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 883 0 0 0 18 0 0 0 25 0 4 0 748564565 191160320 2331 33554432000 4194304 4625164 140736525880464 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.73
Current children cumulated vsize (KiB) 186680

[startup+0.30087 s]
/proc/loadavg: 9.09 8.98 7.39 6/482 1722
/proc/meminfo: memFree=11023712/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=187392 CPUtime=1.13 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 4439 0 0 0 113 0 0 0 25 0 4 0 748564563 191889408 2648 33554432000 4194304 4625164 140736525880464 18446744073709551615 4509061 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 46848 2648 339 106 0 42351 0
[pid=1722/tid=1723] ppid=1720 vsize=187392 CPUtime=0.27 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 444 0 0 0 27 0 0 0 25 0 4 0 748564565 191889408 2648 33554432000 4194304 4625164 140736525880464 18446744073709551615 4487056 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=187392 CPUtime=0.27 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 445 0 0 0 27 0 0 0 25 0 4 0 748564565 191889408 2648 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=187392 CPUtime=0.28 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 1328 0 0 0 28 0 0 0 25 0 4 0 748564565 191889408 2648 33554432000 4194304 4625164 140736525880464 18446744073709551615 4579442 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 187392

[startup+0.700802 s]
/proc/loadavg: 9.09 8.98 7.39 6/482 1722
/proc/meminfo: memFree=11023712/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=253872 CPUtime=2.73 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 6844 0 0 0 273 0 0 0 25 0 4 0 748564563 259964928 3823 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512857 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 63468 3823 345 106 0 58971 0
[pid=1722/tid=1723] ppid=1720 vsize=253872 CPUtime=0.67 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 875 0 0 0 67 0 0 0 25 0 4 0 748564565 259964928 3823 33554432000 4194304 4625164 140736525880464 18446744073709551615 4291804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=253872 CPUtime=0.67 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 847 0 0 0 67 0 0 0 25 0 4 0 748564565 259964928 3823 33554432000 4194304 4625164 140736525880464 18446744073709551615 4292316 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=253872 CPUtime=0.67 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2534 0 0 0 67 0 0 0 25 0 4 0 748564565 259964928 3823 33554432000 4194304 4625164 140736525880464 18446744073709551615 4562639 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 253872

[startup+1.50066 s]
/proc/loadavg: 9.09 8.98 7.39 10/486 1726
/proc/meminfo: memFree=11004860/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=257860 CPUtime=5.91 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 9225 0 0 0 591 0 0 0 25 0 4 0 748564563 264048640 5448 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512075 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 64465 5448 345 106 0 59968 0
[pid=1722/tid=1723] ppid=1720 vsize=257860 CPUtime=1.47 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 1743 0 0 0 147 0 0 0 25 0 4 0 748564565 264048640 5448 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=257860 CPUtime=1.47 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 1616 0 0 0 147 0 0 0 25 0 4 0 748564565 264048640 5448 33554432000 4194304 4625164 140736525880464 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=257860 CPUtime=1.46 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 3164 0 0 0 146 0 0 0 25 0 4 0 748564565 264048640 5448 33554432000 4194304 4625164 140736525880464 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 257860

[startup+3.10038 s]
/proc/loadavg: 9.08 8.98 7.40 10/486 1726
/proc/meminfo: memFree=10996924/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=262864 CPUtime=12.3 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 18038 0 0 0 1228 2 0 0 25 0 4 0 748564563 269172736 8190 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 65716 8190 347 106 0 61219 0
[pid=1722/tid=1723] ppid=1720 vsize=262864 CPUtime=3.07 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2955 0 0 0 307 0 0 0 25 0 4 0 748564565 269172736 8191 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351878 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=262864 CPUtime=3.07 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2823 0 0 0 307 0 0 0 25 0 4 0 748564565 269172736 8191 33554432000 4194304 4625164 140736525880464 18446744073709551615 216734839493 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=262864 CPUtime=3.04 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 8974 0 0 0 303 1 0 0 25 0 4 0 748564565 269172736 8191 33554432000 4194304 4625164 140736525880464 18446744073709551615 4547594 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 262864

[startup+6.30083 s]
/proc/loadavg: 9.08 8.98 7.40 10/486 1726
/proc/meminfo: memFree=10979688/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=271492 CPUtime=25.04 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 42307 0 0 0 2499 5 0 0 25 0 4 0 748564563 278007808 11904 33554432000 4194304 4625164 140736525880464 18446744073709551615 4511906 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 67873 11904 347 106 0 63376 0
[pid=1722/tid=1723] ppid=1720 vsize=271492 CPUtime=6.26 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 4643 0 0 0 626 0 0 0 25 0 4 0 748564565 278007808 11904 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352765 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=271492 CPUtime=6.27 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 4628 0 0 0 626 1 0 0 25 0 4 0 748564565 278007808 11904 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=271492 CPUtime=6.19 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 28757 0 0 0 616 3 0 0 25 0 4 0 748564565 278007808 11904 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.04
Current children cumulated vsize (KiB) 271492

[startup+12.7007 s]
/proc/loadavg: 9.14 8.99 7.42 10/486 1726
/proc/meminfo: memFree=10955992/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=281704 CPUtime=50.54 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 83906 0 0 0 5043 11 0 0 25 0 4 0 748564563 288464896 16717 33554432000 4194304 4625164 140736525880464 18446744073709551615 4519372 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 70426 16717 352 106 0 65929 0
[pid=1722/tid=1723] ppid=1720 vsize=281704 CPUtime=12.67 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 7225 0 0 0 1265 2 0 0 25 0 4 0 748564565 288464896 16717 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=281704 CPUtime=12.67 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 7155 0 0 0 1265 2 0 0 25 0 4 0 748564565 288464896 16717 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=281704 CPUtime=12.48 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 64370 0 0 0 1242 6 0 0 25 0 4 0 748564565 288464896 16717 33554432000 4194304 4625164 140736525880464 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.54
Current children cumulated vsize (KiB) 281704

[startup+25.5005 s]
/proc/loadavg: 9.19 9.01 7.44 10/486 1726
/proc/meminfo: memFree=10929832/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=289340 CPUtime=101.53 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 113273 0 0 0 10135 18 0 0 25 0 4 0 748564563 296284160 21995 33554432000 4194304 4625164 140736525880464 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 72335 21995 346 106 0 67838 0
[pid=1722/tid=1723] ppid=1720 vsize=289340 CPUtime=25.47 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 10670 0 0 0 2545 2 0 0 25 0 4 0 748564565 296284160 21995 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=289340 CPUtime=25.47 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 8799 0 0 0 2543 4 0 0 25 0 4 0 748564565 296284160 21995 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=289340 CPUtime=25.09 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 87651 0 0 0 2498 11 0 0 25 0 4 0 748564565 296284160 21995 33554432000 4194304 4625164 140736525880464 18446744073709551615 4579312 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.53
Current children cumulated vsize (KiB) 289340

[startup+51.101 s]
/proc/loadavg: 9.13 9.01 7.48 10/486 1727
/proc/meminfo: memFree=10874504/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=299104 CPUtime=203.55 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 253127 0 0 0 20315 40 0 0 25 0 4 0 748564563 306282496 33776 33554432000 4194304 4625164 140736525880464 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 74776 33776 375 106 0 70279 0
[pid=1722/tid=1723] ppid=1720 vsize=299104 CPUtime=51.07 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 16432 0 0 0 5104 3 0 0 25 0 4 0 748564565 306282496 33776 33554432000 4194304 4625164 140736525880464 18446744073709551615 4487834 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=299104 CPUtime=51.07 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 12165 0 0 0 5102 5 0 0 25 0 4 0 748564565 306282496 33776 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=299104 CPUtime=50.29 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 215959 0 0 0 4999 30 0 0 25 0 4 0 748564565 306282496 33776 33554432000 4194304 4625164 140736525880464 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.55
Current children cumulated vsize (KiB) 299104

[startup+102.301 s]
/proc/loadavg: 9.26 9.06 7.59 10/486 1759
/proc/meminfo: memFree=11614488/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=328576 CPUtime=407.58 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 380954 0 0 0 40695 63 0 0 25 0 4 0 748564563 336461824 51190 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 82144 51190 631 106 0 77647 0
[pid=1722/tid=1723] ppid=1720 vsize=328576 CPUtime=102.28 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 23546 0 0 0 10224 4 0 0 25 0 4 0 748564565 336461824 51190 33554432000 4194304 4625164 140736525880464 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=328576 CPUtime=102.29 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 18215 0 0 0 10221 8 0 0 25 0 4 0 748564565 336461824 51190 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=328576 CPUtime=100.71 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 324390 0 0 0 10023 48 0 0 25 0 4 0 748564565 336461824 51190 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352098 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.58
Current children cumulated vsize (KiB) 328576

[startup+162.301 s]

################
# More data... #
################

[pid=1722] ppid=1720 vsize=887988 CPUtime=2798.25 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 1705520 0 0 0 279535 290 0 0 25 0 4 0 748564563 909299712 153764 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 221997 153764 363 106 0 217500 0
[pid=1722/tid=1723] ppid=1720 vsize=887988 CPUtime=702.28 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 73502 0 0 0 70208 20 0 0 25 0 4 0 748564565 909299712 153764 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=887988 CPUtime=702.28 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 51190 0 0 0 70208 20 0 0 25 0 4 0 748564565 909299712 153764 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=887988 CPUtime=691.36 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 1505892 0 0 0 68901 235 0 0 25 0 4 0 748564565 909299712 153764 33554432000 4194304 4625164 140736525880464 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2798.25
Current children cumulated vsize (KiB) 887988

[startup+762.301 s]
/proc/loadavg: 9.14 9.14 8.36 10/486 1807
/proc/meminfo: memFree=9916040/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=966020 CPUtime=3037.33 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 2045917 0 0 0 303393 340 0 0 25 0 4 0 748564563 989204480 166160 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 241505 166160 365 106 0 237008 0
[pid=1722/tid=1723] ppid=1720 vsize=966020 CPUtime=762.3 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 77603 0 0 0 76209 21 0 0 25 0 4 0 748564565 989204480 166160 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=966020 CPUtime=762.29 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 52359 0 0 0 76209 20 0 0 25 0 4 0 748564565 989204480 166160 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=966020 CPUtime=750.43 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 1811490 0 0 0 74762 281 0 0 25 0 4 0 748564565 989204480 166160 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3037.33
Current children cumulated vsize (KiB) 966020

[startup+822.3 s]
/proc/loadavg: 9.13 9.14 8.41 10/486 1808
/proc/meminfo: memFree=9815920/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1040540 CPUtime=3276.38 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 2382597 0 0 0 327247 391 0 0 25 0 4 0 748564563 1065512960 173936 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 260135 173936 370 106 0 255638 0
[pid=1722/tid=1723] ppid=1720 vsize=1040540 CPUtime=822.28 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 78243 0 0 0 82207 21 0 0 25 0 4 0 748564565 1065512960 173936 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1040540 CPUtime=822.28 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 53112 0 0 0 82207 21 0 0 25 0 4 0 748564565 1065512960 173936 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1040540 CPUtime=809.49 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2144857 0 0 0 80618 331 0 0 25 0 4 0 748564565 1065512960 173936 33554432000 4194304 4625164 140736525880464 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3276.38
Current children cumulated vsize (KiB) 1040540

[startup+882.319 s]
/proc/loadavg: 9.17 9.14 8.45 10/486 1810
/proc/meminfo: memFree=9701660/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1048724 CPUtime=3515.51 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 2548318 0 0 0 351132 419 0 0 25 0 4 0 748564563 1073893376 183806 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 262181 183806 370 106 0 257684 0
[pid=1722/tid=1723] ppid=1720 vsize=1048724 CPUtime=882.3 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 78932 0 0 0 88208 22 0 0 25 0 4 0 748564565 1073893376 183806 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1048724 CPUtime=882.29 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 53414 0 0 0 88208 21 0 0 25 0 4 0 748564565 1073893376 183806 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1048724 CPUtime=868.56 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2304502 0 0 0 86500 356 0 0 25 0 4 0 748564565 1073893376 183806 33554432000 4194304 4625164 140736525880464 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3515.51
Current children cumulated vsize (KiB) 1048724

[startup+942.3 s]
/proc/loadavg: 9.17 9.15 8.49 10/486 1811
/proc/meminfo: memFree=9643584/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1092524 CPUtime=3754.51 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 2892460 0 0 0 374981 470 0 0 25 0 4 0 748564563 1118744576 192514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 273131 192514 369 106 0 268634 0
[pid=1722/tid=1723] ppid=1720 vsize=1092524 CPUtime=942.28 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 79813 0 0 0 94206 22 0 0 25 0 4 0 748564565 1118744576 192514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1092524 CPUtime=942.28 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 54298 0 0 0 94206 22 0 0 25 0 4 0 748564565 1118744576 192514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352414 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1092524 CPUtime=927.61 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2620562 0 0 0 92358 403 0 0 25 0 4 0 748564565 1118744576 192514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3754.51
Current children cumulated vsize (KiB) 1092524

[startup+1002.3 s]
/proc/loadavg: 9.24 9.18 8.54 10/486 1813
/proc/meminfo: memFree=9510848/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1146232 CPUtime=3993.57 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 3254493 0 0 0 398827 530 0 0 25 0 4 0 748564563 1173741568 212514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 286558 212514 352 106 0 282061 0
[pid=1722/tid=1723] ppid=1720 vsize=1146232 CPUtime=1002.29 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 81129 0 0 0 100203 26 0 0 25 0 4 0 748564565 1173741568 212514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1146232 CPUtime=1002.28 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 55017 0 0 0 100205 23 0 0 25 0 4 0 748564565 1173741568 212514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1146232 CPUtime=986.66 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 2963359 0 0 0 98211 455 0 0 25 0 4 0 748564565 1173741568 212514 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3993.57
Current children cumulated vsize (KiB) 1146232

[startup+1062.3 s]
/proc/loadavg: 9.18 9.17 8.58 10/486 1815
/proc/meminfo: memFree=9280288/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1311032 CPUtime=4232.65 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 3677594 0 0 0 422672 593 0 0 25 0 4 0 748564563 1342496768 260321 33554432000 4194304 4625164 140736525880464 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 327758 260321 358 106 0 323261 0
[pid=1722/tid=1723] ppid=1720 vsize=1311032 CPUtime=1062.29 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 83069 0 0 0 106202 27 0 0 25 0 4 0 748564565 1342496768 260321 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1311032 CPUtime=1062.29 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 56167 0 0 0 106204 25 0 0 25 0 4 0 748564565 1342496768 260321 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1311032 CPUtime=1045.74 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 3293098 0 0 0 104069 505 0 0 25 0 4 0 748564565 1342496768 260321 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4232.65
Current children cumulated vsize (KiB) 1311032

[startup+1122.3 s]
/proc/loadavg: 9.12 9.15 8.61 10/486 1816
/proc/meminfo: memFree=9186004/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1405612 CPUtime=4471.69 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 4010887 0 0 0 446519 650 0 0 25 0 4 0 748564563 1439346688 269606 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 351403 269606 350 106 0 346906 0
[pid=1722/tid=1723] ppid=1720 vsize=1405612 CPUtime=1122.29 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 107911 0 0 0 112199 30 0 0 25 0 4 0 748564565 1439346688 269606 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1405612 CPUtime=1122.28 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 56650 0 0 0 112203 25 0 0 25 0 4 0 748564565 1439346688 269606 33554432000 4194304 4625164 140736525880464 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1405612 CPUtime=1104.78 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 3575287 0 0 0 109924 554 0 0 25 0 4 0 748564565 1439346688 269606 33554432000 4194304 4625164 140736525880464 18446744073709551615 4552391 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4471.69
Current children cumulated vsize (KiB) 1405612

[startup+1182.3 s]
/proc/loadavg: 9.18 9.15 8.64 10/486 1818
/proc/meminfo: memFree=9012980/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1440140 CPUtime=4710.76 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 4318608 0 0 0 470382 694 0 0 25 0 4 0 748564563 1474703360 279112 33554432000 4194304 4625164 140736525880464 18446744073709551615 4512193 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 360035 279112 350 106 0 355538 0
[pid=1722/tid=1723] ppid=1720 vsize=1440140 CPUtime=1182.29 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 109134 0 0 0 118199 30 0 0 25 0 4 0 748564565 1474703360 279112 33554432000 4194304 4625164 140736525880464 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1440140 CPUtime=1182.28 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 56664 0 0 0 118203 25 0 0 25 0 4 0 748564565 1474703360 279112 33554432000 4194304 4625164 140736525880464 18446744073709551615 4339600 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1440140 CPUtime=1163.85 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 3876261 0 0 0 115788 597 0 0 25 0 4 0 748564565 1474703360 279112 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4710.76
Current children cumulated vsize (KiB) 1440140



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 9.12 9.14 8.65 10/486 1819
/proc/meminfo: memFree=8996836/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1469672 CPUtime=4800.41 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 4454477 0 0 0 479325 716 0 0 25 0 4 0 748564563 1504944128 280842 33554432000 4194304 4625164 140736525880464 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 367418 280842 350 106 0 362921 0
[pid=1722/tid=1723] ppid=1720 vsize=1469672 CPUtime=1204.8 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 109385 0 0 0 120450 30 0 0 25 0 4 0 748564565 1504944128 280843 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1469672 CPUtime=1204.8 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 56679 0 0 0 120455 25 0 0 25 0 4 0 748564565 1504944128 280843 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1469672 CPUtime=1185.98 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 4011287 0 0 0 117980 618 0 0 25 0 4 0 748564565 1504944128 280843 33554432000 4194304 4625164 140736525880464 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 1469672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.8 s]
/proc/loadavg: 9.12 9.14 8.65 10/486 1819
/proc/meminfo: memFree=8996836/32951124 swapFree=65586204/67111528
[pid=1722] ppid=1720 vsize=1469672 CPUtime=4800.41 cores=1,3,5,7
/proc/1722/stat : 1722 (SArTagnan) R 1720 1722 1608 0 -1 4202496 4454477 0 0 0 479325 716 0 0 25 0 4 0 748564563 1504944128 280842 33554432000 4194304 4625164 140736525880464 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1722/statm: 367418 280842 350 106 0 362921 0
[pid=1722/tid=1723] ppid=1720 vsize=1469672 CPUtime=1204.8 cores=1,3,5,7
/proc/1722/task/1723/stat : 1723 (SArTagnan) R 1720 1722 1608 0 -1 4202560 109385 0 0 0 120450 30 0 0 25 0 4 0 748564565 1504944128 280843 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1722/tid=1724] ppid=1720 vsize=1469672 CPUtime=1204.8 cores=1,3,5,7
/proc/1722/task/1724/stat : 1724 (SArTagnan) R 1720 1722 1608 0 -1 4202560 56679 0 0 0 120455 25 0 0 25 0 4 0 748564565 1504944128 280843 33554432000 4194304 4625164 140736525880464 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1722/tid=1725] ppid=1720 vsize=1469672 CPUtime=1185.98 cores=1,3,5,7
/proc/1722/task/1725/stat : 1725 (SArTagnan) R 1720 1722 1608 0 -1 4202560 4011287 0 0 0 117980 618 0 0 25 0 4 0 748564565 1504944128 280843 33554432000 4194304 4625164 140736525880464 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 1469672

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.87
CPU time (s): 4800.52
CPU user time (s): 4793.31
CPU system time (s): 7.2049
CPU usage (%): 398.427
Max. virtual memory (cumulated for all children) (KiB): 1493716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4793.31
system time used= 7.2049
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4454478
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 557
involuntary context switches= 30969

runsolver used 5.13122 second user time and 13.7179 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-17 00:02:19
IDJOB=3386053
IDBENCH=85826
IDSOLVER=1871
FILE ID=node119/3386053-1305583339
RUNJOBID= node119-1305582131-1627
PBS_JOBID= 13350300
Free space on /tmp= 73052 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/sorge05/QG7/gensys-icl007.shuffled-as.sat05-3133.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386053-1305583339/watcher-3386053-1305583339 -o /tmp/evaluation-result-3386053-1305583339/solver-3386053-1305583339 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386053-1305583339.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 88361752c7b0c05e849791aafdd7bdba
RANDOM SEED=412212672

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11024116 kB
Buffers:        320628 kB
Cached:        5541164 kB
SwapCached:       4756 kB
Active:       17791376 kB
Inactive:      3780532 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11024116 kB
SwapTotal:    67111528 kB
SwapFree:     65586204 kB
Dirty:             840 kB
Writeback:          16 kB
AnonPages:    15708780 kB
Mapped:          36640 kB
Slab:           216264 kB
PageTables:      73740 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 142829276 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73044 MiB
End job on node119 at 2011-05-17 00:22:26