Trace number 3438916

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.8 5011

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1520_u.cnf
MD5SUMac02a3a5c06227748ecf75dd451ebb7e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63840
Number of clauses123900
Sum of the clauses size369320
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22380
Number of clauses of size 3121520
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438916-1306924607/watcher-3438916-1306924607 -o /tmp/evaluation-result-3438916-1306924607/solver-3438916-1306924607 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438916-1306924607.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.19 8.11 8.01 1/474 22756
/proc/meminfo: memFree=27210340/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=28132 CPUtime=0 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 2296 0 0 0 0 0 0 0 25 0 1 0 804063058 28807168 1925 33554432000 4194304 4625164 140734877805488 18446744073709551615 212435677893 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/22756/statm: 7033 1925 296 106 0 2536 0

[startup+0.102984 s]
/proc/loadavg: 8.19 8.11 8.01 1/474 22756
/proc/meminfo: memFree=27210340/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=93084 CPUtime=0.09 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 20816 0 0 0 7 2 0 0 25 0 1 0 804063058 95318016 16880 33554432000 4194304 4625164 140734877805488 18446744073709551615 4277645 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/22756/statm: 24293 16901 298 106 0 19796 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 93084

[startup+0.200933 s]
/proc/loadavg: 8.19 8.11 8.01 1/474 22756
/proc/meminfo: memFree=27210340/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=350020 CPUtime=0.73 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 38436 0 0 0 68 5 0 0 18 0 8 0 804063058 358420480 27089 33554432000 4194304 4625164 140734877805488 18446744073709551615 4329037 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 87505 27089 346 106 0 83008 0
Current children cumulated CPU time (s) 0.73
Current children cumulated vsize (KiB) 350020

[startup+0.300908 s]
/proc/loadavg: 8.19 8.11 8.01 1/474 22756
/proc/meminfo: memFree=27210340/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=613260 CPUtime=1.52 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 47931 0 0 0 146 6 0 0 18 0 8 0 804063058 627978240 32291 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 153315 32298 347 106 0 148818 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 613260

[startup+0.720198 s]
/proc/loadavg: 8.19 8.11 8.01 1/474 22756
/proc/meminfo: memFree=27210340/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=848652 CPUtime=4.77 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) D 22754 22756 22470 0 -1 4202496 173247 0 0 0 452 25 0 0 18 0 8 0 804063058 869019648 80521 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 212163 80009 347 106 0 207666 0
Current children cumulated CPU time (s) 4.77
Current children cumulated vsize (KiB) 848652

[startup+1.50068 s]
/proc/loadavg: 8.17 8.11 8.01 9/482 22764
/proc/meminfo: memFree=26835308/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=924796 CPUtime=10.98 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 208470 0 0 0 1066 32 0 0 19 0 8 0 804063058 946991104 92789 33554432000 4194304 4625164 140734877805488 18446744073709551615 4280523 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 231199 92816 353 106 0 226702 0
[pid=22756/tid=22758] ppid=22754 vsize=924796 CPUtime=1.37 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 17897 0 0 0 134 3 0 0 19 0 8 0 804063069 946991104 92829 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=924796 CPUtime=1.36 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 18699 0 0 0 134 2 0 0 18 0 8 0 804063069 946991104 92846 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351894 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=924796 CPUtime=1.35 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 32342 0 0 0 131 4 0 0 19 0 8 0 804063069 946991104 92860 33554432000 4194304 4625164 140734877805488 18446744073709551615 212435714517 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=924796 CPUtime=1.35 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 18490 0 0 0 133 2 0 0 18 0 8 0 804063070 946991104 92872 33554432000 4194304 4625164 140734877805488 18446744073709551615 4464807 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=924796 CPUtime=1.35 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 17620 0 0 0 133 2 0 0 18 0 8 0 804063070 946991104 92884 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=924796 CPUtime=1.31 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 16815 0 0 0 128 3 0 0 18 0 8 0 804063070 946991104 92896 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339675 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=924796 CPUtime=1.35 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 18464 0 0 0 132 3 0 0 19 0 8 0 804063070 946991104 92909 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.98
Current children cumulated vsize (KiB) 924796

[startup+3.10038 s]
/proc/loadavg: 8.17 8.11 8.01 9/482 22764
/proc/meminfo: memFree=26830348/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=945516 CPUtime=23.76 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 239813 0 0 0 2340 36 0 0 22 0 8 0 804063058 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 236379 96922 353 106 0 231882 0
[pid=22756/tid=22758] ppid=22754 vsize=945516 CPUtime=2.96 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 18327 0 0 0 293 3 0 0 23 0 8 0 804063069 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4465136 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=945516 CPUtime=2.96 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 24288 0 0 0 293 3 0 0 21 0 8 0 804063069 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=945516 CPUtime=2.96 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 50002 0 0 0 289 7 0 0 23 0 8 0 804063069 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=945516 CPUtime=2.95 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 24254 0 0 0 292 3 0 0 22 0 8 0 804063070 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=945516 CPUtime=2.95 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 18627 0 0 0 293 2 0 0 21 0 8 0 804063070 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4278640 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=945516 CPUtime=2.89 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 17273 0 0 0 286 3 0 0 21 0 8 0 804063070 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351942 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=945516 CPUtime=2.95 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 18544 0 0 0 292 3 0 0 23 0 8 0 804063070 968208384 96922 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351972 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.76
Current children cumulated vsize (KiB) 945516

[startup+6.30077 s]
/proc/loadavg: 8.16 8.10 8.01 9/482 22764
/proc/meminfo: memFree=26774680/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=997280 CPUtime=49.3 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 312549 0 0 0 4885 45 0 0 25 0 8 0 804063058 1021214720 110016 33554432000 4194304 4625164 140734877805488 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 249320 110016 353 106 0 244823 0
[pid=22756/tid=22758] ppid=22754 vsize=997280 CPUtime=6.16 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 25261 0 0 0 612 4 0 0 25 0 8 0 804063069 1021214720 110016 33554432000 4194304 4625164 140734877805488 18446744073709551615 4288699 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=997280 CPUtime=6.16 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 25159 0 0 0 613 3 0 0 25 0 8 0 804063069 1021214720 110016 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=997280 CPUtime=6.16 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 92355 0 0 0 604 12 0 0 25 0 8 0 804063069 1021214720 110016 33554432000 4194304 4625164 140734877805488 18446744073709551615 4547563 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=997280 CPUtime=6.15 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 25260 0 0 0 612 3 0 0 25 0 8 0 804063070 1021214720 110016 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=997280 CPUtime=6.15 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 25312 0 0 0 612 3 0 0 25 0 8 0 804063070 1021214720 110017 33554432000 4194304 4625164 140734877805488 18446744073709551615 4348771 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=997280 CPUtime=6.04 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 24006 0 0 0 600 4 0 0 25 0 8 0 804063070 1021214720 110017 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=997280 CPUtime=6.15 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 24872 0 0 0 611 4 0 0 25 0 8 0 804063070 1021214720 110017 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339546 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.3
Current children cumulated vsize (KiB) 997280

[startup+12.7006 s]
/proc/loadavg: 8.15 8.10 8.01 9/482 22764
/proc/meminfo: memFree=26682928/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=1087844 CPUtime=100.37 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 459579 0 0 0 9970 67 0 0 25 0 8 0 804063058 1113952256 133202 33554432000 4194304 4625164 140734877805488 18446744073709551615 4518279 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 271961 133202 353 106 0 267464 0
[pid=22756/tid=22758] ppid=22754 vsize=1087844 CPUtime=12.56 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 35448 0 0 0 1250 6 0 0 25 0 8 0 804063069 1113952256 133202 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=1087844 CPUtime=12.56 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 27127 0 0 0 1252 4 0 0 25 0 8 0 804063069 1113952256 133203 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=1087844 CPUtime=12.54 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 175649 0 0 0 1231 23 0 0 25 0 8 0 804063069 1113952256 133205 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=1087844 CPUtime=12.55 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 34860 0 0 0 1251 4 0 0 25 0 8 0 804063070 1113952256 133205 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=1087844 CPUtime=12.55 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 36807 0 0 0 1250 5 0 0 25 0 8 0 804063070 1113952256 133206 33554432000 4194304 4625164 140734877805488 18446744073709551615 4348941 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=1087844 CPUtime=12.34 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 35342 0 0 0 1228 6 0 0 25 0 8 0 804063070 1113952256 133206 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=1087844 CPUtime=12.54 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 34860 0 0 0 1250 4 0 0 25 0 8 0 804063070 1113952256 133206 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.37
Current children cumulated vsize (KiB) 1087844

[startup+25.5181 s]
/proc/loadavg: 8.11 8.10 8.01 9/482 22765
/proc/meminfo: memFree=26492648/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=1169204 CPUtime=202.69 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 732304 0 0 0 20162 107 0 0 25 0 8 0 804063058 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 292301 180063 353 106 0 287804 0
[pid=22756/tid=22758] ppid=22754 vsize=1169204 CPUtime=25.37 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 37325 0 0 0 2531 6 0 0 25 0 8 0 804063069 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=1169204 CPUtime=25.37 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 38307 0 0 0 2531 6 0 0 25 0 8 0 804063069 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=1169204 CPUtime=25.36 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 360993 0 0 0 2489 47 0 0 25 0 8 0 804063069 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=1169204 CPUtime=25.36 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 39642 0 0 0 2530 6 0 0 25 0 8 0 804063070 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=1169204 CPUtime=25.37 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 58269 0 0 0 2528 9 0 0 25 0 8 0 804063070 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=1169204 CPUtime=24.95 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 56953 0 0 0 2485 10 0 0 25 0 8 0 804063070 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=1169204 CPUtime=25.37 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 38714 0 0 0 2531 6 0 0 25 0 8 0 804063070 1197264896 180063 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.69
Current children cumulated vsize (KiB) 1169204

[startup+51.1013 s]
/proc/loadavg: 8.07 8.09 8.01 9/482 22765
/proc/meminfo: memFree=26224988/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=1528296 CPUtime=406.94 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 1206686 0 0 0 40514 180 0 0 25 0 8 0 804063058 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 382074 248409 353 106 0 377577 0
[pid=22756/tid=22758] ppid=22754 vsize=1528296 CPUtime=50.96 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 53326 0 0 0 5086 10 0 0 25 0 8 0 804063069 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=1528296 CPUtime=50.95 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 57444 0 0 0 5087 8 0 0 25 0 8 0 804063069 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351894 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=1528296 CPUtime=50.93 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 669331 0 0 0 5003 90 0 0 25 0 8 0 804063069 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=1528296 CPUtime=50.94 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 56685 0 0 0 5085 9 0 0 25 0 8 0 804063070 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=1528296 CPUtime=50.94 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 87623 0 0 0 5081 13 0 0 25 0 8 0 804063070 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=1528296 CPUtime=50.13 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 83656 0 0 0 4997 16 0 0 25 0 8 0 804063070 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=1528296 CPUtime=50.94 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 55690 0 0 0 5085 9 0 0 25 0 8 0 804063070 1564975104 248409 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 406.94

################
# More data... #
################

Current children cumulated vsize (KiB) 10050316

[startup+4722.3 s]
/proc/loadavg: 8.09 8.07 8.01 9/482 22902
/proc/meminfo: memFree=19279556/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=10075216 CPUtime=37698.4 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 56645035 0 0 0 3761427 8416 0 0 25 0 8 0 804063058 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 2518804 1997077 355 106 0 2514307 0
[pid=22756/tid=22758] ppid=22754 vsize=10075216 CPUtime=4697.35 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 523994 0 0 0 469548 187 0 0 25 0 8 0 804063069 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=10075216 CPUtime=4722.09 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 617872 0 0 0 472098 111 0 0 25 0 8 0 804063069 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=10075216 CPUtime=4720.68 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 51860113 0 0 0 464710 7358 0 0 25 0 8 0 804063069 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=10075216 CPUtime=4688.39 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 673155 0 0 0 468671 168 0 0 25 0 8 0 804063070 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=10075216 CPUtime=4722.14 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 468414 0 0 0 472138 76 0 0 25 0 8 0 804063070 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=10075216 CPUtime=4719.92 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 655876 0 0 0 471857 135 0 0 25 0 8 0 804063070 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=10075216 CPUtime=4706.65 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 617735 0 0 0 470509 156 0 0 25 0 8 0 804063070 10317021184 1997077 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37698.4
Current children cumulated vsize (KiB) 10075216

[startup+4782.3 s]
/proc/loadavg: 8.08 8.07 8.01 9/482 22903
/proc/meminfo: memFree=19228572/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=10044300 CPUtime=38177.4 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 57356664 0 0 0 3809223 8521 0 0 25 0 8 0 804063058 10285363200 1993755 33554432000 4194304 4625164 140734877805488 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 2511075 1993756 400 106 0 2506578 0
[pid=22756/tid=22758] ppid=22754 vsize=10044300 CPUtime=4756.36 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 524713 0 0 0 475449 187 0 0 25 0 8 0 804063069 10285363200 1993756 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=10044300 CPUtime=4782.09 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 619434 0 0 0 478098 111 0 0 25 0 8 0 804063069 10285363200 1993756 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=10044300 CPUtime=4780.68 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 52566402 0 0 0 470608 7460 0 0 25 0 8 0 804063069 10285363200 1993757 33554432000 4194304 4625164 140734877805488 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=10044300 CPUtime=4748.39 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 674086 0 0 0 474671 168 0 0 25 0 8 0 804063070 10285363200 1993757 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=10044300 CPUtime=4782.15 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 468748 0 0 0 478138 77 0 0 25 0 8 0 804063070 10285363200 1993757 33554432000 4194304 4625164 140734877805488 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=10044300 CPUtime=4779.92 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 656045 0 0 0 477857 135 0 0 25 0 8 0 804063070 10285363200 1993757 33554432000 4194304 4625164 140734877805488 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=10044300 CPUtime=4766.65 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 618736 0 0 0 476508 157 0 0 25 0 8 0 804063070 10285363200 1993757 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38177.4
Current children cumulated vsize (KiB) 10044300

[startup+4842.3 s]
/proc/loadavg: 8.08 8.07 8.01 9/482 22905
/proc/meminfo: memFree=19147952/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=10072516 CPUtime=38656.6 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 58117025 0 0 0 3857024 8633 0 0 25 0 8 0 804063058 10314256384 2011970 33554432000 4194304 4625164 140734877805488 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 2518129 2011970 353 106 0 2513632 0
[pid=22756/tid=22758] ppid=22754 vsize=10072516 CPUtime=4815.39 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 525150 0 0 0 481352 187 0 0 25 0 8 0 804063069 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352200 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=10072516 CPUtime=4842.11 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 619588 0 0 0 484100 111 0 0 25 0 8 0 804063069 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=10072516 CPUtime=4840.7 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 53322552 0 0 0 476500 7570 0 0 25 0 8 0 804063069 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=10072516 CPUtime=4808.41 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 675215 0 0 0 480672 169 0 0 25 0 8 0 804063070 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=10072516 CPUtime=4842.17 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 469008 0 0 0 484140 77 0 0 25 0 8 0 804063070 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=10072516 CPUtime=4839.95 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 656170 0 0 0 483859 136 0 0 25 0 8 0 804063070 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=10072516 CPUtime=4826.68 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 620111 0 0 0 482510 158 0 0 25 0 8 0 804063070 10314256384 2011972 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38656.6
Current children cumulated vsize (KiB) 10072516

[startup+4902.3 s]
/proc/loadavg: 8.07 8.07 8.01 9/482 22907
/proc/meminfo: memFree=19104416/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=10326508 CPUtime=39135.4 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 59176924 0 0 0 3904753 8792 0 0 25 0 8 0 804063058 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 2581627 2025402 353 106 0 2577130 0
[pid=22756/tid=22758] ppid=22754 vsize=10326508 CPUtime=4874.39 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 525952 0 0 0 487251 188 0 0 25 0 8 0 804063069 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=10326508 CPUtime=4902.1 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 619927 0 0 0 490099 111 0 0 25 0 8 0 804063069 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=10326508 CPUtime=4900.67 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 54241027 0 0 0 482358 7709 0 0 25 0 8 0 804063069 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=10326508 CPUtime=4868.39 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 675595 0 0 0 486670 169 0 0 25 0 8 0 804063070 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=10326508 CPUtime=4902.15 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 469278 0 0 0 490138 77 0 0 25 0 8 0 804063070 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=10326508 CPUtime=4899.93 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 656284 0 0 0 489857 136 0 0 25 0 8 0 804063070 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=10326508 CPUtime=4886.66 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 620683 0 0 0 488508 158 0 0 25 0 8 0 804063070 10574344192 2025402 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352183 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39135.5
Current children cumulated vsize (KiB) 10326508

[startup+4962.32 s]
/proc/loadavg: 8.07 8.07 8.01 9/482 22908
/proc/meminfo: memFree=19080836/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=10312716 CPUtime=39614.6 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 59908851 0 0 0 3952555 8905 0 0 25 0 8 0 804063058 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 2578179 2028773 388 106 0 2573682 0
[pid=22756/tid=22758] ppid=22754 vsize=10312716 CPUtime=4933.42 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 526876 0 0 0 493154 188 0 0 25 0 8 0 804063069 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=10312716 CPUtime=4962.11 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 620571 0 0 0 496100 111 0 0 25 0 8 0 804063069 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4288976 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=10312716 CPUtime=4960.69 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 54968360 0 0 0 488248 7821 0 0 25 0 8 0 804063069 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=10312716 CPUtime=4928.41 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 676668 0 0 0 492672 169 0 0 25 0 8 0 804063070 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=10312716 CPUtime=4962.17 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 469681 0 0 0 496140 77 0 0 25 0 8 0 804063070 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=10312716 CPUtime=4959.95 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 656505 0 0 0 495859 136 0 0 25 0 8 0 804063070 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=10312716 CPUtime=4946.68 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 621312 0 0 0 494510 158 0 0 25 0 8 0 804063070 10560221184 2028773 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39614.6
Current children cumulated vsize (KiB) 10312716



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.6 s]
/proc/loadavg: 8.07 8.07 8.01 10/482 22910
/proc/meminfo: memFree=19088508/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=10289904 CPUtime=40000.3 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) R 22754 22756 22470 0 -1 4202496 60339406 0 0 0 3991056 8974 0 0 25 0 8 0 804063058 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 2572476 2026656 353 106 0 2567979 0
[pid=22756/tid=22758] ppid=22754 vsize=10289904 CPUtime=4980.93 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4202560 527112 0 0 0 497905 188 0 0 25 0 8 0 804063069 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22756/tid=22759] ppid=22754 vsize=10289904 CPUtime=5010.44 cores=0-7
/proc/22756/task/22759/stat : 22759 (SArTagnan) R 22754 22756 22470 0 -1 4202560 621023 0 0 0 500932 112 0 0 25 0 8 0 804063069 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22756/tid=22760] ppid=22754 vsize=10289904 CPUtime=5009.01 cores=0-7
/proc/22756/task/22760/stat : 22760 (SArTagnan) R 22754 22756 22470 0 -1 4202560 55395221 0 0 0 493013 7888 0 0 25 0 8 0 804063069 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22756/tid=22761] ppid=22754 vsize=10289904 CPUtime=4976.73 cores=0-7
/proc/22756/task/22761/stat : 22761 (SArTagnan) R 22754 22756 22470 0 -1 4202560 677741 0 0 0 497503 170 0 0 25 0 8 0 804063070 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22756/tid=22762] ppid=22754 vsize=10289904 CPUtime=5010.49 cores=0-7
/proc/22756/task/22762/stat : 22762 (SArTagnan) R 22754 22756 22470 0 -1 4202560 469914 0 0 0 500972 77 0 0 25 0 8 0 804063070 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22756/tid=22763] ppid=22754 vsize=10289904 CPUtime=5008.27 cores=0-7
/proc/22756/task/22763/stat : 22763 (SArTagnan) R 22754 22756 22470 0 -1 4202560 656662 0 0 0 500691 136 0 0 25 0 8 0 804063070 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22756/tid=22764] ppid=22754 vsize=10289904 CPUtime=4995 cores=0-7
/proc/22756/task/22764/stat : 22764 (SArTagnan) R 22754 22756 22470 0 -1 4202560 622006 0 0 0 499341 159 0 0 25 0 8 0 804063070 10536861696 2026656 33554432000 4194304 4625164 140734877805488 18446744073709551615 4467816 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 10289904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.8 s]
/proc/loadavg: 8.07 8.07 8.01 10/482 22910
/proc/meminfo: memFree=19088508/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=0 CPUtime=40000.5 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) Z 22754 22756 22470 0 -1 4203548 60339406 0 0 0 3991064 8990 0 0 25 0 2 0 804063058 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 0 0 0 0 0 0 0
[pid=22756/tid=22758] ppid=22754 vsize=0 CPUtime=4981.09 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4203588 527112 0 0 0 497905 204 0 0 25 0 2 0 804063069 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

[startup+5011 s]
/proc/loadavg: 8.07 8.07 8.01 10/482 22910
/proc/meminfo: memFree=19088508/32951124 swapFree=38422276/67111528
[pid=22756] ppid=22754 vsize=0 CPUtime=40000.7 cores=0-7
/proc/22756/stat : 22756 (SArTagnan) Z 22754 22756 22470 0 -1 4203548 60339406 0 0 0 3991064 9010 0 0 25 0 2 0 804063058 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22756/statm: 0 0 0 0 0 0 0
[pid=22756/tid=22758] ppid=22754 vsize=0 CPUtime=4981.29 cores=0-7
/proc/22756/task/22758/stat : 22758 (SArTagnan) R 22754 22756 22470 0 -1 4203588 527112 0 0 0 497905 224 0 0 25 0 2 0 804063069 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011
CPU time (s): 40000.8
CPU user time (s): 39910.6
CPU system time (s): 90.1073
CPU usage (%): 798.258
Max. virtual memory (cumulated for all children) (KiB): 10850456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39910.6
system time used= 90.1073
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60339406
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9316
involuntary context switches= 172058

runsolver used 22.2716 second user time and 58.8341 second system time

The end

Launcher Data 

Begin job on node102 at 2011-06-01 12:36:47
IDJOB=3438916
IDBENCH=83198
IDSOLVER=1936
FILE ID=node102/3438916-1306924607
RUNJOBID= node102-1306919577-22487
PBS_JOBID= 13488538
Free space on /tmp= 73824 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1520_u.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438916-1306924607/watcher-3438916-1306924607 -o /tmp/evaluation-result-3438916-1306924607/solver-3438916-1306924607 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438916-1306924607.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ac02a3a5c06227748ecf75dd451ebb7e
RANDOM SEED=634387405

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27210620 kB
Buffers:        272868 kB
Cached:        1445376 kB
SwapCached:      86876 kB
Active:         719000 kB
Inactive:      4724140 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27210620 kB
SwapTotal:    67111528 kB
SwapFree:     38422276 kB
Dirty:            3232 kB
Writeback:           0 kB
AnonPages:     3660220 kB
Mapped:          13228 kB
Slab:           126048 kB
PageTables:      99452 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135449836 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73820 MiB
End job on node102 at 2011-06-01 14:00:20