Trace number 3385890

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4227.74 1300.07

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/crn_20_360_u.cnf
MD5SUM4b70d66c676eba3660e2a5eff473f8e7
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark178.103
Satisfiable
(Un)Satisfiability was proved
Number of variables7920
Number of clauses14950
Sum of the clauses size44260
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2590
Number of clauses of size 314360
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385890-1305581363/watcher-3385890-1305581363 -o /tmp/evaluation-result-3385890-1305581363/solver-3385890-1305581363 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385890-1305581363.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.27 11.20 11.11 8/447 12049
/proc/meminfo: memFree=20124236/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=20692 CPUtime=0 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 1207 0 0 0 0 0 0 0 25 0 1 0 650552160 21188608 838 33554432000 4194304 4625164 140736960612816 18446744073709551615 233509958341 0 0 4096 2 0 0 0 17 3 0 0 0
/proc/12049/statm: 5173 838 296 106 0 676 0
[pid=12049/tid=12050] ppid=12047 vsize=55380 CPUtime=0 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 650552162 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 47326381262770 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=55380 CPUtime=0 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650552162 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510353905 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=55380 CPUtime=0 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650552162 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510353905 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.114124 s]
/proc/loadavg: 11.27 11.20 11.11 8/447 12049
/proc/meminfo: memFree=20124236/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=55380 CPUtime=0.2 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 2108 0 0 0 20 0 0 0 25 0 4 0 650552160 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 47326381262770 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 13845 1738 301 106 0 9348 0
[pid=12049/tid=12050] ppid=12047 vsize=55380 CPUtime=0.07 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 1 0 0 0 7 0 0 0 25 0 4 0 650552162 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 47326381262770 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=55380 CPUtime=0 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650552162 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510353905 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=55380 CPUtime=0.09 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) S 12047 12049 11674 0 -1 4202560 0 0 0 0 9 0 0 0 25 0 4 0 650552162 56709120 1738 33554432000 4194304 4625164 140736960612816 18446744073709551615 47326381262794 0 0 4096 2 18446604469042877504 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 55380

[startup+0.200759 s]
/proc/loadavg: 11.27 11.20 11.11 8/447 12049
/proc/meminfo: memFree=20124236/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=253728 CPUtime=0.37 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 3127 0 0 0 37 0 0 0 25 0 4 0 650552160 259817472 2487 33554432000 4194304 4625164 140736960612816 18446744073709551615 233509994607 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12049/statm: 63432 2487 340 106 0 58935 0
[pid=12049/tid=12050] ppid=12047 vsize=253728 CPUtime=0.13 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 331 0 0 0 13 0 0 0 25 0 4 0 650552162 259817472 2487 33554432000 4194304 4625164 140736960612816 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=253728 CPUtime=0.05 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 343 0 0 0 5 0 0 0 25 0 4 0 650552162 259817472 2487 33554432000 4194304 4625164 140736960612816 18446744073709551615 4484945 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=253728 CPUtime=0.1 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 176 0 0 0 10 0 0 0 25 0 4 0 650552162 259817472 2487 33554432000 4194304 4625164 140736960612816 18446744073709551615 233509994599 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 253728

[startup+0.300849 s]
/proc/loadavg: 11.27 11.20 11.11 8/447 12049
/proc/meminfo: memFree=20124236/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=255312 CPUtime=0.54 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) D 12047 12049 11674 0 -1 4202496 4616 0 0 0 54 0 0 0 25 0 4 0 650552160 261439488 3359 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510340791 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 63828 3360 340 106 0 59331 0
[pid=12049/tid=12050] ppid=12047 vsize=255312 CPUtime=0.21 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 513 0 0 0 21 0 0 0 25 0 4 0 650552162 261439488 3372 33554432000 4194304 4625164 140736960612816 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=255312 CPUtime=0.14 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) D 12047 12049 11674 0 -1 4202560 716 0 0 0 14 0 0 0 18 0 4 0 650552162 261439488 3406 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510340791 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=255312 CPUtime=0.1 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 421 0 0 0 10 0 0 0 25 0 4 0 650552162 261439488 3406 33554432000 4194304 4625164 140736960612816 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 255312

[startup+0.761619 s]
/proc/loadavg: 11.27 11.20 11.11 8/447 12049
/proc/meminfo: memFree=20124236/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=266632 CPUtime=1.43 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 10061 0 0 0 142 1 0 0 25 0 4 0 650552160 273031168 6014 33554432000 4194304 4625164 140736960612816 18446744073709551615 233509958539 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 66658 6014 340 106 0 62161 0
[pid=12049/tid=12050] ppid=12047 vsize=266632 CPUtime=0.6 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 1658 0 0 0 60 0 0 0 18 0 4 0 650552162 273031168 6014 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=266632 CPUtime=0.57 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 2675 0 0 0 57 0 0 0 18 0 4 0 650552162 273031168 6014 33554432000 4194304 4625164 140736960612816 18446744073709551615 233509994704 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=266632 CPUtime=0.15 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) S 12047 12049 11674 0 -1 4202560 1313 0 0 0 15 0 0 0 25 0 4 0 650552162 273031168 6014 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510402542 0 0 4096 2 18446604469042877504 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.43
Current children cumulated vsize (KiB) 266632

[startup+1.50053 s]
/proc/loadavg: 11.17 11.18 11.10 11/451 12053
/proc/meminfo: memFree=20096560/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=264912 CPUtime=3.06 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 14910 0 0 0 304 2 0 0 25 0 4 0 650552160 271269888 8515 33554432000 4194304 4625164 140736960612816 18446744073709551615 4383093 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/12049/statm: 66228 8515 340 106 0 61731 0
[pid=12049/tid=12050] ppid=12047 vsize=264912 CPUtime=1.33 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 3370 0 0 0 133 0 0 0 19 0 4 0 650552162 271269888 8515 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=264912 CPUtime=1.3 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 4022 0 0 0 129 1 0 0 19 0 4 0 650552162 271269888 8515 33554432000 4194304 4625164 140736960612816 18446744073709551615 4462343 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=264912 CPUtime=0.31 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 2452 0 0 0 31 0 0 0 20 0 4 0 650552162 271269888 8515 33554432000 4194304 4625164 140736960612816 18446744073709551615 4547661 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 264912

[startup+3.10024 s]
/proc/loadavg: 11.17 11.18 11.10 12/451 12053
/proc/meminfo: memFree=20078832/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=265672 CPUtime=7.04 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 30622 0 0 0 699 5 0 0 25 0 4 0 650552160 272048128 12362 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511982 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 66418 12362 347 106 0 61921 0
[pid=12049/tid=12050] ppid=12047 vsize=265672 CPUtime=2.19 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 4711 0 0 0 219 0 0 0 20 0 4 0 650552162 272048128 12362 33554432000 4194304 4625164 140736960612816 18446744073709551615 4462312 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=265672 CPUtime=2.88 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 5603 0 0 0 287 1 0 0 23 0 4 0 650552162 272048128 12362 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=265672 CPUtime=1.12 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 12214 0 0 0 110 2 0 0 22 0 4 0 650552162 272048128 12362 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 7.04
Current children cumulated vsize (KiB) 265672

[startup+6.30067 s]
/proc/loadavg: 11.17 11.18 11.10 12/451 12053
/proc/meminfo: memFree=20054064/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=281728 CPUtime=14.91 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 48230 0 0 0 1483 8 0 0 25 0 4 0 650552160 288489472 18169 33554432000 4194304 4625164 140736960612816 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 70432 18169 347 106 0 65935 0
[pid=12049/tid=12050] ppid=12047 vsize=281728 CPUtime=3.79 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 9159 0 0 0 378 1 0 0 25 0 4 0 650552162 288489472 18169 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510340791 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=281728 CPUtime=6.04 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 8906 0 0 0 602 2 0 0 25 0 4 0 650552162 288489472 18169 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=281728 CPUtime=2.62 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 21147 0 0 0 259 3 0 0 25 0 4 0 650552162 288489472 18169 33554432000 4194304 4625164 140736960612816 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 14.91
Current children cumulated vsize (KiB) 281728

[startup+12.7005 s]
/proc/loadavg: 11.22 11.19 11.11 12/451 12053
/proc/meminfo: memFree=20012284/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=300944 CPUtime=30.7 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 65776 0 0 0 3060 10 0 0 25 0 4 0 650552160 308166656 26950 33554432000 4194304 4625164 140736960612816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12049/statm: 75236 26950 348 106 0 70739 0
[pid=12049/tid=12050] ppid=12047 vsize=300944 CPUtime=7 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 12572 0 0 0 698 2 0 0 25 0 4 0 650552162 308166656 26950 33554432000 4194304 4625164 140736960612816 18446744073709551615 4278385 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=300944 CPUtime=12.34 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 12634 0 0 0 1232 2 0 0 25 0 4 0 650552162 308166656 26950 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=300944 CPUtime=5.71 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 26730 0 0 0 567 4 0 0 25 0 4 0 650552162 308166656 26950 33554432000 4194304 4625164 140736960612816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 30.7
Current children cumulated vsize (KiB) 300944

[startup+25.5172 s]
/proc/loadavg: 11.19 11.18 11.11 12/451 12054
/proc/meminfo: memFree=19968528/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=308036 CPUtime=62.56 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 94171 0 0 0 6242 14 0 0 25 0 4 0 650552160 315428864 37506 33554432000 4194304 4625164 140736960612816 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12049/statm: 77009 37506 390 106 0 72512 0
[pid=12049/tid=12050] ppid=12047 vsize=308036 CPUtime=13.19 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 12929 0 0 0 1317 2 0 0 25 0 4 0 650552162 315428864 37506 33554432000 4194304 4625164 140736960612816 18446744073709551615 233510402542 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=308036 CPUtime=24.26 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 17829 0 0 0 2423 3 0 0 25 0 4 0 650552162 315428864 37506 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=308036 CPUtime=12.34 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 43465 0 0 0 1228 6 0 0 25 0 4 0 650552162 315428864 37506 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351984 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 62.56
Current children cumulated vsize (KiB) 308036

[startup+51.1006 s]
/proc/loadavg: 11.28 11.20 11.11 12/451 12054
/proc/meminfo: memFree=19922248/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=325380 CPUtime=117.51 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 115462 0 0 0 11733 18 0 0 25 0 4 0 650552160 333189120 47805 33554432000 4194304 4625164 140736960612816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12049/statm: 81345 47805 392 106 0 76848 0
[pid=12049/tid=12050] ppid=12047 vsize=325380 CPUtime=25.8 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 17476 0 0 0 2578 2 0 0 25 0 4 0 650552162 333189120 47805 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=325380 CPUtime=37.04 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 25900 0 0 0 3699 5 0 0 25 0 4 0 650552162 333189120 47805 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=325380 CPUtime=25.31 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 46615 0 0 0 2524 7 0 0 25 0 4 0 650552162 333189120 47805 33554432000 4194304 4625164 140736960612816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 117.51
Current children cumulated vsize (KiB) 325380

[startup+102.3 s]
/proc/loadavg: 11.23 11.19 11.11 12/451 12056
/proc/meminfo: memFree=19824672/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=409200 CPUtime=253.41 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 185361 0 0 0 25311 30 0 0 25 0 4 0 650552160 419020800 69099 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12049/statm: 102300 69099 536 106 0 97803 0
[pid=12049/tid=12050] ppid=12047 vsize=409200 CPUtime=54.79 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 24511 0 0 0 5475 4 0 0 25 0 4 0 650552162 419020800 69099 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=409200 CPUtime=76.33 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 39425 0 0 0 7625 8 0 0 25 0 4 0 650552162 419020800 69099 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=409200 CPUtime=64.15 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 85562 0 0 0 6402 13 0 0 25 0 4 0 650552162 419020800 69099 33554432000 4194304 4625164 140736960612816 18446744073709551615 4335119 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 253.41
Current children cumulated vsize (KiB) 409200

[startup+162.301 s]

################
# More data... #
################

[pid=12049] ppid=12047 vsize=1196084 CPUtime=2252.47 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 4702374 0 0 0 224538 709 0 0 25 0 4 0 650552160 1224790016 211785 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 299021 211785 627 106 0 294524 0
[pid=12049/tid=12050] ppid=12047 vsize=1196084 CPUtime=561.62 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 88916 0 0 0 56144 18 0 0 25 0 4 0 650552162 1224790016 211785 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1196084 CPUtime=582.24 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 125550 0 0 0 58198 26 0 0 25 0 4 0 650552162 1224790016 211785 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1196084 CPUtime=569.73 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 4323308 0 0 0 56336 637 0 0 25 0 4 0 650552162 1224790016 211785 33554432000 4194304 4625164 140736960612816 18446744073709551615 4578811 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2252.47
Current children cumulated vsize (KiB) 1196084

[startup+762.3 s]
/proc/loadavg: 10.10 10.26 10.64 11/450 12104
/proc/meminfo: memFree=19179824/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1196084 CPUtime=2431.61 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 5317894 0 0 0 242361 800 0 0 25 0 4 0 650552160 1224790016 219046 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 299021 219046 616 106 0 294524 0
[pid=12049/tid=12050] ppid=12047 vsize=1196084 CPUtime=592 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 90961 0 0 0 59181 19 0 0 25 0 4 0 650552162 1224790016 219046 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1196084 CPUtime=612.17 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 126320 0 0 0 61190 27 0 0 25 0 4 0 650552162 1224790016 219046 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1196084 CPUtime=628.87 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 4933663 0 0 0 62160 727 0 0 25 0 4 0 650552162 1224790016 219046 33554432000 4194304 4625164 140736960612816 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2431.61
Current children cumulated vsize (KiB) 1196084

[startup+822.3 s]
/proc/loadavg: 10.15 10.24 10.61 11/450 12106
/proc/meminfo: memFree=19115796/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1219620 CPUtime=2610.73 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 5991185 0 0 0 260178 895 0 0 25 0 4 0 650552160 1248890880 223749 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 304905 223749 600 106 0 300408 0
[pid=12049/tid=12050] ppid=12047 vsize=1219620 CPUtime=639.43 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 93020 0 0 0 63923 20 0 0 25 0 4 0 650552162 1248890880 223749 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1219620 CPUtime=648.96 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 127092 0 0 0 64869 27 0 0 25 0 4 0 650552162 1248890880 223749 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1219620 CPUtime=687.99 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 5603633 0 0 0 67978 821 0 0 25 0 4 0 650552162 1248890880 223749 33554432000 4194304 4625164 140736960612816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2610.73
Current children cumulated vsize (KiB) 1219620

[startup+882.301 s]
/proc/loadavg: 10.19 10.23 10.58 11/450 12108
/proc/meminfo: memFree=19039364/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1306808 CPUtime=2789.89 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 6615792 0 0 0 277999 990 0 0 25 0 4 0 650552160 1338171392 232020 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 326702 232020 575 106 0 322205 0
[pid=12049/tid=12050] ppid=12047 vsize=1306808 CPUtime=699.45 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 122272 0 0 0 69921 24 0 0 25 0 4 0 650552162 1338171392 232020 33554432000 4194304 4625164 140736960612816 18446744073709551615 4339660 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1306808 CPUtime=678.56 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 128092 0 0 0 67829 27 0 0 25 0 4 0 650552162 1338171392 232020 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1306808 CPUtime=738.1 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 6179308 0 0 0 72901 909 0 0 25 0 4 0 650552162 1338171392 232020 33554432000 4194304 4625164 140736960612816 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2789.89
Current children cumulated vsize (KiB) 1306808

[startup+942.301 s]
/proc/loadavg: 10.27 10.23 10.55 11/450 12109
/proc/meminfo: memFree=18988844/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1306808 CPUtime=2981.4 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 7138248 0 0 0 297072 1068 0 0 25 0 4 0 650552160 1338171392 236269 33554432000 4194304 4625164 140736960612816 18446744073709551615 4512205 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 326702 236269 551 106 0 322205 0
[pid=12049/tid=12050] ppid=12047 vsize=1306808 CPUtime=759.43 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 124755 0 0 0 75918 25 0 0 25 0 4 0 650552162 1338171392 236269 33554432000 4194304 4625164 140736960612816 18446744073709551615 233509964802 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1306808 CPUtime=708.33 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 128657 0 0 0 70806 27 0 0 25 0 4 0 650552162 1338171392 236269 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1306808 CPUtime=779.85 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 6697603 0 0 0 77000 985 0 0 25 0 4 0 650552162 1338171392 236269 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2981.4
Current children cumulated vsize (KiB) 1306808

[startup+1002.32 s]
/proc/loadavg: 10.22 10.22 10.53 11/450 12111
/proc/meminfo: memFree=18923924/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1372344 CPUtime=3190.46 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 7780178 0 0 0 317882 1164 0 0 25 0 4 0 650552160 1405280256 245924 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511956 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 343086 245924 506 106 0 338589 0
[pid=12049/tid=12050] ppid=12047 vsize=1372344 CPUtime=819.45 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 126969 0 0 0 81919 26 0 0 25 0 4 0 650552162 1405280256 245924 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1372344 CPUtime=738.23 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 129415 0 0 0 73795 28 0 0 25 0 4 0 650552162 1405280256 245924 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1372344 CPUtime=838.98 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 7335177 0 0 0 82819 1079 0 0 25 0 4 0 650552162 1405280256 245924 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3190.46
Current children cumulated vsize (KiB) 1372344

[startup+1062.3 s]
/proc/loadavg: 10.14 10.19 10.50 11/450 12112
/proc/meminfo: memFree=18853312/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1372344 CPUtime=3399.55 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 8590614 0 0 0 338673 1282 0 0 25 0 4 0 650552160 1405280256 253693 33554432000 4194304 4625164 140736960612816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 343086 253693 496 106 0 338589 0
[pid=12049/tid=12050] ppid=12047 vsize=1372344 CPUtime=879.43 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 130549 0 0 0 87915 28 0 0 25 0 4 0 650552162 1405280256 253693 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1372344 CPUtime=768.23 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 129864 0 0 0 76795 28 0 0 25 0 4 0 650552162 1405280256 253693 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1372344 CPUtime=898.11 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 8139646 0 0 0 88616 1195 0 0 25 0 4 0 650552162 1405280256 253693 33554432000 4194304 4625164 140736960612816 18446744073709551615 4327768 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3399.55
Current children cumulated vsize (KiB) 1372344

[startup+1122.3 s]
/proc/loadavg: 10.16 10.19 10.47 11/450 12114
/proc/meminfo: memFree=18765580/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1372344 CPUtime=3608.67 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 9342201 0 0 0 359481 1386 0 0 25 0 4 0 650552160 1405280256 262908 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 343086 262908 484 106 0 338589 0
[pid=12049/tid=12050] ppid=12047 vsize=1372344 CPUtime=939.44 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 131974 0 0 0 93915 29 0 0 25 0 4 0 650552162 1405280256 262908 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1372344 CPUtime=798.22 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 131244 0 0 0 79793 29 0 0 25 0 4 0 650552162 1405280256 262908 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351769 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1372344 CPUtime=957.23 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 8885858 0 0 0 94427 1296 0 0 25 0 4 0 650552162 1405280256 262908 33554432000 4194304 4625164 140736960612816 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3608.67
Current children cumulated vsize (KiB) 1372344

[startup+1182.3 s]
/proc/loadavg: 10.20 10.19 10.45 11/450 12116
/proc/meminfo: memFree=18725344/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1378380 CPUtime=3817.8 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 9986566 0 0 0 380304 1476 0 0 25 0 4 0 650552160 1411461120 267736 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 344595 267736 450 106 0 340098 0
[pid=12049/tid=12050] ppid=12047 vsize=1378380 CPUtime=999.44 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 132622 0 0 0 99915 29 0 0 25 0 4 0 650552162 1411461120 267736 33554432000 4194304 4625164 140736960612816 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1378380 CPUtime=828.21 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 132007 0 0 0 82792 29 0 0 25 0 4 0 650552162 1411461120 267736 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1378380 CPUtime=1016.37 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 9527156 0 0 0 100252 1385 0 0 25 0 4 0 650552162 1411461120 267736 33554432000 4194304 4625164 140736960612816 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3817.8
Current children cumulated vsize (KiB) 1378380

[startup+1242.3 s]
/proc/loadavg: 10.17 10.19 10.44 11/450 12117
/proc/meminfo: memFree=18644068/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1378928 CPUtime=4026.84 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 10411987 0 0 0 401146 1538 0 0 25 0 4 0 650552160 1412022272 277166 33554432000 4194304 4625164 140736960612816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 344732 277166 429 106 0 340235 0
[pid=12049/tid=12050] ppid=12047 vsize=1378928 CPUtime=1059.44 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 134065 0 0 0 105914 30 0 0 25 0 4 0 650552162 1412022272 277166 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1378928 CPUtime=858.11 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 134111 0 0 0 85781 30 0 0 25 0 4 0 650552162 1412022272 277166 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1378928 CPUtime=1075.49 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 9947797 0 0 0 106105 1444 0 0 25 0 4 0 650552162 1412022272 277166 33554432000 4194304 4625164 140736960612816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4026.84
Current children cumulated vsize (KiB) 1378928



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.12 10.17 10.41 11/450 12119
/proc/meminfo: memFree=18580404/32951124 swapFree=67023148/67111528
[pid=12049] ppid=12047 vsize=1383776 CPUtime=4227.64 cores=1,3,5,7
/proc/12049/stat : 12049 (SArTagnan) R 12047 12049 11674 0 -1 4202496 11028753 0 0 0 421144 1620 0 0 25 0 4 0 650552160 1416986624 283455 33554432000 4194304 4625164 140736960612816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/12049/statm: 345944 283455 420 106 0 341447 0
[pid=12049/tid=12050] ppid=12047 vsize=1383776 CPUtime=1095.36 cores=1,3,5,7
/proc/12049/task/12050/stat : 12050 (SArTagnan) R 12047 12049 11674 0 -1 4202560 134424 0 0 0 109506 30 0 0 25 0 4 0 650552162 1416986624 283455 33554432000 4194304 4625164 140736960612816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=12049/tid=12051] ppid=12047 vsize=1383776 CPUtime=908.44 cores=1,3,5,7
/proc/12049/task/12051/stat : 12051 (SArTagnan) R 12047 12049 11674 0 -1 4202560 135249 0 0 0 90813 31 0 0 25 0 4 0 650552162 1416986624 283455 33554432000 4194304 4625164 140736960612816 18446744073709551615 4352102 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12049/tid=12052] ppid=12047 vsize=1383776 CPUtime=1132.36 cores=1,3,5,7
/proc/12049/task/12052/stat : 12052 (SArTagnan) R 12047 12049 11674 0 -1 4202560 10561877 0 0 0 111710 1526 0 0 25 0 4 0 650552162 1416986624 283455 33554432000 4194304 4625164 140736960612816 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4227.64
Current children cumulated vsize (KiB) 1383776

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.07
CPU time (s): 4227.74
CPU user time (s): 4211.49
CPU system time (s): 16.2495
CPU usage (%): 325.193
Max. virtual memory (cumulated for all children) (KiB): 1449312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4211.49
system time used= 16.2495
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11028753
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2147
involuntary context switches= 28052

runsolver used 5.2862 second user time and 13.6419 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-16 23:29:23
IDJOB=3385890
IDBENCH=83189
IDSOLVER=1871
FILE ID=node145/3385890-1305581363
RUNJOBID= node145-1305577446-11693
PBS_JOBID= 13350223
Free space on /tmp= 73628 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_20_360_u.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385890-1305581363/watcher-3385890-1305581363 -o /tmp/evaluation-result-3385890-1305581363/solver-3385890-1305581363 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385890-1305581363.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4b70d66c676eba3660e2a5eff473f8e7
RANDOM SEED=2059358795

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20124276 kB
Buffers:        110116 kB
Cached:         929592 kB
SwapCached:       4796 kB
Active:        9009040 kB
Inactive:      3559240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20124276 kB
SwapTotal:    67111528 kB
SwapFree:     67023148 kB
Dirty:             696 kB
Writeback:           0 kB
AnonPages:    11523848 kB
Mapped:          34220 kB
Slab:           136548 kB
PageTables:      55744 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 120250952 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73632 MiB
End job on node145 at 2011-05-16 23:51:05