Trace number 3386220

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3344.84 1300.05

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.11.unsat.cnf
MD5SUM90581094793af5fc10d4e4b9a10259ac
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark643.759
Satisfiable
(Un)Satisfiability was proved
Number of variables1400
Number of clauses4732
Sum of the clauses size12300
Maximum clause length21
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22052
Number of clauses of size 32605
Number of clauses of size 427
Number of clauses of size 531
Number of clauses of size over 514

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386220-1305576783/watcher-3386220-1305576783 -o /tmp/evaluation-result-3386220-1305576783/solver-3386220-1305576783 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386220-1305576783.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.12 11.14 11.22 9/394 6071
/proc/meminfo: memFree=17526712/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 712 0 0 0 0 0 0 0 25 0 4 0 669276214 51634176 649 33554432000 4194304 4625164 140733606639392 18446744073709551615 47473075664816 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 12606 649 304 106 0 8109 0
[pid=6071/tid=6072] ppid=6069 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 669276215 51634176 649 33554432000 4194304 4625164 140733606639392 18446744073709551615 47473075664818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669276215 51634176 649 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550594033 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=50424 CPUtime=0 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669276215 51634176 649 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550594033 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.138999 s]
/proc/loadavg: 10.12 11.14 11.22 9/394 6071
/proc/meminfo: memFree=17526712/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=182084 CPUtime=0.29 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 994 0 0 0 29 0 0 0 25 0 4 0 669276214 186454016 929 33554432000 4194304 4625164 140733606639392 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 45521 929 342 106 0 41024 0
[pid=6071/tid=6072] ppid=6069 vsize=182084 CPUtime=0.1 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 64 0 0 0 10 0 0 0 25 0 4 0 669276215 186454016 929 33554432000 4194304 4625164 140733606639392 18446744073709551615 4339690 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=182084 CPUtime=0.02 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 78 0 0 0 2 0 0 0 25 0 4 0 669276215 186454016 929 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=182084 CPUtime=0.12 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 110 0 0 0 12 0 0 0 25 0 4 0 669276215 186454016 929 33554432000 4194304 4625164 140733606639392 18446744073709551615 4339920 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 182084

[startup+0.20099 s]
/proc/loadavg: 10.12 11.14 11.22 9/394 6071
/proc/meminfo: memFree=17526712/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=249752 CPUtime=0.4 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2413 0 0 0 40 0 0 0 25 0 4 0 669276214 255746048 1693 33554432000 4194304 4625164 140733606639392 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/6071/statm: 62438 1693 343 106 0 57941 0
[pid=6071/tid=6072] ppid=6069 vsize=249752 CPUtime=0.13 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 427 0 0 0 13 0 0 0 25 0 4 0 669276215 255746048 1693 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352089 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=249752 CPUtime=0.05 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 261 0 0 0 5 0 0 0 25 0 4 0 669276215 255746048 1693 33554432000 4194304 4625164 140733606639392 18446744073709551615 4279928 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=249752 CPUtime=0.16 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 437 0 0 0 16 0 0 0 25 0 4 0 669276215 255746048 1693 33554432000 4194304 4625164 140733606639392 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 249752

[startup+0.302713 s]
/proc/loadavg: 10.12 11.14 11.22 9/394 6071
/proc/meminfo: memFree=17526712/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=251476 CPUtime=0.59 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 3082 0 0 0 59 0 0 0 25 0 4 0 669276214 257511424 1980 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550234832 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/6071/statm: 62869 1980 343 106 0 58372 0
[pid=6071/tid=6072] ppid=6069 vsize=251476 CPUtime=0.21 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) D 6069 6071 5970 0 -1 4202560 653 0 0 0 21 0 0 0 18 0 4 0 669276215 257511424 1980 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550580919 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=251476 CPUtime=0.12 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 583 0 0 0 12 0 0 0 25 0 4 0 669276215 257511424 1980 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550198817 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=251476 CPUtime=0.19 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 476 0 0 0 19 0 0 0 25 0 4 0 669276215 257511424 1980 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550234832 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 251476

[startup+1.15518 s]
/proc/loadavg: 10.12 11.14 11.22 9/394 6071
/proc/meminfo: memFree=17526712/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=253112 CPUtime=2.49 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 5878 0 0 0 249 0 0 0 25 0 4 0 669276214 259186688 3842 33554432000 4194304 4625164 140733606639392 18446744073709551615 4356217 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 63278 3843 346 106 0 58781 0
[pid=6071/tid=6072] ppid=6069 vsize=253112 CPUtime=1.05 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1218 0 0 0 105 0 0 0 19 0 4 0 669276215 259186688 3843 33554432000 4194304 4625164 140733606639392 18446744073709551615 271550642670 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=253112 CPUtime=0.54 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1072 0 0 0 54 0 0 0 25 0 4 0 669276215 259186688 3844 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352174 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=253112 CPUtime=0.63 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1044 0 0 0 63 0 0 0 25 0 4 0 669276215 259186688 3845 33554432000 4194304 4625164 140733606639392 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.49
Current children cumulated vsize (KiB) 253112

[startup+1.50075 s]
/proc/loadavg: 10.12 11.14 11.22 9/394 6071
/proc/meminfo: memFree=17526712/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=253112 CPUtime=3.37 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 6405 0 0 0 337 0 0 0 25 0 4 0 669276214 259186688 4042 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512078 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 63278 4042 346 106 0 58781 0
[pid=6071/tid=6072] ppid=6069 vsize=253112 CPUtime=1.4 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1239 0 0 0 140 0 0 0 19 0 4 0 669276215 259186688 4042 33554432000 4194304 4625164 140733606639392 18446744073709551615 4278640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=253112 CPUtime=0.72 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1075 0 0 0 72 0 0 0 25 0 4 0 669276215 259186688 4042 33554432000 4194304 4625164 140733606639392 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=253112 CPUtime=0.82 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1522 0 0 0 82 0 0 0 25 0 4 0 669276215 259186688 4042 33554432000 4194304 4625164 140733606639392 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.37
Current children cumulated vsize (KiB) 253112

[startup+3.10047 s]
/proc/loadavg: 10.27 11.16 11.22 12/398 6075
/proc/meminfo: memFree=17490108/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=255940 CPUtime=7.35 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 10466 0 0 0 734 1 0 0 25 0 4 0 669276214 262082560 5553 33554432000 4194304 4625164 140733606639392 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 63985 5553 347 106 0 59488 0
[pid=6071/tid=6072] ppid=6069 vsize=255940 CPUtime=2.97 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2529 0 0 0 297 0 0 0 23 0 4 0 669276215 262082560 5553 33554432000 4194304 4625164 140733606639392 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=255940 CPUtime=1.52 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1532 0 0 0 152 0 0 0 25 0 4 0 669276215 262082560 5553 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=255940 CPUtime=1.61 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 3796 0 0 0 161 0 0 0 25 0 4 0 669276215 262082560 5553 33554432000 4194304 4625164 140733606639392 18446744073709551615 4562224 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 7.35
Current children cumulated vsize (KiB) 255940

[startup+6.30088 s]
/proc/loadavg: 10.49 11.19 11.23 13/398 6075
/proc/meminfo: memFree=17464564/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=262608 CPUtime=15.9 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 20569 0 0 0 1588 2 0 0 25 0 4 0 669276214 268910592 9611 33554432000 4194304 4625164 140733606639392 18446744073709551615 4513499 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6071/statm: 65652 9611 347 106 0 61155 0
[pid=6071/tid=6072] ppid=6069 vsize=262608 CPUtime=4.83 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 3776 0 0 0 483 0 0 0 25 0 4 0 669276215 268910592 9611 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=262608 CPUtime=4.42 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 3867 0 0 0 442 0 0 0 25 0 4 0 669276215 268910592 9611 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=262608 CPUtime=3.8 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 9909 0 0 0 379 1 0 0 25 0 4 0 669276215 268910592 9611 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352299 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 15.9
Current children cumulated vsize (KiB) 262608

[startup+12.7007 s]
/proc/loadavg: 10.53 11.18 11.23 12/398 6076
/proc/meminfo: memFree=17425316/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=268096 CPUtime=31.54 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 32980 0 0 0 3150 4 0 0 25 0 4 0 669276214 274530304 13594 33554432000 4194304 4625164 140733606639392 18446744073709551615 4356856 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 67024 13594 347 106 0 62527 0
[pid=6071/tid=6072] ppid=6069 vsize=268096 CPUtime=8 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 5489 0 0 0 800 0 0 0 25 0 4 0 669276215 274530304 13594 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=268096 CPUtime=9.04 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 5980 0 0 0 904 0 0 0 25 0 4 0 669276215 274530304 13594 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=268096 CPUtime=8.41 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 18010 0 0 0 839 2 0 0 25 0 4 0 669276215 274530304 13594 33554432000 4194304 4625164 140733606639392 18446744073709551615 4551671 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 31.54
Current children cumulated vsize (KiB) 268096

[startup+25.5004 s]
/proc/loadavg: 10.60 11.18 11.22 12/398 6076
/proc/meminfo: memFree=17376996/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=283480 CPUtime=57.26 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 60279 0 0 0 5719 7 0 0 25 0 4 0 669276214 290283520 19681 33554432000 4194304 4625164 140733606639392 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6071/statm: 70870 19681 350 106 0 66373 0
[pid=6071/tid=6072] ppid=6069 vsize=283480 CPUtime=14.28 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 8276 0 0 0 1427 1 0 0 25 0 4 0 669276215 290283520 19681 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=283480 CPUtime=15.32 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 8520 0 0 0 1531 1 0 0 25 0 4 0 669276215 290283520 19681 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=283480 CPUtime=15.11 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 38831 0 0 0 1507 4 0 0 25 0 4 0 669276215 290283520 19681 33554432000 4194304 4625164 140733606639392 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 57.26
Current children cumulated vsize (KiB) 283480

[startup+51.1007 s]
/proc/loadavg: 10.81 11.17 11.22 12/398 6077
/proc/meminfo: memFree=17307920/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=292784 CPUtime=108.14 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 124610 0 0 0 10798 16 0 0 25 0 4 0 669276214 299810816 26540 33554432000 4194304 4625164 140733606639392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/6071/statm: 73196 26540 350 106 0 68699 0
[pid=6071/tid=6072] ppid=6069 vsize=292784 CPUtime=27.2 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 11498 0 0 0 2718 2 0 0 25 0 4 0 669276215 299810816 26540 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=292784 CPUtime=27.93 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 9545 0 0 0 2792 1 0 0 25 0 4 0 669276215 299810816 26540 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=292784 CPUtime=27.71 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 96413 0 0 0 2760 11 0 0 25 0 4 0 669276215 299810816 26540 33554432000 4194304 4625164 140733606639392 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 108.14
Current children cumulated vsize (KiB) 292784

[startup+102.3 s]
/proc/loadavg: 11.01 11.17 11.22 12/398 6078
/proc/meminfo: memFree=17177072/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=379936 CPUtime=209.88 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 239636 0 0 0 20955 33 0 0 25 0 4 0 669276214 389054464 41309 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/6071/statm: 94984 41309 349 106 0 90487 0
[pid=6071/tid=6072] ppid=6069 vsize=379936 CPUtime=52.61 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 19166 0 0 0 5258 3 0 0 25 0 4 0 669276215 389054464 41309 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=379936 CPUtime=53.13 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 13726 0 0 0 5311 2 0 0 25 0 4 0 669276215 389054464 41309 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=379936 CPUtime=53.51 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 196874 0 0 0 5325 26 0 0 25 0 4 0 669276215 389054464 41309 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351866 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 209.88
Current children cumulated vsize (KiB) 379936

[startup+162.301 s]

################
# More data... #
################

[pid=6071] ppid=6069 vsize=901884 CPUtime=1973.94 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 1439163 0 0 0 197168 226 0 0 25 0 4 0 669276214 923529216 164313 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 225471 164313 1451 106 0 220974 0
[pid=6071/tid=6072] ppid=6069 vsize=901884 CPUtime=471.72 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54805 0 0 0 47163 9 0 0 25 0 4 0 669276215 923529216 164313 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=901884 CPUtime=586.93 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 36636 0 0 0 58687 6 0 0 25 0 4 0 669276215 923529216 164313 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=901884 CPUtime=534.61 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1227685 0 0 0 53269 192 0 0 25 0 4 0 669276215 923529216 164313 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351866 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1973.94
Current children cumulated vsize (KiB) 901884

[startup+822.301 s]
/proc/loadavg: 11.36 11.25 11.21 12/398 6097
/proc/meminfo: memFree=16028292/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=901884 CPUtime=2151.17 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 1705259 0 0 0 214846 271 0 0 25 0 4 0 669276214 923529216 171580 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 225471 171580 1409 106 0 220974 0
[pid=6071/tid=6072] ppid=6069 vsize=901884 CPUtime=501.71 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54805 0 0 0 50162 9 0 0 25 0 4 0 669276215 923529216 171580 33554432000 4194304 4625164 140733606639392 18446744073709551615 4467783 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=901884 CPUtime=646.95 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 36828 0 0 0 64689 6 0 0 25 0 4 0 669276215 923529216 171580 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=901884 CPUtime=591.83 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1491889 0 0 0 58946 237 0 0 25 0 4 0 669276215 923529216 171580 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2151.17
Current children cumulated vsize (KiB) 901884

[startup+882.301 s]
/proc/loadavg: 11.13 11.20 11.19 12/398 6099
/proc/meminfo: memFree=15970116/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=901884 CPUtime=2300.76 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 1840007 0 0 0 229784 292 0 0 25 0 4 0 669276214 923529216 176193 33554432000 4194304 4625164 140733606639392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 225471 176193 1376 106 0 220974 0
[pid=6071/tid=6072] ppid=6069 vsize=901884 CPUtime=531.71 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54805 0 0 0 53162 9 0 0 25 0 4 0 669276215 923529216 176193 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=901884 CPUtime=706.94 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 37352 0 0 0 70688 6 0 0 25 0 4 0 669276215 923529216 176193 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=901884 CPUtime=621.42 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1623934 0 0 0 61885 257 0 0 25 0 4 0 669276215 923529216 176193 33554432000 4194304 4625164 140733606639392 18446744073709551615 4579317 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2300.76
Current children cumulated vsize (KiB) 901884

[startup+942.315 s]
/proc/loadavg: 11.15 11.19 11.18 12/398 6100
/proc/meminfo: memFree=15924328/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1001432 CPUtime=2450.4 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 1990897 0 0 0 244725 315 0 0 25 0 4 0 669276214 1025466368 181349 33554432000 4194304 4625164 140733606639392 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 250358 181349 1362 106 0 245861 0
[pid=6071/tid=6072] ppid=6069 vsize=1001432 CPUtime=561.73 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54805 0 0 0 56164 9 0 0 25 0 4 0 669276215 1025466368 181349 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1001432 CPUtime=766.95 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 37391 0 0 0 76689 6 0 0 25 0 4 0 669276215 1025466368 181349 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1001432 CPUtime=651.04 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1755332 0 0 0 64826 278 0 0 25 0 4 0 669276215 1025466368 181349 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2450.4
Current children cumulated vsize (KiB) 1001432

[startup+1002.3 s]
/proc/loadavg: 11.25 11.22 11.19 12/398 6102
/proc/meminfo: memFree=15875704/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1001432 CPUtime=2600.26 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2130119 0 0 0 259688 338 0 0 25 0 4 0 669276214 1025466368 185089 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 250358 185089 1352 106 0 245861 0
[pid=6071/tid=6072] ppid=6069 vsize=1001432 CPUtime=591.72 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 59163 9 0 0 25 0 4 0 669276215 1025466368 185089 33554432000 4194304 4625164 140733606639392 18446744073709551615 4465717 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1001432 CPUtime=826.94 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 37508 0 0 0 82688 6 0 0 25 0 4 0 669276215 1025466368 185089 33554432000 4194304 4625164 140733606639392 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1001432 CPUtime=680.91 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 1893367 0 0 0 67791 300 0 0 25 0 4 0 669276215 1025466368 185089 33554432000 4194304 4625164 140733606639392 18446744073709551615 4552410 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2600.26
Current children cumulated vsize (KiB) 1001432

[startup+1062.3 s]
/proc/loadavg: 11.28 11.23 11.19 12/398 6104
/proc/meminfo: memFree=15819376/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1001432 CPUtime=2750.25 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2262796 0 0 0 274666 359 0 0 25 0 4 0 669276214 1025466368 189158 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 250358 189158 1338 106 0 245861 0
[pid=6071/tid=6072] ppid=6069 vsize=1001432 CPUtime=621.73 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 62164 9 0 0 25 0 4 0 669276215 1025466368 189158 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1001432 CPUtime=886.94 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 37581 0 0 0 88688 6 0 0 25 0 4 0 669276215 1025466368 189158 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1001432 CPUtime=710.91 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2024305 0 0 0 70770 321 0 0 25 0 4 0 669276215 1025466368 189158 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2750.25
Current children cumulated vsize (KiB) 1001432

[startup+1122.3 s]
/proc/loadavg: 11.35 11.26 11.20 12/398 6105
/proc/meminfo: memFree=15750168/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1001432 CPUtime=2900.25 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2393053 0 0 0 289646 379 0 0 25 0 4 0 669276214 1025466368 193479 33554432000 4194304 4625164 140733606639392 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 250358 193479 1331 106 0 245861 0
[pid=6071/tid=6072] ppid=6069 vsize=1001432 CPUtime=651.73 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 65164 9 0 0 25 0 4 0 669276215 1025466368 193479 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1001432 CPUtime=946.95 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 38605 0 0 0 94688 7 0 0 25 0 4 0 669276215 1025466368 193479 33554432000 4194304 4625164 140733606639392 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1001432 CPUtime=740.91 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2152072 0 0 0 73751 340 0 0 25 0 4 0 669276215 1025466368 193479 33554432000 4194304 4625164 140733606639392 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2900.25
Current children cumulated vsize (KiB) 1001432

[startup+1182.3 s]
/proc/loadavg: 11.28 11.26 11.20 12/398 6107
/proc/meminfo: memFree=15667692/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1025932 CPUtime=3050.25 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2545391 0 0 0 304622 403 0 0 25 0 4 0 669276214 1050554368 199010 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 256483 199010 1324 106 0 251986 0
[pid=6071/tid=6072] ppid=6069 vsize=1025932 CPUtime=681.74 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 68165 9 0 0 25 0 4 0 669276215 1050554368 199010 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1025932 CPUtime=1006.95 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 52523 0 0 0 100687 8 0 0 25 0 4 0 669276215 1050554368 199010 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1025932 CPUtime=770.9 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2289490 0 0 0 76728 362 0 0 25 0 4 0 669276215 1050554368 199010 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3050.25
Current children cumulated vsize (KiB) 1025932

[startup+1242.3 s]
/proc/loadavg: 11.26 11.25 11.20 12/398 6108
/proc/meminfo: memFree=15636648/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1041720 CPUtime=3200.05 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2671396 0 0 0 319583 422 0 0 25 0 4 0 669276214 1066721280 204293 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512122 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 260430 204293 1059 106 0 255933 0
[pid=6071/tid=6072] ppid=6069 vsize=1041720 CPUtime=711.94 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 71185 9 0 0 25 0 4 0 669276215 1066721280 204293 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1041720 CPUtime=1066.95 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54226 0 0 0 106687 8 0 0 25 0 4 0 669276215 1066721280 204293 33554432000 4194304 4625164 140733606639392 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1041720 CPUtime=800.69 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2412412 0 0 0 79689 380 0 0 25 0 4 0 669276215 1066721280 204293 33554432000 4194304 4625164 140733606639392 18446744073709551615 4552320 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3200.05
Current children cumulated vsize (KiB) 1041720



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.81 11.15 11.16 8/393 6111
/proc/meminfo: memFree=16661400/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1150312 CPUtime=3344.77 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2827301 0 0 0 334033 444 0 0 25 0 4 0 669276214 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 287578 220200 1089 106 0 283081 0
[pid=6071/tid=6072] ppid=6069 vsize=1150312 CPUtime=740.78 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 74069 9 0 0 25 0 4 0 669276215 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1150312 CPUtime=1124.67 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54371 0 0 0 112459 8 0 0 25 0 4 0 669276215 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1150312 CPUtime=830 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2539151 0 0 0 82601 399 0 0 25 0 4 0 669276215 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3344.77
Current children cumulated vsize (KiB) 1150312

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 10.81 11.15 11.16 8/393 6111
/proc/meminfo: memFree=16661400/32951124 swapFree=67056796/67111528
[pid=6071] ppid=6069 vsize=1150312 CPUtime=3344.77 cores=1,3,5,7
/proc/6071/stat : 6071 (SArTagnan) R 6069 6071 5970 0 -1 4202496 2827301 0 0 0 334033 444 0 0 25 0 4 0 669276214 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6071/statm: 287578 220200 1089 106 0 283081 0
[pid=6071/tid=6072] ppid=6069 vsize=1150312 CPUtime=740.78 cores=1,3,5,7
/proc/6071/task/6072/stat : 6072 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54846 0 0 0 74069 9 0 0 25 0 4 0 669276215 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6071/tid=6073] ppid=6069 vsize=1150312 CPUtime=1124.67 cores=1,3,5,7
/proc/6071/task/6073/stat : 6073 (SArTagnan) R 6069 6071 5970 0 -1 4202560 54371 0 0 0 112459 8 0 0 25 0 4 0 669276215 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6071/tid=6074] ppid=6069 vsize=1150312 CPUtime=830 cores=1,3,5,7
/proc/6071/task/6074/stat : 6074 (SArTagnan) R 6069 6071 5970 0 -1 4202560 2539151 0 0 0 82601 399 0 0 25 0 4 0 669276215 1177919488 220200 33554432000 4194304 4625164 140733606639392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3344.77
Current children cumulated vsize (KiB) 1150312

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.05
CPU time (s): 3344.84
CPU user time (s): 3340.37
CPU system time (s): 4.47432
CPU usage (%): 257.285
Max. virtual memory (cumulated for all children) (KiB): 1157004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3340.37
system time used= 4.47432
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2827301
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 920
involuntary context switches= 40592

runsolver used 4.6123 second user time and 11.9472 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-16 22:13:03
IDJOB=3386220
IDBENCH=20472
IDSOLVER=1871
FILE ID=node133/3386220-1305576783
RUNJOBID= node133-1305576779-5989
PBS_JOBID= 13350209
Free space on /tmp= 73400 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.11.unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386220-1305576783/watcher-3386220-1305576783 -o /tmp/evaluation-result-3386220-1305576783/solver-3386220-1305576783 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386220-1305576783.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 90581094793af5fc10d4e4b9a10259ac
RANDOM SEED=883050761

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17527116 kB
Buffers:        326084 kB
Cached:        4509640 kB
SwapCached:       7668 kB
Active:       11797512 kB
Inactive:      3310716 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17527116 kB
SwapTotal:    67111528 kB
SwapFree:     67056796 kB
Dirty:            1424 kB
Writeback:          16 kB
AnonPages:    10270636 kB
Mapped:          31940 kB
Slab:           202656 kB
PageTables:      45072 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 84998376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73400 MiB
End job on node133 at 2011-05-16 22:34:45