Trace number 3386003

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3010.27 1300.08

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-13-13-unsat.cnf
MD5SUMb828910e9308a3dd9d5f850f224ef842
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark385.978
Satisfiable
(Un)Satisfiability was proved
Number of variables169
Number of clauses1183
Sum of the clauses size4225
Maximum clause length13
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21014
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5169

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386003-1305581537/watcher-3386003-1305581537 -o /tmp/evaluation-result-3386003-1305581537/solver-3386003-1305581537 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386003-1305581537.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 12.25 12.18 12.11 9/494 8838
/proc/meminfo: memFree=20601976/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=49352 CPUtime=0 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 460 0 0 0 0 0 0 0 25 0 4 0 669750753 50536448 397 33554432000 4194304 4625164 140737340126368 18446744073709551615 47437636761522 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8838/statm: 12338 397 301 106 0 7841 0
[pid=8838/tid=8839] ppid=8836 vsize=49352 CPUtime=0 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 669750753 50536448 398 33554432000 4194304 4625164 140737340126368 18446744073709551615 47437636761526 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=49352 CPUtime=0 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669750753 50536448 398 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476751345 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=49352 CPUtime=0 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669750753 50536448 398 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476751345 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.117659 s]
/proc/loadavg: 12.25 12.18 12.11 9/494 8838
/proc/meminfo: memFree=20601976/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=115796 CPUtime=0.21 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 846 0 0 0 21 0 0 0 25 0 4 0 669750753 118575104 695 33554432000 4194304 4625164 140737340126368 18446744073709551615 4356532 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 28949 695 341 106 0 24452 0
[pid=8838/tid=8839] ppid=8836 vsize=115796 CPUtime=0.06 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 106 0 0 0 6 0 0 0 25 0 4 0 669750753 118575104 695 33554432000 4194304 4625164 140737340126368 18446744073709551615 4462944 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=115796 CPUtime=0.02 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 0 0 0 0 2 0 0 0 25 0 4 0 669750753 118575104 695 33554432000 4194304 4625164 140737340126368 18446744073709551615 47437636761522 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=115796 CPUtime=0.01 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 68 0 0 0 1 0 0 0 25 0 4 0 669750753 118575104 695 33554432000 4194304 4625164 140737340126368 18446744073709551615 4579432 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 115796

[startup+0.200644 s]
/proc/loadavg: 12.25 12.18 12.11 9/494 8838
/proc/meminfo: memFree=20601976/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=117288 CPUtime=0.37 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 1450 0 0 0 37 0 0 0 25 0 4 0 669750753 120102912 1160 33554432000 4194304 4625164 140737340126368 18446744073709551615 4425439 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 29322 1160 341 106 0 24825 0
[pid=8838/tid=8839] ppid=8836 vsize=117288 CPUtime=0.14 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 500 0 0 0 14 0 0 0 25 0 4 0 669750753 120102912 1160 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=117288 CPUtime=0.02 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 0 0 0 0 2 0 0 0 25 0 4 0 669750753 120102912 1160 33554432000 4194304 4625164 140737340126368 18446744073709551615 47437636761522 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=117288 CPUtime=0.01 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 68 0 0 0 1 0 0 0 25 0 4 0 669750753 120102912 1160 33554432000 4194304 4625164 140737340126368 18446744073709551615 4579432 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 117288

[startup+0.300627 s]
/proc/loadavg: 12.25 12.18 12.11 9/494 8838
/proc/meminfo: memFree=20601976/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=184712 CPUtime=0.57 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 2299 0 0 0 57 0 0 0 25 0 4 0 669750753 189145088 1785 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476799982 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 46178 1785 342 106 0 41681 0
[pid=8838/tid=8839] ppid=8836 vsize=184712 CPUtime=0.17 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 718 0 0 0 17 0 0 0 25 0 4 0 669750753 189145088 1785 33554432000 4194304 4625164 140737340126368 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=184712 CPUtime=0.09 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) D 8836 8838 8278 0 -1 4202560 396 0 0 0 9 0 0 0 25 0 4 0 669750753 189145088 1786 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476392144 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=184712 CPUtime=0.07 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 135 0 0 0 7 0 0 0 25 0 4 0 669750753 189145088 1787 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351714 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 184712

[startup+0.95996 s]
/proc/loadavg: 12.25 12.18 12.11 9/494 8838
/proc/meminfo: memFree=20601976/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=190256 CPUtime=2.25 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 6849 0 0 0 224 1 0 0 25 0 4 0 669750753 194822144 4864 33554432000 4194304 4625164 140737340126368 18446744073709551615 4363952 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8838/statm: 47564 4864 342 106 0 43067 0
[pid=8838/tid=8839] ppid=8836 vsize=190256 CPUtime=0.9 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 3175 0 0 0 90 0 0 0 19 0 4 0 669750753 194822144 4864 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476356129 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=190256 CPUtime=0.09 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 442 0 0 0 9 0 0 0 25 0 4 0 669750753 194822144 4864 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476392405 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=190256 CPUtime=0.8 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 1964 0 0 0 80 0 0 0 19 0 4 0 669750753 194822144 4864 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476392405 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.25
Current children cumulated vsize (KiB) 190256

[startup+1.5004 s]
/proc/loadavg: 12.25 12.18 12.11 9/494 8838
/proc/meminfo: memFree=20601976/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=190144 CPUtime=3.17 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 8934 0 0 0 316 1 0 0 25 0 4 0 669750753 194707456 5803 33554432000 4194304 4625164 140737340126368 18446744073709551615 4508942 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 47536 5803 349 106 0 43039 0
[pid=8838/tid=8839] ppid=8836 vsize=190144 CPUtime=1.23 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 3947 0 0 0 123 0 0 0 19 0 4 0 669750753 194707456 5803 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=190144 CPUtime=0.22 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 1081 0 0 0 22 0 0 0 25 0 4 0 669750753 194707456 5803 33554432000 4194304 4625164 140737340126368 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=190144 CPUtime=1.08 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2504 0 0 0 108 0 0 0 19 0 4 0 669750753 194707456 5803 33554432000 4194304 4625164 140737340126368 18446744073709551615 4335207 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.17
Current children cumulated vsize (KiB) 190144

[startup+3.10109 s]
/proc/loadavg: 12.23 12.18 12.11 13/498 8842
/proc/meminfo: memFree=20560184/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=202640 CPUtime=6.34 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 15171 0 0 0 631 3 0 0 25 0 4 0 669750753 207503360 10372 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512081 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 50660 10372 392 106 0 46163 0
[pid=8838/tid=8839] ppid=8836 vsize=202640 CPUtime=2.04 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 5507 0 0 0 203 1 0 0 20 0 4 0 669750753 207503360 10372 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=202640 CPUtime=1.01 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 3655 0 0 0 101 0 0 0 25 0 4 0 669750753 207503360 10372 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=202640 CPUtime=1.84 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 3488 0 0 0 184 0 0 0 20 0 4 0 669750753 207503360 10372 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.34
Current children cumulated vsize (KiB) 202640

[startup+6.30049 s]
/proc/loadavg: 12.23 12.18 12.11 13/498 8842
/proc/meminfo: memFree=20539476/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=212608 CPUtime=12.68 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 21598 0 0 0 1264 4 0 0 25 0 4 0 669750753 217710592 13911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 53152 13911 346 106 0 48655 0
[pid=8838/tid=8839] ppid=8836 vsize=212608 CPUtime=3.63 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 7823 0 0 0 362 1 0 0 25 0 4 0 669750753 217710592 13911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=212608 CPUtime=2.61 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 5813 0 0 0 261 0 0 0 25 0 4 0 669750753 217710592 13911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=212608 CPUtime=3.5 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 4921 0 0 0 349 1 0 0 25 0 4 0 669750753 217710592 13911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4555531 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 212608

[startup+12.7003 s]
/proc/loadavg: 12.19 12.17 12.10 13/498 8843
/proc/meminfo: memFree=20505260/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=296028 CPUtime=25.63 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 43544 0 0 0 2555 8 0 0 25 0 4 0 669750753 303132672 21674 33554432000 4194304 4625164 140737340126368 18446744073709551615 4393068 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 74007 21674 352 106 0 69510 0
[pid=8838/tid=8839] ppid=8836 vsize=296028 CPUtime=6.77 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 11679 0 0 0 675 2 0 0 25 0 4 0 669750753 303132672 21652 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=296028 CPUtime=5.82 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 12693 0 0 0 580 2 0 0 25 0 4 0 669750753 303132672 21652 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=296028 CPUtime=6.63 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 14836 0 0 0 660 3 0 0 25 0 4 0 669750753 303132672 21652 33554432000 4194304 4625164 140737340126368 18446744073709551615 4552423 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.63
Current children cumulated vsize (KiB) 296028

[startup+25.5008 s]
/proc/loadavg: 12.32 12.20 12.11 13/498 8843
/proc/meminfo: memFree=20449980/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=327140 CPUtime=56.84 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 79871 0 0 0 5669 15 0 0 25 0 4 0 669750753 334991360 34711 33554432000 4194304 4625164 140737340126368 18446744073709551615 4511982 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 81785 34711 547 106 0 77288 0
[pid=8838/tid=8839] ppid=8836 vsize=327140 CPUtime=13.04 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 17578 0 0 0 1301 3 0 0 25 0 4 0 669750753 334991360 34711 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476799982 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=327140 CPUtime=12.14 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 18887 0 0 0 1211 3 0 0 25 0 4 0 669750753 334991360 34711 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=327140 CPUtime=13.65 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 35152 0 0 0 1359 6 0 0 25 0 4 0 669750753 334991360 34711 33554432000 4194304 4625164 140737340126368 18446744073709551615 4547843 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 56.84
Current children cumulated vsize (KiB) 327140

[startup+51.1009 s]
/proc/loadavg: 12.27 12.20 12.11 13/498 8844
/proc/meminfo: memFree=20383264/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=350136 CPUtime=120.13 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 119924 0 0 0 11988 25 0 0 25 0 4 0 669750753 358539264 49455 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512021 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 87534 49455 501 106 0 83037 0
[pid=8838/tid=8839] ppid=8836 vsize=350136 CPUtime=25.54 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 27040 0 0 0 2547 7 0 0 25 0 4 0 669750753 358539264 49455 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=350136 CPUtime=24.81 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 28344 0 0 0 2475 6 0 0 25 0 4 0 669750753 358539264 49455 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=350136 CPUtime=33.08 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 53810 0 0 0 3300 8 0 0 25 0 4 0 669750753 358539264 49455 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 120.13
Current children cumulated vsize (KiB) 350136

[startup+102.301 s]
/proc/loadavg: 12.27 12.21 12.12 13/498 8845
/proc/meminfo: memFree=20260364/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=492552 CPUtime=247.12 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 191828 0 0 0 24673 39 0 0 25 0 4 0 669750753 504373248 71923 33554432000 4194304 4625164 140737340126368 18446744073709551615 239476392304 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 123138 71923 444 106 0 118641 0
[pid=8838/tid=8839] ppid=8836 vsize=492552 CPUtime=50.74 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 39936 0 0 0 5062 12 0 0 25 0 4 0 669750753 504373248 71923 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=492552 CPUtime=54.33 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 41777 0 0 0 5425 8 0 0 25 0 4 0 669750753 504373248 71923 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352760 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=492552 CPUtime=58.3 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 92382 0 0 0 5816 14 0 0 25 0 4 0 669750753 504373248 71923 33554432000 4194304 4625164 140737340126368 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 247.12
Current children cumulated vsize (KiB) 492552

[startup+162.301 s]

################
# More data... #
################

[pid=8838] ppid=8836 vsize=1231480 CPUtime=1839.42 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 2253271 0 0 0 183552 390 0 0 25 0 4 0 669750753 1261035520 236320 33554432000 4194304 4625164 140737340126368 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8838/statm: 307870 236320 453 106 0 303373 0
[pid=8838/tid=8839] ppid=8836 vsize=1231480 CPUtime=386.2 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 110803 0 0 0 38564 56 0 0 25 0 4 0 669750753 1261035520 236320 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1231480 CPUtime=449.44 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 144555 0 0 0 44914 30 0 0 25 0 4 0 669750753 1261035520 236320 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1231480 CPUtime=383.34 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 1604823 0 0 0 38103 231 0 0 25 0 4 0 669750753 1261035520 236320 33554432000 4194304 4625164 140737340126368 18446744073709551615 4547836 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1839.42
Current children cumulated vsize (KiB) 1231480

[startup+822.3 s]
/proc/loadavg: 12.17 12.16 12.10 13/498 8895
/proc/meminfo: memFree=18974104/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1288944 CPUtime=1985.53 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 2470093 0 0 0 198127 426 0 0 25 0 4 0 669750753 1319878656 250629 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512054 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8838/statm: 322236 250629 426 106 0 317739 0
[pid=8838/tid=8839] ppid=8836 vsize=1288944 CPUtime=416.18 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 144099 0 0 0 41554 64 0 0 25 0 4 0 669750753 1319878656 250630 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1288944 CPUtime=487.59 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 147763 0 0 0 48728 31 0 0 25 0 4 0 669750753 1319878656 250630 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1288944 CPUtime=417.44 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 1782517 0 0 0 41487 257 0 0 25 0 4 0 669750753 1319878656 250630 33554432000 4194304 4625164 140737340126368 18446744073709551615 4552423 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1985.53
Current children cumulated vsize (KiB) 1288944

[startup+882.301 s]
/proc/loadavg: 12.17 12.16 12.10 13/498 8897
/proc/meminfo: memFree=18895960/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1427492 CPUtime=2115.35 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 2624738 0 0 0 211081 454 0 0 25 0 4 0 669750753 1461751808 267911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8838/statm: 356873 267911 414 106 0 352376 0
[pid=8838/tid=8839] ppid=8836 vsize=1427492 CPUtime=445.97 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 147768 0 0 0 44527 70 0 0 25 0 4 0 669750753 1461751808 267911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1427492 CPUtime=517.59 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 153044 0 0 0 51726 33 0 0 25 0 4 0 669750753 1461751808 267911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1427492 CPUtime=447.16 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 1887225 0 0 0 44444 272 0 0 25 0 4 0 669750753 1461751808 267911 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2115.35
Current children cumulated vsize (KiB) 1427492

[startup+942.319 s]
/proc/loadavg: 12.12 12.14 12.09 13/498 8899
/proc/meminfo: memFree=18849296/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1430372 CPUtime=2237.68 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 2789712 0 0 0 223284 484 0 0 25 0 4 0 669750753 1464700928 275690 33554432000 4194304 4625164 140737340126368 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8838/statm: 357593 275690 368 106 0 353096 0
[pid=8838/tid=8839] ppid=8836 vsize=1430372 CPUtime=475.86 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 151389 0 0 0 47513 73 0 0 25 0 4 0 669750753 1464700928 275690 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1430372 CPUtime=547.93 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 154288 0 0 0 54759 34 0 0 25 0 4 0 669750753 1464700928 275690 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1430372 CPUtime=476.91 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2045766 0 0 0 47393 298 0 0 25 0 4 0 669750753 1464700928 275690 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2237.68
Current children cumulated vsize (KiB) 1430372

[startup+1002.3 s]
/proc/loadavg: 12.15 12.15 12.09 13/498 8900
/proc/meminfo: memFree=18798552/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1432748 CPUtime=2357.64 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 2939468 0 0 0 235256 508 0 0 25 0 4 0 669750753 1467133952 283357 33554432000 4194304 4625164 140737340126368 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8838/statm: 358187 283357 366 106 0 353690 0
[pid=8838/tid=8839] ppid=8836 vsize=1432748 CPUtime=505.57 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 154058 0 0 0 50479 78 0 0 25 0 4 0 669750753 1467133952 283357 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1432748 CPUtime=578.33 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 156206 0 0 0 57798 35 0 0 25 0 4 0 669750753 1467133952 283357 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1432748 CPUtime=506.33 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2189184 0 0 0 50317 316 0 0 25 0 4 0 669750753 1467133952 283357 33554432000 4194304 4625164 140737340126368 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2357.64
Current children cumulated vsize (KiB) 1432748

[startup+1062.3 s]
/proc/loadavg: 12.16 12.15 12.10 13/498 8902
/proc/meminfo: memFree=18751136/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1434860 CPUtime=2488.34 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 3099709 0 0 0 248299 535 0 0 25 0 4 0 669750753 1469296640 291111 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8838/statm: 358715 291111 357 106 0 354218 0
[pid=8838/tid=8839] ppid=8836 vsize=1434860 CPUtime=535.45 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 158220 0 0 0 53463 82 0 0 25 0 4 0 669750753 1469296640 291111 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1434860 CPUtime=608.18 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 157167 0 0 0 60783 35 0 0 25 0 4 0 669750753 1469296640 291111 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1434860 CPUtime=536.89 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2342814 0 0 0 53351 338 0 0 25 0 4 0 669750753 1469296640 291111 33554432000 4194304 4625164 140737340126368 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2488.34
Current children cumulated vsize (KiB) 1434860

[startup+1122.3 s]
/proc/loadavg: 12.16 12.15 12.09 13/498 8903
/proc/meminfo: memFree=18701256/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1462040 CPUtime=2608.34 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 3280967 0 0 0 260265 569 0 0 25 0 4 0 669750753 1497128960 299248 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512057 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8838/statm: 365510 299248 347 106 0 361013 0
[pid=8838/tid=8839] ppid=8836 vsize=1462040 CPUtime=565.39 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 163276 0 0 0 56451 88 0 0 25 0 4 0 669750753 1497128960 299248 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1462040 CPUtime=638.33 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 158532 0 0 0 63797 36 0 0 25 0 4 0 669750753 1497128960 299248 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1462040 CPUtime=566.82 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2516730 0 0 0 56317 365 0 0 25 0 4 0 669750753 1497128960 299248 33554432000 4194304 4625164 140737340126368 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2608.34
Current children cumulated vsize (KiB) 1462040

[startup+1182.3 s]
/proc/loadavg: 12.11 12.14 12.09 13/498 8905
/proc/meminfo: memFree=18631788/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1563356 CPUtime=2738.1 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 3492160 0 0 0 273208 602 0 0 25 0 4 0 669750753 1600876544 313756 33554432000 4194304 4625164 140737340126368 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8838/statm: 390839 313756 350 106 0 386342 0
[pid=8838/tid=8839] ppid=8836 vsize=1563356 CPUtime=594.85 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 167147 0 0 0 59392 93 0 0 25 0 4 0 669750753 1600876544 313756 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1563356 CPUtime=670.21 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 213957 0 0 0 66979 42 0 0 25 0 4 0 669750753 1600876544 313756 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1563356 CPUtime=598.24 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2666970 0 0 0 59437 387 0 0 25 0 4 0 669750753 1600876544 313756 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2738.1
Current children cumulated vsize (KiB) 1563356

[startup+1242.3 s]
/proc/loadavg: 12.04 12.11 12.08 13/498 8907
/proc/meminfo: memFree=18585148/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1605996 CPUtime=2875.66 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 3654486 0 0 0 286937 629 0 0 25 0 4 0 669750753 1644539904 321800 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8838/statm: 401499 321800 366 106 0 397002 0
[pid=8838/tid=8839] ppid=8836 vsize=1605996 CPUtime=624.44 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 169497 0 0 0 62348 96 0 0 25 0 4 0 669750753 1644539904 321800 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1605996 CPUtime=713.36 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 214838 0 0 0 71293 43 0 0 25 0 4 0 669750753 1644539904 321800 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1605996 CPUtime=631.36 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2803356 0 0 0 62729 407 0 0 25 0 4 0 669750753 1644539904 321800 33554432000 4194304 4625164 140737340126368 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2875.66
Current children cumulated vsize (KiB) 1605996



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.05 12.10 12.08 13/498 8908
/proc/meminfo: memFree=18526728/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1696872 CPUtime=3010.18 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 3813039 0 0 0 300360 658 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 424218 330817 343 106 0 419721 0
[pid=8838/tid=8839] ppid=8836 vsize=1696872 CPUtime=652.84 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 171736 0 0 0 65185 99 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1696872 CPUtime=752.91 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 218760 0 0 0 75247 44 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1696872 CPUtime=667.3 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2953169 0 0 0 66299 431 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3010.18
Current children cumulated vsize (KiB) 1696872

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 12.05 12.10 12.08 13/498 8908
/proc/meminfo: memFree=18526728/32950928 swapFree=67056568/67111528
[pid=8838] ppid=8836 vsize=1696872 CPUtime=3010.18 cores=1,3,5,7
/proc/8838/stat : 8838 (SArTagnan) R 8836 8838 8278 0 -1 4202496 3813039 0 0 0 300360 658 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8838/statm: 424218 330817 343 106 0 419721 0
[pid=8838/tid=8839] ppid=8836 vsize=1696872 CPUtime=652.84 cores=1,3,5,7
/proc/8838/task/8839/stat : 8839 (SArTagnan) R 8836 8838 8278 0 -1 4202560 171736 0 0 0 65185 99 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8838/tid=8840] ppid=8836 vsize=1696872 CPUtime=752.91 cores=1,3,5,7
/proc/8838/task/8840/stat : 8840 (SArTagnan) R 8836 8838 8278 0 -1 4202560 218760 0 0 0 75247 44 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8838/tid=8841] ppid=8836 vsize=1696872 CPUtime=667.3 cores=1,3,5,7
/proc/8838/task/8841/stat : 8841 (SArTagnan) R 8836 8838 8278 0 -1 4202560 2953169 0 0 0 66299 431 0 0 25 0 4 0 669750753 1737596928 330817 33554432000 4194304 4625164 140737340126368 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3010.18
Current children cumulated vsize (KiB) 1696872

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.08
CPU time (s): 3010.27
CPU user time (s): 3003.63
CPU system time (s): 6.63399
CPU usage (%): 231.545
Max. virtual memory (cumulated for all children) (KiB): 1762408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3003.63
system time used= 6.63399
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3813039
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3199
involuntary context switches= 44739

runsolver used 5.72813 second user time and 15.5476 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-16 23:32:17
IDJOB=3386003
IDBENCH=83217
IDSOLVER=1871
FILE ID=node148/3386003-1305581537
RUNJOBID= node148-1305576286-8297
PBS_JOBID= 13350202
Free space on /tmp= 72884 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-13-13-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386003-1305581537/watcher-3386003-1305581537 -o /tmp/evaluation-result-3386003-1305581537/solver-3386003-1305581537 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386003-1305581537.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b828910e9308a3dd9d5f850f224ef842
RANDOM SEED=714848049

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20602116 kB
Buffers:        354836 kB
Cached:        5009416 kB
SwapCached:       8488 kB
Active:        8775648 kB
Inactive:      3205736 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20602116 kB
SwapTotal:    67111528 kB
SwapFree:     67056568 kB
Dirty:             400 kB
Writeback:           0 kB
AnonPages:     6614904 kB
Mapped:          38112 kB
Slab:           250532 kB
PageTables:      50860 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 142614984 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72860 MiB
End job on node148 at 2011-05-16 23:53:59