Trace number 3385864

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.41 1205.72

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-5-5_34308.cnf
MD5SUM1ef198d3f2d717e33f4f2ba124eb7eb2
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables34306
Number of clauses708168
Sum of the clauses size3540840
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 5708168
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385864-1305581684/watcher-3385864-1305581684 -o /tmp/evaluation-result-3385864-1305581684/solver-3385864-1305581684 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385864-1305581684.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.77 7.98 7.66 6/491 2108
/proc/meminfo: memFree=15994772/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=21196 CPUtime=0 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 949 0 0 0 0 0 0 0 24 0 1 0 669766185 21704704 888 33554432000 4194304 4625164 140735282606016 18446744073709551615 4295708 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2108/statm: 5299 900 291 106 0 802 0

[startup+0.0643169 s]
/proc/loadavg: 7.77 7.98 7.66 6/491 2108
/proc/meminfo: memFree=15994772/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=45980 CPUtime=0.05 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 5584 0 0 0 5 0 0 0 24 0 1 0 669766185 47083520 3099 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905730816 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2108/statm: 11495 3099 296 106 0 6998 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 45980

[startup+0.100324 s]
/proc/loadavg: 7.77 7.98 7.66 6/491 2108
/proc/meminfo: memFree=15994772/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=49792 CPUtime=0.09 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 7976 0 0 0 8 1 0 0 24 0 1 0 669766185 50987008 4179 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905391813 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2108/statm: 12448 4179 296 106 0 7951 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 49792

[startup+0.300299 s]
/proc/loadavg: 7.77 7.98 7.66 6/491 2108
/proc/meminfo: memFree=15994772/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=70884 CPUtime=0.29 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 20337 0 0 0 26 3 0 0 25 0 1 0 669766185 72585216 9951 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905391813 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2108/statm: 17721 9952 296 106 0 13224 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 70884

[startup+0.700226 s]
/proc/loadavg: 7.77 7.98 7.66 6/491 2108
/proc/meminfo: memFree=15994772/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=146684 CPUtime=0.69 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 51884 0 0 0 61 8 0 0 25 0 1 0 669766185 150204416 28344 33554432000 4194304 4625164 140735282606016 18446744073709551615 4298385 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2108/statm: 36671 28369 298 106 0 32174 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 146684

[startup+1.50102 s]
/proc/loadavg: 7.77 7.98 7.66 9/495 2112
/proc/meminfo: memFree=15763612/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=430996 CPUtime=3.78 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 79632 0 0 0 366 12 0 0 25 0 4 0 669766185 441339904 56029 33554432000 4194304 4625164 140735282606016 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/2108/statm: 107749 56029 336 106 0 103252 0
[pid=2108/tid=2110] ppid=2106 vsize=430996 CPUtime=0.76 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 3920 0 0 0 76 0 0 0 25 0 4 0 669766258 441339904 56029 33554432000 4194304 4625164 140735282606016 18446744073709551615 4278640 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=430996 CPUtime=0.75 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 3907 0 0 0 75 0 0 0 25 0 4 0 669766258 441339904 56029 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=430996 CPUtime=0.75 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 4197 0 0 0 75 0 0 0 25 0 4 0 669766258 441339904 56029 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.78
Current children cumulated vsize (KiB) 430996

[startup+3.10073 s]
/proc/loadavg: 7.77 7.98 7.66 9/495 2113
/proc/meminfo: memFree=15736828/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=430996 CPUtime=10.16 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 84507 0 0 0 1002 14 0 0 25 0 4 0 669766185 441339904 60279 33554432000 4194304 4625164 140735282606016 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/2108/statm: 107749 60279 336 106 0 103252 0
[pid=2108/tid=2110] ppid=2106 vsize=430996 CPUtime=2.36 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 4372 0 0 0 235 1 0 0 25 0 4 0 669766258 441339904 60279 33554432000 4194304 4625164 140735282606016 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=430996 CPUtime=2.36 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 4284 0 0 0 235 1 0 0 25 0 4 0 669766258 441339904 60279 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=430996 CPUtime=2.36 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 8081 0 0 0 235 1 0 0 25 0 4 0 669766258 441339904 60279 33554432000 4194304 4625164 140735282606016 18446744073709551615 4327743 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.16
Current children cumulated vsize (KiB) 430996

[startup+6.30115 s]
/proc/loadavg: 7.79 7.98 7.66 9/495 2113
/proc/meminfo: memFree=15664732/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=445312 CPUtime=22.91 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 98957 0 0 0 2272 19 0 0 25 0 4 0 669766185 455999488 72407 33554432000 4194304 4625164 140735282606016 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/2108/statm: 111328 72407 336 106 0 106831 0
[pid=2108/tid=2110] ppid=2106 vsize=445312 CPUtime=5.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 6776 0 0 0 554 2 0 0 25 0 4 0 669766258 455999488 72407 33554432000 4194304 4625164 140735282606016 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=445312 CPUtime=5.56 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 6196 0 0 0 555 1 0 0 25 0 4 0 669766258 455999488 72407 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351853 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=445312 CPUtime=5.56 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 17549 0 0 0 553 3 0 0 25 0 4 0 669766258 455999488 72407 33554432000 4194304 4625164 140735282606016 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 22.91
Current children cumulated vsize (KiB) 445312

[startup+12.701 s]
/proc/loadavg: 7.81 7.98 7.66 9/495 2113
/proc/meminfo: memFree=15523532/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=567252 CPUtime=48.39 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 151751 0 0 0 4809 30 0 0 24 0 4 0 669766185 580866048 94443 33554432000 4194304 4625164 140735282606016 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/2108/statm: 141813 94443 337 106 0 137316 0
[pid=2108/tid=2110] ppid=2106 vsize=567252 CPUtime=11.96 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 16425 0 0 0 1192 4 0 0 18 0 4 0 669766258 580866048 94443 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=567252 CPUtime=11.96 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 16136 0 0 0 1193 3 0 0 18 0 4 0 669766258 580866048 94443 33554432000 4194304 4625164 140735282606016 18446744073709551615 4352112 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=567252 CPUtime=11.96 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 44509 0 0 0 1187 9 0 0 25 0 4 0 669766258 580866048 94454 33554432000 4194304 4625164 140735282606016 18446744073709551615 4572504 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 48.39
Current children cumulated vsize (KiB) 567252

[startup+25.5007 s]
/proc/loadavg: 7.85 7.98 7.66 9/495 2113
/proc/meminfo: memFree=15327984/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=763336 CPUtime=99.36 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 207707 0 0 0 9888 48 0 0 25 0 4 0 669766185 781656064 120926 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/2108/statm: 190834 120926 343 106 0 186337 0
[pid=2108/tid=2110] ppid=2106 vsize=763336 CPUtime=24.76 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 25312 0 0 0 2466 10 0 0 23 0 4 0 669766258 781656064 120926 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=763336 CPUtime=24.76 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 24899 0 0 0 2466 10 0 0 25 0 4 0 669766258 781656064 120926 33554432000 4194304 4625164 140735282606016 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=763336 CPUtime=24.75 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 77892 0 0 0 2460 15 0 0 25 0 4 0 669766258 781656064 120926 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905398234 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 99.36
Current children cumulated vsize (KiB) 763336

[startup+51.101 s]
/proc/loadavg: 8.14 8.03 7.69 9/495 2114
/proc/meminfo: memFree=15070124/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=885644 CPUtime=201.33 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 391893 0 0 0 20043 90 0 0 25 0 4 0 669766185 906899456 155859 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 221411 155859 343 106 0 216914 0
[pid=2108/tid=2110] ppid=2106 vsize=885644 CPUtime=50.35 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 41280 0 0 0 5011 24 0 0 25 0 4 0 669766258 906899456 155859 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=885644 CPUtime=50.35 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 37959 0 0 0 5021 14 0 0 25 0 4 0 669766258 906899456 155859 33554432000 4194304 4625164 140735282606016 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=885644 CPUtime=50.08 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 223958 0 0 0 4971 37 0 0 25 0 4 0 669766258 906899456 155859 33554432000 4194304 4625164 140735282606016 18446744073709551615 4547918 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 201.33
Current children cumulated vsize (KiB) 885644

[startup+102.319 s]
/proc/loadavg: 8.06 8.03 7.70 9/495 2115
/proc/meminfo: memFree=14575312/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1129792 CPUtime=405.33 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 721732 0 0 0 40362 171 0 0 25 0 4 0 669766185 1156907008 227003 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 282448 227003 343 106 0 277951 0
[pid=2108/tid=2110] ppid=2106 vsize=1129792 CPUtime=101.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 78590 0 0 0 10101 55 0 0 25 0 4 0 669766258 1156907008 227003 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905392161 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1129792 CPUtime=101.57 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 80407 0 0 0 10129 28 0 0 25 0 4 0 669766258 1156907008 227003 33554432000 4194304 4625164 140735282606016 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1129792 CPUtime=100.45 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 460199 0 0 0 9975 70 0 0 25 0 4 0 669766258 1156907008 227003 33554432000 4194304 4625164 140735282606016 18446744073709551615 4469204 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 405.33
Current children cumulated vsize (KiB) 1129792

[startup+162.301 s]
/proc/loadavg: 8.16 8.06 7.74 9/495 2117
/proc/meminfo: memFree=14121940/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1435616 CPUtime=644.28 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 995092 0 0 0 64185 243 0 0 25 0 4 0 669766185 1470070784 291256 33554432000 4194304 4625164 140735282606016 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 358904 291256 343 106 0 354407 0
[pid=2108/tid=2110] ppid=2106 vsize=1435616 CPUtime=161.54 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 104416 0 0 0 16071 83 0 0 25 0 4 0 669766258 1470070784 291256 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351853 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1435616 CPUtime=161.55 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98417 0 0 0 16121 34 0 0 25 0 4 0 669766258 1470070784 291256 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1435616 CPUtime=159.47 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 685081 0 0 0 15842 105 0 0 25 0 4 0 669766258 1470070784 291256 33554432000 4194304 4625164 140735282606016 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 644.28
Current children cumulated vsize (KiB) 1435616

[startup+222.301 s]
/proc/loadavg: 8.13 8.07 7.75 9/495 2118
/proc/meminfo: memFree=13876512/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1489400 CPUtime=883.27 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 1298862 0 0 0 88017 310 0 0 25 0 4 0 669766185 1525145600 313703 33554432000 4194304 4625164 140735282606016 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 372350 313703 344 106 0 367853 0
[pid=2108/tid=2110] ppid=2106 vsize=1489400 CPUtime=221.54 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 129591 0 0 0 22055 99 0 0 25 0 4 0 669766258 1525145600 313703 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1489400 CPUtime=221.55 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98493 0 0 0 22121 34 0 0 25 0 4 0 669766258 1525145600 313703 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1489400 CPUtime=218.47 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 945515 0 0 0 21695 152 0 0 25 0 4 0 669766258 1525145600 313703 33554432000 4194304 4625164 140735282606016 18446744073709551615 4278370 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 883.27
Current children cumulated vsize (KiB) 1489400

[startup+282.301 s]

################
# More data... #
################

[pid=2108] ppid=2106 vsize=1730512 CPUtime=2556.34 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 2445621 0 0 0 255104 530 0 0 25 0 4 0 669766185 1772044288 372161 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 432628 372161 344 106 0 428131 0
[pid=2108/tid=2110] ppid=2106 vsize=1730512 CPUtime=641.57 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130059 0 0 0 64058 99 0 0 25 0 4 0 669766258 1772044288 372161 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1730512 CPUtime=641.58 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98734 0 0 0 64123 35 0 0 25 0 4 0 669766258 1772044288 372161 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330958 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1730512 CPUtime=631.61 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2043788 0 0 0 62801 360 0 0 25 0 4 0 669766258 1772044288 372161 33554432000 4194304 4625164 140735282606016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2556.34
Current children cumulated vsize (KiB) 1730512

[startup+702.301 s]
/proc/loadavg: 8.15 8.10 7.88 9/495 2131
/proc/meminfo: memFree=13185956/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1795576 CPUtime=2795.32 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 2706064 0 0 0 278951 581 0 0 25 0 4 0 669766185 1838669824 378952 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 448894 378952 344 106 0 444397 0
[pid=2108/tid=2110] ppid=2106 vsize=1795576 CPUtime=701.55 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130120 0 0 0 70056 99 0 0 25 0 4 0 669766258 1838669824 378952 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1795576 CPUtime=701.57 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98766 0 0 0 70122 35 0 0 25 0 4 0 669766258 1838669824 378952 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1795576 CPUtime=690.62 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2267976 0 0 0 68657 405 0 0 25 0 4 0 669766258 1838669824 378952 33554432000 4194304 4625164 140735282606016 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2795.32
Current children cumulated vsize (KiB) 1795576

[startup+762.319 s]
/proc/loadavg: 8.09 8.09 7.89 9/495 2133
/proc/meminfo: memFree=13137192/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1812472 CPUtime=3034.39 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 2916591 0 0 0 302816 623 0 0 25 0 4 0 669766185 1855971328 385498 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 453118 385498 344 106 0 448621 0
[pid=2108/tid=2110] ppid=2106 vsize=1812472 CPUtime=761.58 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130181 0 0 0 76058 100 0 0 25 0 4 0 669766258 1855971328 385498 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1812472 CPUtime=761.59 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98804 0 0 0 76124 35 0 0 25 0 4 0 669766258 1855971328 385498 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331081 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1812472 CPUtime=749.65 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2476863 0 0 0 74518 447 0 0 25 0 4 0 669766258 1855971328 385498 33554432000 4194304 4625164 140735282606016 18446744073709551615 4469221 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3034.39
Current children cumulated vsize (KiB) 1812472

[startup+822.3 s]
/proc/loadavg: 8.07 8.09 7.90 9/495 2134
/proc/meminfo: memFree=13101576/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1822880 CPUtime=3273.34 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 3002204 0 0 0 326693 641 0 0 25 0 4 0 669766185 1866629120 391538 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396545 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 455720 391538 344 106 0 451223 0
[pid=2108/tid=2110] ppid=2106 vsize=1822880 CPUtime=821.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130391 0 0 0 82056 100 0 0 25 0 4 0 669766258 1866629120 391538 33554432000 4194304 4625164 140735282606016 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1822880 CPUtime=821.57 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98842 0 0 0 82122 35 0 0 25 0 4 0 669766258 1866629120 391538 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1822880 CPUtime=808.65 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2560605 0 0 0 80402 463 0 0 25 0 4 0 669766258 1866629120 391538 33554432000 4194304 4625164 140735282606016 18446744073709551615 4339569 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3273.34
Current children cumulated vsize (KiB) 1822880

[startup+882.3 s]
/proc/loadavg: 8.06 8.08 7.91 9/495 2136
/proc/meminfo: memFree=13052440/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1836600 CPUtime=3512.33 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 3015223 0 0 0 350588 645 0 0 25 0 4 0 669766185 1880678400 397332 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 459150 397332 344 106 0 454653 0
[pid=2108/tid=2110] ppid=2106 vsize=1836600 CPUtime=881.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130530 0 0 0 88056 100 0 0 25 0 4 0 669766258 1880678400 397332 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1836600 CPUtime=881.57 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98921 0 0 0 88122 35 0 0 25 0 4 0 669766258 1880678400 397332 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330859 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1836600 CPUtime=867.67 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2571656 0 0 0 86300 467 0 0 25 0 4 0 669766258 1880678400 397332 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905379928 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3512.33
Current children cumulated vsize (KiB) 1836600

[startup+942.301 s]
/proc/loadavg: 8.17 8.11 7.93 9/495 2138
/proc/meminfo: memFree=13014216/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1902136 CPUtime=3751.35 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 3212058 0 0 0 374449 686 0 0 25 0 4 0 669766185 1947787264 402578 33554432000 4194304 4625164 140735282606016 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 475534 402578 344 106 0 471037 0
[pid=2108/tid=2110] ppid=2106 vsize=1902136 CPUtime=941.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130561 0 0 0 94056 100 0 0 25 0 4 0 669766258 1947787264 402578 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1902136 CPUtime=941.57 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 98951 0 0 0 94122 35 0 0 25 0 4 0 669766258 1947787264 402578 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1902136 CPUtime=926.69 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2766719 0 0 0 92162 507 0 0 25 0 4 0 669766258 1947787264 402578 33554432000 4194304 4625164 140735282606016 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3751.35
Current children cumulated vsize (KiB) 1902136

[startup+1002.3 s]
/proc/loadavg: 8.10 8.10 7.93 9/495 2139
/proc/meminfo: memFree=12976244/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1902136 CPUtime=3990.35 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 3433922 0 0 0 398307 728 0 0 25 0 4 0 669766185 1947787264 408430 33554432000 4194304 4625164 140735282606016 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 475534 408430 344 106 0 471037 0
[pid=2108/tid=2110] ppid=2106 vsize=1902136 CPUtime=1001.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130600 0 0 0 100056 100 0 0 25 0 4 0 669766258 1947787264 408430 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1902136 CPUtime=1001.57 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 99034 0 0 0 100122 35 0 0 25 0 4 0 669766258 1947787264 408430 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1902136 CPUtime=985.7 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 2986719 0 0 0 98021 549 0 0 25 0 4 0 669766258 1947787264 408430 33554432000 4194304 4625164 140735282606016 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3990.35
Current children cumulated vsize (KiB) 1902136

[startup+1062.3 s]
/proc/loadavg: 8.14 8.11 7.94 9/495 2141
/proc/meminfo: memFree=12946200/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1967672 CPUtime=4229.36 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 3678370 0 0 0 422158 778 0 0 25 0 4 0 669766185 2014896128 416181 33554432000 4194304 4625164 140735282606016 18446744073709551615 4338090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 491918 416181 344 106 0 487421 0
[pid=2108/tid=2110] ppid=2106 vsize=1967672 CPUtime=1061.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130652 0 0 0 106056 100 0 0 25 0 4 0 669766258 2014896128 416181 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1967672 CPUtime=1061.58 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 99080 0 0 0 106122 36 0 0 25 0 4 0 669766258 2014896128 416181 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1967672 CPUtime=1044.72 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 3229280 0 0 0 103875 597 0 0 25 0 4 0 669766258 2014896128 416181 33554432000 4194304 4625164 140735282606016 18446744073709551615 4573816 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4229.36
Current children cumulated vsize (KiB) 1967672

[startup+1122.3 s]
/proc/loadavg: 8.12 8.10 7.95 9/495 2142
/proc/meminfo: memFree=12909712/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1967672 CPUtime=4468.36 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 3852074 0 0 0 446021 815 0 0 25 0 4 0 669766185 2014896128 422807 33554432000 4194304 4625164 140735282606016 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 491918 422807 344 106 0 487421 0
[pid=2108/tid=2110] ppid=2106 vsize=1967672 CPUtime=1121.56 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130699 0 0 0 112056 100 0 0 25 0 4 0 669766258 2014896128 422807 33554432000 4194304 4625164 140735282606016 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1967672 CPUtime=1121.58 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 99109 0 0 0 112122 36 0 0 25 0 4 0 669766258 2014896128 422807 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1967672 CPUtime=1103.74 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 3401278 0 0 0 109741 633 0 0 25 0 4 0 669766258 2014896128 422807 33554432000 4194304 4625164 140735282606016 18446744073709551615 4573808 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4468.36
Current children cumulated vsize (KiB) 1967672

[startup+1182.3 s]
/proc/loadavg: 8.18 8.11 7.96 9/495 2144
/proc/meminfo: memFree=12869872/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1967672 CPUtime=4707.38 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 4092792 0 0 0 469876 862 0 0 25 0 4 0 669766185 2014896128 425595 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 491918 425595 344 106 0 487421 0
[pid=2108/tid=2110] ppid=2106 vsize=1967672 CPUtime=1181.57 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130754 0 0 0 118057 100 0 0 25 0 4 0 669766258 2014896128 425595 33554432000 4194304 4625164 140735282606016 18446744073709551615 4488027 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1967672 CPUtime=1181.58 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 99149 0 0 0 118122 36 0 0 25 0 4 0 669766258 2014896128 425595 33554432000 4194304 4625164 140735282606016 18446744073709551615 4330822 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1967672 CPUtime=1162.77 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 3640180 0 0 0 115597 680 0 0 25 0 4 0 669766258 2014896128 425595 33554432000 4194304 4625164 140735282606016 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4707.38
Current children cumulated vsize (KiB) 1967672



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.62 s]
/proc/loadavg: 7.80 8.04 7.94 5/490 2146
/proc/meminfo: memFree=14323292/32951124 swapFree=62248504/67111528
[pid=2108] ppid=2106 vsize=1967672 CPUtime=4800.25 cores=0,2,4,6
/proc/2108/stat : 2108 (SArTagnan) R 2106 2108 1492 0 -1 4202496 4160194 0 0 0 479149 876 0 0 25 0 4 0 669766185 2014896128 428525 33554432000 4194304 4625164 140735282606016 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2108/statm: 491918 428525 344 106 0 487421 0
[pid=2108/tid=2110] ppid=2106 vsize=1967672 CPUtime=1204.9 cores=0,2,4,6
/proc/2108/task/2110/stat : 2110 (SArTagnan) R 2106 2108 1492 0 -1 4202560 130777 0 0 0 120390 100 0 0 25 0 4 0 669766258 2014896128 428525 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2108/tid=2111] ppid=2106 vsize=1967672 CPUtime=1204.92 cores=0,2,4,6
/proc/2108/task/2111/stat : 2111 (SArTagnan) R 2106 2108 1492 0 -1 4202560 99168 0 0 0 120456 36 0 0 25 0 4 0 669766258 2014896128 428525 33554432000 4194304 4625164 140735282606016 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2108/tid=2112] ppid=2106 vsize=1967672 CPUtime=1185.69 cores=0,2,4,6
/proc/2108/task/2112/stat : 2112 (SArTagnan) R 2106 2108 1492 0 -1 4202560 3706966 0 0 0 117876 693 0 0 25 0 4 0 669766258 2014896128 428525 33554432000 4194304 4625164 140735282606016 18446744073709551615 218905380044 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 1967672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.72
CPU time (s): 4800.41
CPU user time (s): 4791.56
CPU system time (s): 8.84566
CPU usage (%): 398.135
Max. virtual memory (cumulated for all children) (KiB): 1967672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.56
system time used= 8.84566
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4160194
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2587
involuntary context switches= 22759

runsolver used 5.53516 second user time and 14.2278 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-16 23:34:45
IDJOB=3385864
IDBENCH=83249
IDSOLVER=1871
FILE ID=node137/3385864-1305581684
RUNJOBID= node137-1305580476-1991
PBS_JOBID= 13350207
Free space on /tmp= 73640 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-5-5_34308.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385864-1305581684/watcher-3385864-1305581684 -o /tmp/evaluation-result-3385864-1305581684/solver-3385864-1305581684 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385864-1305581684.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1ef198d3f2d717e33f4f2ba124eb7eb2
RANDOM SEED=111108709

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15995060 kB
Buffers:        330556 kB
Cached:        4392220 kB
SwapCached:      25020 kB
Active:        6978716 kB
Inactive:      9702984 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15995060 kB
SwapTotal:    67111528 kB
SwapFree:     62248504 kB
Dirty:           25660 kB
Writeback:           0 kB
AnonPages:    11943656 kB
Mapped:          31768 kB
Slab:           138044 kB
PageTables:      68460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 147036784 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73640 MiB
End job on node137 at 2011-05-16 23:54:52