Trace number 3385863

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3881.97 1300.07

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-3-6_2072.cnf
MD5SUMd2ef996f95bbf68a3c980c797dfdc364
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2071
Number of clauses159039
Sum of the clauses size479052
Maximum clause length6
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3158394
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5645

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385863-1305581632/watcher-3385863-1305581632 -o /tmp/evaluation-result-3385863-1305581632/solver-3385863-1305581632 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385863-1305581632.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.24 9.92 10.03 4/415 11188
/proc/meminfo: memFree=24125864/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=23616 CPUtime=0 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 1130 0 0 0 0 0 0 0 25 0 1 0 669761715 24182784 804 33554432000 4194304 4625164 140733831346096 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/11188/statm: 5904 805 296 106 0 1407 0

[startup+0.077016 s]
/proc/loadavg: 9.24 9.92 10.03 4/415 11188
/proc/meminfo: memFree=24125864/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=35148 CPUtime=0.07 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 7634 0 0 0 6 1 0 0 25 0 1 0 669761715 35991552 4116 33554432000 4194304 4625164 140733831346096 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/11188/statm: 8787 4117 296 106 0 4290 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 35148

[startup+0.101739 s]
/proc/loadavg: 9.24 9.92 10.03 4/415 11188
/proc/meminfo: memFree=24125864/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=157376 CPUtime=0.1 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 13740 0 0 0 9 1 0 0 25 0 4 0 669761715 161153024 9329 33554432000 4194304 4625164 140733831346096 18446744073709551615 4518211 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/11188/statm: 39344 9329 329 106 0 34847 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 157376

[startup+0.300946 s]
/proc/loadavg: 9.24 9.92 10.03 4/415 11188
/proc/meminfo: memFree=24125864/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=232856 CPUtime=0.68 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 16387 0 0 0 67 1 0 0 25 0 4 0 669761715 238444544 11976 33554432000 4194304 4625164 140733831346096 18446744073709551615 4280384 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/11188/statm: 58214 11976 334 106 0 53717 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 232856

[startup+0.700879 s]
/proc/loadavg: 9.24 9.92 10.03 4/415 11188
/proc/meminfo: memFree=24125864/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=299632 CPUtime=1.89 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 17796 0 0 0 187 2 0 0 25 0 4 0 669761715 306823168 12452 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/11188/statm: 74908 12452 334 106 0 70411 0
Current children cumulated CPU time (s) 1.89
Current children cumulated vsize (KiB) 299632

[startup+1.50074 s]
/proc/loadavg: 9.24 9.92 10.03 11/425 11201
/proc/meminfo: memFree=24023000/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=302304 CPUtime=4.26 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 20718 0 0 0 423 3 0 0 18 0 4 0 669761715 309559296 14038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/11188/statm: 75576 14038 334 106 0 71079 0
[pid=11188/tid=11196] ppid=11186 vsize=302304 CPUtime=1.36 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 1645 0 0 0 136 0 0 0 25 0 4 0 669761724 309559296 14038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=302304 CPUtime=1.37 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 1077 0 0 0 137 0 0 0 19 0 4 0 669761724 309559296 14038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4375311 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=302304 CPUtime=0.03 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 1630 0 0 0 3 0 0 0 25 0 4 0 669761724 309559296 14038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.26
Current children cumulated vsize (KiB) 302304

[startup+3.10048 s]
/proc/loadavg: 9.30 9.92 10.03 11/425 11201
/proc/meminfo: memFree=23971540/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=307652 CPUtime=9.04 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 25803 0 0 0 900 4 0 0 21 0 4 0 669761715 315035648 16038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/11188/statm: 76913 16038 337 106 0 72416 0
[pid=11188/tid=11196] ppid=11186 vsize=307652 CPUtime=2.39 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 3421 0 0 0 238 1 0 0 25 0 4 0 669761724 315035648 16038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=307652 CPUtime=2.97 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 2683 0 0 0 297 0 0 0 25 0 4 0 669761724 315035648 16038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=307652 CPUtime=0.6 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 3187 0 0 0 60 0 0 0 25 0 4 0 669761724 315035648 16038 33554432000 4194304 4625164 140733831346096 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9.04
Current children cumulated vsize (KiB) 307652

[startup+6.30094 s]
/proc/loadavg: 9.30 9.92 10.03 11/425 11201
/proc/meminfo: memFree=23945776/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=310424 CPUtime=18.59 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 31509 0 0 0 1853 6 0 0 25 0 4 0 669761715 317874176 18220 33554432000 4194304 4625164 140733831346096 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/11188/statm: 77606 18220 341 106 0 73109 0
[pid=11188/tid=11196] ppid=11186 vsize=310424 CPUtime=4 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 4220 0 0 0 398 2 0 0 25 0 4 0 669761724 317874176 18220 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=310424 CPUtime=6.06 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 3783 0 0 0 605 1 0 0 25 0 4 0 669761724 317874176 18220 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=310424 CPUtime=2.32 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 6823 0 0 0 232 0 0 0 25 0 4 0 669761724 317874176 18220 33554432000 4194304 4625164 140733831346096 18446744073709551615 210220631067 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 18.59
Current children cumulated vsize (KiB) 310424

[startup+12.7009 s]
/proc/loadavg: 9.41 9.92 10.03 11/425 11201
/proc/meminfo: memFree=23911708/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=329832 CPUtime=37.67 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 75943 0 0 0 3751 16 0 0 25 0 4 0 669761715 337747968 23201 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/11188/statm: 82458 23201 341 106 0 77961 0
[pid=11188/tid=11196] ppid=11186 vsize=329832 CPUtime=8.34 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 8057 0 0 0 831 3 0 0 25 0 4 0 669761724 337747968 23201 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=329832 CPUtime=11.19 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 8040 0 0 0 1116 3 0 0 25 0 4 0 669761724 337747968 23201 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=329832 CPUtime=7.1 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 41781 0 0 0 704 6 0 0 25 0 4 0 669761724 337747968 23201 33554432000 4194304 4625164 140733831346096 18446744073709551615 4375412 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37.67
Current children cumulated vsize (KiB) 329832

[startup+25.5007 s]
/proc/loadavg: 9.50 9.92 10.02 11/425 11202
/proc/meminfo: memFree=23860648/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=349440 CPUtime=75.89 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 148458 0 0 0 7558 31 0 0 25 0 4 0 669761715 357826560 31473 33554432000 4194304 4625164 140733831346096 18446744073709551615 4396557 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/11188/statm: 87360 31473 341 106 0 82863 0
[pid=11188/tid=11196] ppid=11186 vsize=349440 CPUtime=20.96 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 14570 0 0 0 2091 5 0 0 25 0 4 0 669761724 357826560 31473 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=349440 CPUtime=17.61 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 10252 0 0 0 1755 6 0 0 25 0 4 0 669761724 357826560 31473 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=349440 CPUtime=13.49 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 103250 0 0 0 1333 16 0 0 25 0 4 0 669761724 357826560 31473 33554432000 4194304 4625164 140733831346096 18446744073709551615 4339549 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 75.89
Current children cumulated vsize (KiB) 349440

[startup+51.1004 s]
/proc/loadavg: 9.75 9.94 10.03 11/425 11202
/proc/meminfo: memFree=23751952/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=350392 CPUtime=152.26 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 336937 0 0 0 15160 66 0 0 25 0 4 0 669761715 358801408 44404 33554432000 4194304 4625164 140733831346096 18446744073709551615 4396493 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/11188/statm: 87598 44404 341 106 0 83101 0
[pid=11188/tid=11196] ppid=11186 vsize=350392 CPUtime=43.03 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 24305 0 0 0 4295 8 0 0 25 0 4 0 669761724 358801408 44404 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=350392 CPUtime=32.2 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 18518 0 0 0 3209 11 0 0 25 0 4 0 669761724 358801408 44404 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=350392 CPUtime=29.09 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 267893 0 0 0 2867 42 0 0 25 0 4 0 669761724 358801408 44404 33554432000 4194304 4625164 140733831346096 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 152.26
Current children cumulated vsize (KiB) 350392

[startup+102.316 s]
/proc/loadavg: 10.05 9.99 10.04 11/425 11204
/proc/meminfo: memFree=23574876/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=395536 CPUtime=305.18 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 535601 0 0 0 30411 107 0 0 25 0 4 0 669761715 405028864 65615 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512138 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 98884 65615 341 106 0 94387 0
[pid=11188/tid=11196] ppid=11186 vsize=395536 CPUtime=69.38 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 26684 0 0 0 6929 9 0 0 25 0 4 0 669761724 405028864 65615 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=395536 CPUtime=81.94 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 33487 0 0 0 8177 17 0 0 25 0 4 0 669761724 405028864 65615 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=395536 CPUtime=54.75 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 439014 0 0 0 5403 72 0 0 25 0 4 0 669761724 405028864 65615 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 305.18
Current children cumulated vsize (KiB) 395536

[startup+162.301 s]
/proc/loadavg: 10.13 10.02 10.04 11/425 11205
/proc/meminfo: memFree=23367260/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=542924 CPUtime=484.32 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 774416 0 0 0 48280 152 0 0 25 0 4 0 669761715 555954176 95546 33554432000 4194304 4625164 140733831346096 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 135731 95546 388 106 0 131234 0
[pid=11188/tid=11196] ppid=11186 vsize=542924 CPUtime=116.11 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 39849 0 0 0 11596 15 0 0 25 0 4 0 669761724 555954176 95546 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=542924 CPUtime=140.27 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 50547 0 0 0 14003 24 0 0 25 0 4 0 669761724 555954176 95546 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=542924 CPUtime=84.57 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 635413 0 0 0 8355 102 0 0 25 0 4 0 669761724 555954176 95546 33554432000 4194304 4625164 140733831346096 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 484.32
Current children cumulated vsize (KiB) 542924

[startup+222.301 s]
/proc/loadavg: 10.14 10.04 10.05 11/425 11207
/proc/meminfo: memFree=23202544/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=597144 CPUtime=663.49 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 1012624 0 0 0 66157 192 0 0 25 0 4 0 669761715 611475456 110107 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 149286 110107 365 106 0 144789 0
[pid=11188/tid=11196] ppid=11186 vsize=597144 CPUtime=154.41 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 43440 0 0 0 15425 16 0 0 25 0 4 0 669761724 611475456 110107 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=597144 CPUtime=191.14 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 52725 0 0 0 19088 26 0 0 25 0 4 0 669761724 611475456 110107 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=597144 CPUtime=114.57 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 857830 0 0 0 11320 137 0 0 25 0 4 0 669761724 611475456 110107 33554432000 4194304 4625164 140733831346096 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 663.49
Current children cumulated vsize (KiB) 597144

[startup+282.301 s]

################
# More data... #
################

[pid=11188] ppid=11186 vsize=1067632 CPUtime=2096.94 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 2911712 0 0 0 209175 519 0 0 25 0 4 0 669761715 1093255168 200733 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 266908 200733 342 106 0 262411 0
[pid=11188/tid=11196] ppid=11186 vsize=1067632 CPUtime=564.02 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 94505 0 0 0 56372 30 0 0 25 0 4 0 669761724 1093255168 200733 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1067632 CPUtime=484.52 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 104683 0 0 0 48399 53 0 0 25 0 4 0 669761724 1093255168 200733 33554432000 4194304 4625164 140733831346096 18446744073709551615 4462556 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1067632 CPUtime=385.24 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 2613031 0 0 0 38108 416 0 0 25 0 4 0 669761724 1093255168 200733 33554432000 4194304 4625164 140733831346096 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2096.94
Current children cumulated vsize (KiB) 1067632

[startup+762.316 s]
/proc/loadavg: 10.07 10.09 10.07 11/425 11221
/proc/meminfo: memFree=22364336/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1082020 CPUtime=2276.16 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 3234188 0 0 0 227039 577 0 0 25 0 4 0 669761715 1107988480 209918 33554432000 4194304 4625164 140733831346096 18446744073709551615 4329208 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 270505 209918 342 106 0 266008 0
[pid=11188/tid=11196] ppid=11186 vsize=1082020 CPUtime=623.22 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 98537 0 0 0 62288 34 0 0 25 0 4 0 669761724 1107988480 209918 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352186 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1082020 CPUtime=514.52 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 107453 0 0 0 51393 59 0 0 25 0 4 0 669761724 1107988480 209918 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1082020 CPUtime=415.26 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 2927791 0 0 0 41061 465 0 0 25 0 4 0 669761724 1107988480 209918 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2276.16
Current children cumulated vsize (KiB) 1082020

[startup+822.3 s]
/proc/loadavg: 10.10 10.10 10.08 11/425 11223
/proc/meminfo: memFree=22307008/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1122968 CPUtime=2455.31 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 3527915 0 0 0 244904 627 0 0 25 0 4 0 669761715 1149919232 218138 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 280742 218138 341 106 0 276245 0
[pid=11188/tid=11196] ppid=11186 vsize=1122968 CPUtime=682.39 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 104370 0 0 0 68204 35 0 0 25 0 4 0 669761724 1149919232 218138 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1122968 CPUtime=544.43 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 109180 0 0 0 54383 60 0 0 25 0 4 0 669761724 1149919232 218138 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1122968 CPUtime=445.32 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 3213386 0 0 0 44021 511 0 0 25 0 4 0 669761724 1149919232 218138 33554432000 4194304 4625164 140733831346096 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2455.31
Current children cumulated vsize (KiB) 1122968

[startup+882.3 s]
/proc/loadavg: 10.18 10.13 10.09 11/425 11224
/proc/meminfo: memFree=22268508/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1127720 CPUtime=2634.48 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 3802737 0 0 0 262771 677 0 0 25 0 4 0 669761715 1154785280 225911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 281930 225911 341 106 0 277433 0
[pid=11188/tid=11196] ppid=11186 vsize=1127720 CPUtime=741.56 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 105954 0 0 0 74121 35 0 0 25 0 4 0 669761724 1154785280 225911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1127720 CPUtime=574.54 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 111824 0 0 0 57391 63 0 0 25 0 4 0 669761724 1154785280 225911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1127720 CPUtime=475.22 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 3482149 0 0 0 46965 557 0 0 25 0 4 0 669761724 1154785280 225911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2634.48
Current children cumulated vsize (KiB) 1127720

[startup+942.3 s]
/proc/loadavg: 10.10 10.11 10.09 11/425 11226
/proc/meminfo: memFree=22213792/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1169288 CPUtime=2813.66 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 4119658 0 0 0 280636 730 0 0 25 0 4 0 669761715 1197350912 236911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 292322 236911 347 106 0 287825 0
[pid=11188/tid=11196] ppid=11186 vsize=1169288 CPUtime=800.75 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 109656 0 0 0 80038 37 0 0 25 0 4 0 669761724 1197350912 236911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1169288 CPUtime=604.6 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 113369 0 0 0 60395 65 0 0 25 0 4 0 669761724 1197350912 236911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1169288 CPUtime=505.15 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 3774987 0 0 0 49912 603 0 0 25 0 4 0 669761724 1197350912 236911 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2813.66
Current children cumulated vsize (KiB) 1169288

[startup+1002.3 s]
/proc/loadavg: 10.15 10.12 10.09 11/425 11228
/proc/meminfo: memFree=22170116/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1230460 CPUtime=2992.83 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 4413889 0 0 0 298502 781 0 0 25 0 4 0 669761715 1259991040 243349 33554432000 4194304 4625164 140733831346096 18446744073709551615 4511973 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 307615 243349 341 106 0 303118 0
[pid=11188/tid=11196] ppid=11186 vsize=1230460 CPUtime=859.92 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 113313 0 0 0 85952 40 0 0 25 0 4 0 669761724 1259991040 243349 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1230460 CPUtime=634.75 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 114548 0 0 0 63409 66 0 0 25 0 4 0 669761724 1259991040 243349 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1230460 CPUtime=535.01 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 4048301 0 0 0 52853 648 0 0 25 0 4 0 669761724 1259991040 243349 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2992.83
Current children cumulated vsize (KiB) 1230460

[startup+1062.3 s]
/proc/loadavg: 10.12 10.11 10.09 11/425 11229
/proc/meminfo: memFree=22131876/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1240888 CPUtime=3172.02 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 4698279 0 0 0 316370 832 0 0 25 0 4 0 669761715 1270669312 250033 33554432000 4194304 4625164 140733831346096 18446744073709551615 4392955 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 310222 250033 341 106 0 305725 0
[pid=11188/tid=11196] ppid=11186 vsize=1240888 CPUtime=919.01 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 116262 0 0 0 91859 42 0 0 25 0 4 0 669761724 1270669312 250033 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1240888 CPUtime=664.86 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 116187 0 0 0 66417 69 0 0 25 0 4 0 669761724 1270669312 250033 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1240888 CPUtime=565 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 4327206 0 0 0 55806 694 0 0 25 0 4 0 669761724 1270669312 250033 33554432000 4194304 4625164 140733831346096 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3172.02
Current children cumulated vsize (KiB) 1240888

[startup+1122.3 s]
/proc/loadavg: 10.18 10.12 10.09 11/425 11231
/proc/meminfo: memFree=22085584/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1250656 CPUtime=3351.2 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 4971902 0 0 0 334246 874 0 0 25 0 4 0 669761715 1280671744 255322 33554432000 4194304 4625164 140733831346096 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 312664 255322 341 106 0 308167 0
[pid=11188/tid=11196] ppid=11186 vsize=1250656 CPUtime=978.19 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 119038 0 0 0 97775 44 0 0 25 0 4 0 669761724 1280671744 255322 33554432000 4194304 4625164 140733831346096 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1250656 CPUtime=694.86 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 117957 0 0 0 69415 71 0 0 25 0 4 0 669761724 1280671744 255322 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1250656 CPUtime=595 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 4595084 0 0 0 58769 731 0 0 25 0 4 0 669761724 1280671744 255322 33554432000 4194304 4625164 140733831346096 18446744073709551615 4547847 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3351.2
Current children cumulated vsize (KiB) 1250656

[startup+1182.3 s]
/proc/loadavg: 10.14 10.11 10.09 11/425 11232
/proc/meminfo: memFree=22032468/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1325036 CPUtime=3530.39 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 5224162 0 0 0 352120 919 0 0 25 0 4 0 669761715 1356836864 264597 33554432000 4194304 4625164 140733831346096 18446744073709551615 4356413 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 331259 264597 343 106 0 326762 0
[pid=11188/tid=11196] ppid=11186 vsize=1325036 CPUtime=1037.38 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 122184 0 0 0 103693 45 0 0 25 0 4 0 669761724 1356836864 264597 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352776 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1325036 CPUtime=724.88 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 119566 0 0 0 72414 74 0 0 25 0 4 0 669761724 1356836864 264597 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1325036 CPUtime=624.98 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 4840975 0 0 0 61726 772 0 0 25 0 4 0 669761724 1356836864 264597 33554432000 4194304 4625164 140733831346096 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3530.39
Current children cumulated vsize (KiB) 1325036

[startup+1242.3 s]
/proc/loadavg: 10.11 10.11 10.09 11/425 11234
/proc/meminfo: memFree=22011116/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1279904 CPUtime=3709.55 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 5429191 0 0 0 369998 957 0 0 25 0 4 0 669761715 1310621696 270091 33554432000 4194304 4625164 140733831346096 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 319976 270091 341 106 0 315479 0
[pid=11188/tid=11196] ppid=11186 vsize=1279904 CPUtime=1088.53 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 124466 0 0 0 108806 47 0 0 25 0 4 0 669761724 1310621696 270091 33554432000 4194304 4625164 140733831346096 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1279904 CPUtime=763.19 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 120980 0 0 0 76243 76 0 0 25 0 4 0 669761724 1310621696 270091 33554432000 4194304 4625164 140733831346096 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1279904 CPUtime=662.11 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 5041920 0 0 0 65405 806 0 0 25 0 4 0 669761724 1310621696 270091 33554432000 4194304 4625164 140733831346096 18446744073709551615 4335197 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3709.55
Current children cumulated vsize (KiB) 1279904



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.17 10.12 10.09 11/425 11236
/proc/meminfo: memFree=21941656/32951124 swapFree=63649240/67111528
[pid=11188] ppid=11186 vsize=1463308 CPUtime=3881.89 cores=1,3,5,7
/proc/11188/stat : 11188 (SArTagnan) R 11186 11188 10575 0 -1 4202496 5463970 0 0 0 387223 966 0 0 25 0 4 0 669761715 1498427392 281335 33554432000 4194304 4625164 140733831346096 18446744073709551615 4511982 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/11188/statm: 365827 281335 341 106 0 361330 0
[pid=11188/tid=11196] ppid=11186 vsize=1463308 CPUtime=1117.41 cores=1,3,5,7
/proc/11188/task/11196/stat : 11196 (SArTagnan) R 11186 11188 10575 0 -1 4202560 125901 0 0 0 111693 48 0 0 25 0 4 0 669761724 1498427392 281335 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11197] ppid=11186 vsize=1463308 CPUtime=813.67 cores=1,3,5,7
/proc/11188/task/11197/stat : 11197 (SArTagnan) R 11186 11188 10575 0 -1 4202560 151228 0 0 0 81284 83 0 0 25 0 4 0 669761724 1498427392 281335 33554432000 4194304 4625164 140733831346096 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=11188/tid=11198] ppid=11186 vsize=1463308 CPUtime=719 cores=1,3,5,7
/proc/11188/task/11198/stat : 11198 (SArTagnan) R 11186 11188 10575 0 -1 4202560 5043764 0 0 0 71094 806 0 0 25 0 4 0 669761724 1498427392 281335 33554432000 4194304 4625164 140733831346096 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3881.89
Current children cumulated vsize (KiB) 1463308

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.07
CPU time (s): 3881.97
CPU user time (s): 3872.26
CPU system time (s): 9.71252
CPU usage (%): 298.597
Max. virtual memory (cumulated for all children) (KiB): 1463308

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3872.26
system time used= 9.71252
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5463970
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3114
involuntary context switches= 43447

runsolver used 4.44332 second user time and 13.348 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-16 23:33:52
IDJOB=3385863
IDBENCH=83245
IDSOLVER=1871
FILE ID=node130/3385863-1305581632
RUNJOBID= node130-1305581631-11115
PBS_JOBID= 13350203
Free space on /tmp= 73352 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-3-6_2072.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385863-1305581632/watcher-3385863-1305581632 -o /tmp/evaluation-result-3385863-1305581632/solver-3385863-1305581632 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385863-1305581632.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2ef996f95bbf68a3c980c797dfdc364
RANDOM SEED=321772274

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24126020 kB
Buffers:        310628 kB
Cached:        4335948 kB
SwapCached:      10240 kB
Active:        4499608 kB
Inactive:      4022472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24126020 kB
SwapTotal:    67111528 kB
SwapFree:     63649240 kB
Dirty:            5964 kB
Writeback:           0 kB
AnonPages:     3873236 kB
Mapped:          23172 kB
Slab:           190692 kB
PageTables:      44504 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 110443960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73352 MiB
End job on node130 at 2011-05-16 23:55:34