Trace number 3385895

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.24 1204.99

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-15-15-unsat.cnf
MD5SUM647576009a3d34cc33c6dfd3ecb1a2ef
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables225
Number of clauses1800
Sum of the clauses size6525
Maximum clause length15
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21575
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5225

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385895-1305581604/watcher-3385895-1305581604 -o /tmp/evaluation-result-3385895-1305581604/solver-3385895-1305581604 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385895-1305581604.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.84 6.98 8.23 2/449 1141
/proc/meminfo: memFree=13245540/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=49372 CPUtime=0 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 468 0 0 0 0 0 0 0 25 0 4 0 748391079 50556928 406 33554432000 4194304 4625164 140734226411728 18446744073709551615 47617879144368 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1141/statm: 12343 406 300 106 0 7846 0
[pid=1141/tid=1142] ppid=1139 vsize=180640 CPUtime=0.01 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 58 0 0 0 1 0 0 0 25 0 4 0 748391079 184975360 645 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415052833 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=180640 CPUtime=0 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 4 0 748391079 184975360 653 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415496686 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=180640 CPUtime=0.01 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 35 0 0 0 1 0 0 0 25 0 4 0 748391079 184975360 653 33554432000 4194304 4625164 140734226411728 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.0978511 s]
/proc/loadavg: 4.84 6.98 8.23 2/449 1141
/proc/meminfo: memFree=13245540/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=248808 CPUtime=0.35 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 1926 0 0 0 35 0 0 0 25 0 4 0 748391079 254779392 1726 33554432000 4194304 4625164 140734226411728 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 62202 1726 343 106 0 57705 0
[pid=1141/tid=1142] ppid=1139 vsize=248808 CPUtime=0.09 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 439 0 0 0 9 0 0 0 25 0 4 0 748391079 254779392 1726 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415052833 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=248808 CPUtime=0.07 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 362 0 0 0 7 0 0 0 25 0 4 0 748391079 254779392 1726 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415088848 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=248808 CPUtime=0.09 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 264 0 0 0 9 0 0 0 25 0 4 0 748391079 254779392 1726 33554432000 4194304 4625164 140734226411728 18446744073709551615 4561161 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 248808

[startup+0.117811 s]
/proc/loadavg: 4.84 6.98 8.23 2/449 1141
/proc/meminfo: memFree=13245540/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=249012 CPUtime=0.43 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 2371 0 0 0 43 0 0 0 25 0 4 0 748391079 254988288 1869 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512475 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 62253 1869 342 106 0 57756 0
[pid=1141/tid=1142] ppid=1139 vsize=249012 CPUtime=0.11 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) D 1139 1141 617 0 -1 4202560 604 0 0 0 11 0 0 0 25 0 4 0 748391079 254988288 1869 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415434935 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=249012 CPUtime=0.09 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 447 0 0 0 9 0 0 0 25 0 4 0 748391079 254988288 1869 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415052485 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=249012 CPUtime=0.11 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 336 0 0 0 11 0 0 0 25 0 4 0 748391079 254988288 1869 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 249012

[startup+0.300551 s]
/proc/loadavg: 4.84 6.98 8.23 2/449 1141
/proc/meminfo: memFree=13245540/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=251352 CPUtime=1.16 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 4404 0 0 0 116 0 0 0 25 0 4 0 748391079 257384448 3235 33554432000 4194304 4625164 140734226411728 18446744073709551615 4511860 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 62838 3236 342 106 0 58341 0
[pid=1141/tid=1142] ppid=1139 vsize=251352 CPUtime=0.29 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 1323 0 0 0 29 0 0 0 25 0 4 0 748391079 257384448 3236 33554432000 4194304 4625164 140734226411728 18446744073709551615 4339546 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=251352 CPUtime=0.28 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 1186 0 0 0 28 0 0 0 25 0 4 0 748391079 257384448 3236 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=251352 CPUtime=0.29 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 604 0 0 0 29 0 0 0 25 0 4 0 748391079 257384448 3236 33554432000 4194304 4625164 140734226411728 18446744073709551615 47617879144998 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 251352

[startup+0.70048 s]
/proc/loadavg: 4.84 6.98 8.23 2/449 1141
/proc/meminfo: memFree=13245540/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=254708 CPUtime=2.76 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 8156 0 0 0 275 1 0 0 25 0 4 0 748391079 260820992 5563 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 63677 5563 342 106 0 59180 0
[pid=1141/tid=1142] ppid=1139 vsize=254708 CPUtime=0.68 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 2809 0 0 0 68 0 0 0 18 0 4 0 748391079 260820992 5563 33554432000 4194304 4625164 140734226411728 18446744073709551615 4292264 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=254708 CPUtime=0.67 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 2702 0 0 0 67 0 0 0 25 0 4 0 748391079 260820992 5563 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=254708 CPUtime=0.69 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 1189 0 0 0 69 0 0 0 25 0 4 0 748391079 260820992 5563 33554432000 4194304 4625164 140734226411728 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 254708

[startup+1.50033 s]
/proc/loadavg: 4.84 6.98 8.23 11/461 1186
/proc/meminfo: memFree=13197456/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=258492 CPUtime=5.94 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 13270 0 0 0 592 2 0 0 25 0 4 0 748391079 264695808 8729 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512026 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 64623 8729 343 106 0 60126 0
[pid=1141/tid=1142] ppid=1139 vsize=258492 CPUtime=1.48 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 4617 0 0 0 148 0 0 0 19 0 4 0 748391079 264695808 8729 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=258492 CPUtime=1.46 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 4420 0 0 0 145 1 0 0 25 0 4 0 748391079 264695808 8729 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=258492 CPUtime=1.49 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 2331 0 0 0 149 0 0 0 25 0 4 0 748391079 264695808 8729 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415049990 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 258492

[startup+3.10103 s]
/proc/loadavg: 4.84 6.98 8.23 7/454 1234
/proc/meminfo: memFree=13201472/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=269640 CPUtime=12.33 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 22569 0 0 0 1230 3 0 0 25 0 4 0 748391079 276111360 14090 33554432000 4194304 4625164 140734226411728 18446744073709551615 4518988 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 67410 14090 346 106 0 62913 0
[pid=1141/tid=1142] ppid=1139 vsize=269640 CPUtime=3.09 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 7051 0 0 0 308 1 0 0 22 0 4 0 748391079 276111360 14090 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=269640 CPUtime=3.04 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 8229 0 0 0 303 1 0 0 25 0 4 0 748391079 276111360 14090 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=269640 CPUtime=3.09 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 4586 0 0 0 309 0 0 0 25 0 4 0 748391079 276111360 14090 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415058906 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 269640

[startup+6.30042 s]
/proc/loadavg: 5.18 7.01 8.24 10/461 1276
/proc/meminfo: memFree=13100456/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=280868 CPUtime=25.08 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 39607 0 0 0 2502 6 0 0 25 0 4 0 748391079 287608832 21714 33554432000 4194304 4625164 140734226411728 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 70217 21714 353 106 0 65720 0
[pid=1141/tid=1142] ppid=1139 vsize=280868 CPUtime=6.29 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 9725 0 0 0 627 2 0 0 25 0 4 0 748391079 287608832 21714 33554432000 4194304 4625164 140734226411728 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=280868 CPUtime=6.19 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 12620 0 0 0 617 2 0 0 25 0 4 0 748391079 287608832 21714 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=280868 CPUtime=6.29 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 12733 0 0 0 628 1 0 0 25 0 4 0 748391079 287608832 21714 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.08
Current children cumulated vsize (KiB) 280868

[startup+12.7002 s]
/proc/loadavg: 5.48 7.04 8.24 10/461 1276
/proc/meminfo: memFree=12971204/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=319644 CPUtime=50.57 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 60760 0 0 0 5046 11 0 0 25 0 4 0 748391079 327315456 32857 33554432000 4194304 4625164 140734226411728 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 79911 32857 441 106 0 75414 0
[pid=1141/tid=1142] ppid=1139 vsize=319644 CPUtime=12.68 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 17858 0 0 0 1264 4 0 0 25 0 4 0 748391079 327315456 32857 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=319644 CPUtime=12.49 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 19032 0 0 0 1246 3 0 0 25 0 4 0 748391079 327315456 32857 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=319644 CPUtime=12.69 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 15566 0 0 0 1267 2 0 0 25 0 4 0 748391079 327315456 32857 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.57
Current children cumulated vsize (KiB) 319644

[startup+25.5008 s]
/proc/loadavg: 6.33 7.15 8.26 10/461 1277
/proc/meminfo: memFree=12807072/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=340832 CPUtime=101.58 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 145655 0 0 0 10130 28 0 0 25 0 4 0 748391079 349011968 48557 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415049970 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 85208 48557 420 106 0 80711 0
[pid=1141/tid=1142] ppid=1139 vsize=340832 CPUtime=25.48 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 27869 0 0 0 2541 7 0 0 25 0 4 0 748391079 349011968 48557 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=340832 CPUtime=25.1 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 27633 0 0 0 2505 5 0 0 25 0 4 0 748391079 349011968 48557 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=340832 CPUtime=25.49 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 80281 0 0 0 2536 13 0 0 25 0 4 0 748391079 349011968 48557 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.58
Current children cumulated vsize (KiB) 340832

[startup+51.101 s]
/proc/loadavg: 7.24 7.30 8.28 10/461 1277
/proc/meminfo: memFree=12575548/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=508844 CPUtime=203.6 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 220453 0 0 0 20322 38 0 0 25 0 4 0 748391079 521056256 67962 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 127211 67962 450 106 0 122714 0
[pid=1141/tid=1142] ppid=1139 vsize=508844 CPUtime=51.07 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 36835 0 0 0 5099 8 0 0 25 0 4 0 748391079 521056256 67962 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352002 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=508844 CPUtime=50.32 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 40830 0 0 0 5025 7 0 0 25 0 4 0 748391079 521056256 67962 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=508844 CPUtime=51.08 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 124204 0 0 0 5090 18 0 0 25 0 4 0 748391079 521056256 67962 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.6
Current children cumulated vsize (KiB) 508844

[startup+102.317 s]
/proc/loadavg: 8.40 7.61 8.33 10/461 1309
/proc/meminfo: memFree=12703744/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=668552 CPUtime=407.67 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 393149 0 0 0 40693 74 0 0 25 0 4 0 748391079 684597248 113035 33554432000 4194304 4625164 140734226411728 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 167138 113035 894 106 0 162641 0
[pid=1141/tid=1142] ppid=1139 vsize=668552 CPUtime=102.27 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 48479 0 0 0 10209 18 0 0 25 0 4 0 748391079 684597248 113035 33554432000 4194304 4625164 140734226411728 18446744073709551615 4339600 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=668552 CPUtime=101.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 60220 0 0 0 10104 10 0 0 25 0 4 0 748391079 684597248 113035 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=668552 CPUtime=101.92 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 229739 0 0 0 10156 36 0 0 25 0 4 0 748391079 684597248 113035 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.67
Current children cumulated vsize (KiB) 668552

[startup+162.301 s]

################
# More data... #
################

[pid=1141] ppid=1139 vsize=1918200 CPUtime=2797.48 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 3592854 0 0 0 279094 654 0 0 25 0 4 0 748391079 1964236800 345703 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 479550 345703 343 106 0 475053 0
[pid=1141/tid=1142] ppid=1139 vsize=1918200 CPUtime=701.98 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 205914 0 0 0 70099 99 0 0 25 0 4 0 748391079 1964236800 345703 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1918200 CPUtime=701.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 211008 0 0 0 70063 51 0 0 25 0 4 0 748391079 1964236800 345703 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1918200 CPUtime=692.18 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 2067583 0 0 0 68896 322 0 0 25 0 4 0 748391079 1964236800 345703 33554432000 4194304 4625164 140734226411728 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2797.48
Current children cumulated vsize (KiB) 1918200

[startup+762.318 s]
/proc/loadavg: 9.14 9.01 8.75 10/461 1329
/proc/meminfo: memFree=11132208/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=1918200 CPUtime=3036.63 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 3886129 0 0 0 302964 699 0 0 25 0 4 0 748391079 1964236800 361624 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 479550 361624 351 106 0 475053 0
[pid=1141/tid=1142] ppid=1139 vsize=1918200 CPUtime=761.98 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 210219 0 0 0 76097 101 0 0 25 0 4 0 748391079 1964236800 361624 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1918200 CPUtime=761.15 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 215658 0 0 0 76062 53 0 0 25 0 4 0 748391079 1964236800 361624 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1918200 CPUtime=751.29 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 2339295 0 0 0 74768 361 0 0 25 0 4 0 748391079 1964236800 361624 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351887 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3036.63
Current children cumulated vsize (KiB) 1918200

[startup+822.3 s]
/proc/loadavg: 9.16 9.04 8.77 10/461 1331
/proc/meminfo: memFree=11043052/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=1918200 CPUtime=3275.63 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 4151841 0 0 0 326822 741 0 0 25 0 4 0 748391079 1964236800 371976 33554432000 4194304 4625164 140734226411728 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 479550 371976 344 106 0 475053 0
[pid=1141/tid=1142] ppid=1139 vsize=1918200 CPUtime=821.95 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 214236 0 0 0 82088 107 0 0 25 0 4 0 748391079 1964236800 371976 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1918200 CPUtime=821.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 216919 0 0 0 82059 55 0 0 25 0 4 0 748391079 1964236800 371976 33554432000 4194304 4625164 140734226411728 18446744073709551615 4352145 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1918200 CPUtime=810.36 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 2596416 0 0 0 80641 395 0 0 25 0 4 0 748391079 1964236800 371976 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3275.63
Current children cumulated vsize (KiB) 1918200

[startup+882.301 s]
/proc/loadavg: 9.17 9.06 8.80 10/461 1333
/proc/meminfo: memFree=10980304/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=1918200 CPUtime=3514.7 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 4438818 0 0 0 350682 788 0 0 25 0 4 0 748391079 1964236800 381954 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 479550 381954 343 106 0 475053 0
[pid=1141/tid=1142] ppid=1139 vsize=1918200 CPUtime=881.93 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 217243 0 0 0 88082 111 0 0 25 0 4 0 748391079 1964236800 381954 33554432000 4194304 4625164 140734226411728 18446744073709551615 4345240 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1918200 CPUtime=881.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 220505 0 0 0 88057 57 0 0 25 0 4 0 748391079 1964236800 381954 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415052833 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1918200 CPUtime=869.43 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 2875230 0 0 0 86509 434 0 0 25 0 4 0 748391079 1964236800 381954 33554432000 4194304 4625164 140734226411728 18446744073709551615 4278537 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3514.7
Current children cumulated vsize (KiB) 1918200

[startup+942.301 s]
/proc/loadavg: 9.27 9.11 8.83 10/461 1334
/proc/meminfo: memFree=10900448/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=1983736 CPUtime=3753.78 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 4719570 0 0 0 374546 832 0 0 25 0 4 0 748391079 2031345664 396217 33554432000 4194304 4625164 140734226411728 18446744073709551615 4393127 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 495934 396217 377 106 0 491437 0
[pid=1141/tid=1142] ppid=1139 vsize=1983736 CPUtime=941.93 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 223272 0 0 0 94077 116 0 0 25 0 4 0 748391079 2031345664 396217 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1983736 CPUtime=941.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 224077 0 0 0 94053 61 0 0 25 0 4 0 748391079 2031345664 396217 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1983736 CPUtime=928.53 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 3144634 0 0 0 92383 470 0 0 25 0 4 0 748391079 2031345664 396217 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3753.78
Current children cumulated vsize (KiB) 1983736

[startup+1002.3 s]
/proc/loadavg: 9.16 9.10 8.84 10/461 1336
/proc/meminfo: memFree=10829520/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=1983736 CPUtime=3992.84 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 4907153 0 0 0 398416 868 0 0 25 0 4 0 748391079 2031345664 406896 33554432000 4194304 4625164 140734226411728 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 495934 406896 362 106 0 491437 0
[pid=1141/tid=1142] ppid=1139 vsize=1983736 CPUtime=1001.9 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 226074 0 0 0 100069 121 0 0 25 0 4 0 748391079 2031345664 406896 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1983736 CPUtime=1001.15 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 226198 0 0 0 100050 65 0 0 25 0 4 0 748391079 2031345664 406896 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1983736 CPUtime=987.6 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 3323846 0 0 0 98264 496 0 0 25 0 4 0 748391079 2031345664 406896 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3992.84
Current children cumulated vsize (KiB) 1983736

[startup+1062.3 s]
/proc/loadavg: 9.10 9.10 8.85 10/461 1337
/proc/meminfo: memFree=10749784/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=1983736 CPUtime=4231.93 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 5247193 0 0 0 422269 924 0 0 25 0 4 0 748391079 2031345664 414527 33554432000 4194304 4625164 140734226411728 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 495934 414527 343 106 0 491437 0
[pid=1141/tid=1142] ppid=1139 vsize=1983736 CPUtime=1061.89 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 228864 0 0 0 106064 125 0 0 25 0 4 0 748391079 2031345664 414527 33554432000 4194304 4625164 140734226411728 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=1983736 CPUtime=1061.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 228655 0 0 0 106046 68 0 0 25 0 4 0 748391079 2031345664 414527 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=1983736 CPUtime=1046.69 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 3656268 0 0 0 104125 544 0 0 25 0 4 0 748391079 2031345664 414527 33554432000 4194304 4625164 140734226411728 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4231.93
Current children cumulated vsize (KiB) 1983736

[startup+1122.3 s]
/proc/loadavg: 9.10 9.09 8.86 10/461 1339
/proc/meminfo: memFree=10684192/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=2043560 CPUtime=4470.98 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 5529885 0 0 0 446127 971 0 0 25 0 4 0 748391079 2092605440 425920 33554432000 4194304 4625164 140734226411728 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 510890 425920 343 106 0 506393 0
[pid=1141/tid=1142] ppid=1139 vsize=2043560 CPUtime=1121.88 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 228944 0 0 0 112063 125 0 0 25 0 4 0 748391079 2092605440 425920 33554432000 4194304 4625164 140734226411728 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=2043560 CPUtime=1121.14 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 232997 0 0 0 112040 74 0 0 25 0 4 0 748391079 2092605440 425920 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=2043560 CPUtime=1105.76 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 3902732 0 0 0 109996 580 0 0 25 0 4 0 748391079 2092605440 425920 33554432000 4194304 4625164 140734226411728 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4470.98
Current children cumulated vsize (KiB) 2043560

[startup+1182.3 s]
/proc/loadavg: 9.06 9.08 8.87 10/461 1341
/proc/meminfo: memFree=10643136/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=2112220 CPUtime=4710.05 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 5754058 0 0 0 469993 1012 0 0 25 0 4 0 748391079 2162913280 432351 33554432000 4194304 4625164 140734226411728 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 528055 432351 343 106 0 523558 0
[pid=1141/tid=1142] ppid=1139 vsize=2112220 CPUtime=1181.86 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 229106 0 0 0 118061 125 0 0 25 0 4 0 748391079 2162913280 432351 33554432000 4194304 4625164 140734226411728 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=2112220 CPUtime=1181.15 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 234674 0 0 0 118038 77 0 0 25 0 4 0 748391079 2162913280 432351 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=2112220 CPUtime=1164.84 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 4026252 0 0 0 115884 600 0 0 25 0 4 0 748391079 2162913280 432351 33554432000 4194304 4625164 140734226411728 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4710.05
Current children cumulated vsize (KiB) 2112220



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.9 s]
/proc/loadavg: 9.04 9.08 8.88 10/461 1341
/proc/meminfo: memFree=10624408/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=2146056 CPUtime=4800.1 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 5931113 0 0 0 478971 1039 0 0 25 0 4 0 748391079 2197561344 435968 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415435111 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 536514 435968 367 106 0 532017 0
[pid=1141/tid=1142] ppid=1139 vsize=2146056 CPUtime=1204.47 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 229132 0 0 0 120322 125 0 0 25 0 4 0 748391079 2197561344 436063 33554432000 4194304 4625164 140734226411728 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=2146056 CPUtime=1203.77 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 234741 0 0 0 120300 77 0 0 25 0 4 0 748391079 2197561344 436063 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=2146056 CPUtime=1187.09 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 4129126 0 0 0 118093 616 0 0 25 0 4 0 748391079 2197561344 436063 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 2146056

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.9 s]
/proc/loadavg: 9.04 9.08 8.88 10/461 1341
/proc/meminfo: memFree=10624408/32950928 swapFree=67111200/67111528
[pid=1141] ppid=1139 vsize=2146056 CPUtime=4800.1 cores=1,3,5,7
/proc/1141/stat : 1141 (SArTagnan) R 1139 1141 617 0 -1 4202496 5931113 0 0 0 478971 1039 0 0 25 0 4 0 748391079 2197561344 435968 33554432000 4194304 4625164 140734226411728 18446744073709551615 256415435111 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1141/statm: 536514 435968 367 106 0 532017 0
[pid=1141/tid=1142] ppid=1139 vsize=2146056 CPUtime=1204.47 cores=1,3,5,7
/proc/1141/task/1142/stat : 1142 (SArTagnan) R 1139 1141 617 0 -1 4202560 229132 0 0 0 120322 125 0 0 25 0 4 0 748391079 2197561344 436063 33554432000 4194304 4625164 140734226411728 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1141/tid=1143] ppid=1139 vsize=2146056 CPUtime=1203.77 cores=1,3,5,7
/proc/1141/task/1143/stat : 1143 (SArTagnan) R 1139 1141 617 0 -1 4202560 234741 0 0 0 120300 77 0 0 25 0 4 0 748391079 2197561344 436063 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=1141/tid=1144] ppid=1139 vsize=2146056 CPUtime=1187.09 cores=1,3,5,7
/proc/1141/task/1144/stat : 1144 (SArTagnan) R 1139 1141 617 0 -1 4202560 4129126 0 0 0 118093 616 0 0 25 0 4 0 748391079 2197561344 436063 33554432000 4194304 4625164 140734226411728 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 2146056

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.99
CPU time (s): 4800.24
CPU user time (s): 4789.78
CPU system time (s): 10.4594
CPU usage (%): 398.363
Max. virtual memory (cumulated for all children) (KiB): 2146056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4789.78
system time used= 10.4594
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5931208
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1796
involuntary context switches= 33188

runsolver used 5.34319 second user time and 13.108 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-16 23:33:24
IDJOB=3385895
IDBENCH=83230
IDSOLVER=1871
FILE ID=node115/3385895-1305581604
RUNJOBID= node115-1305581604-1070
PBS_JOBID= 13350213
Free space on /tmp= 73268 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-15-15-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385895-1305581604/watcher-3385895-1305581604 -o /tmp/evaluation-result-3385895-1305581604/solver-3385895-1305581604 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385895-1305581604.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 647576009a3d34cc33c6dfd3ecb1a2ef
RANDOM SEED=3814331

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13245688 kB
Buffers:        284324 kB
Cached:        3260900 kB
SwapCached:          0 kB
Active:       16278980 kB
Inactive:      3095068 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13245688 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:             580 kB
Writeback:           0 kB
AnonPages:    15828708 kB
Mapped:          36220 kB
Slab:           197280 kB
PageTables:      66004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 122579856 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node115 at 2011-05-16 23:53:31