Trace number 3250122

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.49 1201.86

General information on the benchmark

Namecrafted/manthey/sudoku-single-hard/
sudoku_81x81_unknown.cnf
MD5SUMcbd78921480e79d133eb06cb2172caa1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables18217
Number of clauses284829
Sum of the clauses size622430
Maximum clause length28
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2275099
Number of clauses of size 3620
Number of clauses of size 4984
Number of clauses of size 51120
Number of clauses of size over 57006

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250122-1304091668/watcher-3250122-1304091668 -o /tmp/evaluation-result-3250122-1304091668/solver-3250122-1304091668 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3250122-1304091668.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.80 8.05 8.01 6/180 19257
/proc/meminfo: memFree=28373880/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=27004 CPUtime=0 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 828 0 0 0 0 0 0 0 24 0 1 0 520767187 27652096 765 33554432000 4194304 4623224 140735867560720 18446744073709551615 253640859392 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19257/statm: 6751 765 297 105 0 2255 0

[startup+0.065867 s]
/proc/loadavg: 7.80 8.05 8.01 6/180 19257
/proc/meminfo: memFree=28373880/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=31184 CPUtime=0.05 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 3195 0 0 0 5 0 0 0 24 0 1 0 520767187 31932416 1667 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19257/statm: 7796 1668 297 105 0 3300 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 31184

[startup+0.103704 s]
/proc/loadavg: 7.80 8.05 8.01 6/180 19257
/proc/meminfo: memFree=28373880/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=213600 CPUtime=0.11 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 8290 0 0 0 10 1 0 0 25 0 4 0 520767187 218726400 5993 33554432000 4194304 4623224 140735867560720 18446744073709551615 4497500 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 53400 5993 323 105 0 48904 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 213600

[startup+0.300784 s]
/proc/loadavg: 7.80 8.05 8.01 6/180 19257
/proc/meminfo: memFree=28373880/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=280192 CPUtime=0.89 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 10885 0 0 0 88 1 0 0 25 0 4 0 520767187 286916608 8586 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366247 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 70048 8589 342 105 0 65552 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 280192

[startup+0.700712 s]
/proc/loadavg: 7.80 8.05 8.01 6/180 19257
/proc/meminfo: memFree=28373880/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=302044 CPUtime=2.5 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 28394 0 0 0 246 4 0 0 25 0 4 0 520767187 309293056 21007 33554432000 4194304 4623224 140735867560720 18446744073709551615 4360078 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 75511 21007 342 105 0 71015 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 302044

[startup+1.50057 s]
/proc/loadavg: 7.80 8.05 8.01 9/184 19261
/proc/meminfo: memFree=28282840/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=325156 CPUtime=5.69 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 39243 0 0 0 563 6 0 0 25 0 4 0 520767187 332959744 25227 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510445 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 81289 25227 343 105 0 76793 0
[pid=19257/tid=19259] ppid=19255 vsize=325156 CPUtime=1.4 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 5639 0 0 0 139 1 0 0 19 0 4 0 520767196 332959744 25227 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=325156 CPUtime=1.39 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 5692 0 0 0 139 0 0 0 25 0 4 0 520767196 332959744 25227 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=325156 CPUtime=1.39 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 7586 0 0 0 138 1 0 0 25 0 4 0 520767196 332959744 25227 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366866 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.69
Current children cumulated vsize (KiB) 325156

[startup+3.10027 s]
/proc/loadavg: 7.80 8.05 8.01 9/184 19261
/proc/meminfo: memFree=28267588/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=336108 CPUtime=12.08 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 47203 0 0 0 1200 8 0 0 25 0 4 0 520767187 344174592 27712 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 84027 27712 344 105 0 79531 0
[pid=19257/tid=19259] ppid=19255 vsize=336108 CPUtime=2.99 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 7881 0 0 0 298 1 0 0 24 0 4 0 520767196 344174592 27712 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=336108 CPUtime=2.99 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 8464 0 0 0 298 1 0 0 25 0 4 0 520767196 344174592 27712 33554432000 4194304 4623224 140735867560720 18446744073709551615 4377258 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=336108 CPUtime=2.98 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 7851 0 0 0 297 1 0 0 25 0 4 0 520767196 344174592 27712 33554432000 4194304 4623224 140735867560720 18446744073709551615 4549202 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.08
Current children cumulated vsize (KiB) 336108

[startup+6.30069 s]
/proc/loadavg: 7.82 8.05 8.01 9/184 19261
/proc/meminfo: memFree=28254616/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=339760 CPUtime=24.86 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 57496 0 0 0 2477 9 0 0 25 0 4 0 520767187 347914240 29701 33554432000 4194304 4623224 140735867560720 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 84940 29701 345 105 0 80444 0
[pid=19257/tid=19259] ppid=19255 vsize=339760 CPUtime=6.19 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 8327 0 0 0 618 1 0 0 25 0 4 0 520767196 347914240 29701 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=339760 CPUtime=6.19 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 8932 0 0 0 618 1 0 0 25 0 4 0 520767196 347914240 29702 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=339760 CPUtime=6.16 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 16687 0 0 0 614 2 0 0 25 0 4 0 520767196 347914240 29702 33554432000 4194304 4623224 140735867560720 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.86
Current children cumulated vsize (KiB) 339760

[startup+12.7005 s]
/proc/loadavg: 7.51 7.98 7.99 9/184 19292
/proc/meminfo: memFree=30154880/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=353028 CPUtime=50.43 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 76840 0 0 0 5029 14 0 0 25 0 4 0 520767187 361500672 33224 33554432000 4194304 4623224 140735867560720 18446744073709551615 4360030 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 88257 33224 345 105 0 83761 0
[pid=19257/tid=19259] ppid=19255 vsize=353028 CPUtime=12.59 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 12008 0 0 0 1257 2 0 0 25 0 4 0 520767196 361500672 33224 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=353028 CPUtime=12.59 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 12598 0 0 0 1256 3 0 0 25 0 4 0 520767196 361500672 33224 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=353028 CPUtime=12.53 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 28451 0 0 0 1249 4 0 0 25 0 4 0 520767196 361500672 33224 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.43
Current children cumulated vsize (KiB) 353028

[startup+25.5012 s]
/proc/loadavg: 7.69 8.00 7.99 9/184 19292
/proc/meminfo: memFree=30057460/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=361800 CPUtime=101.57 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 151430 0 0 0 10130 27 0 0 25 0 4 0 520767187 370483200 42581 33554432000 4194304 4623224 140735867560720 18446744073709551615 4360087 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 90450 42581 345 105 0 85954 0
[pid=19257/tid=19259] ppid=19255 vsize=361800 CPUtime=25.39 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 16494 0 0 0 2534 5 0 0 25 0 4 0 520767196 370483200 42581 33554432000 4194304 4623224 140735867560720 18446744073709551615 4377358 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=361800 CPUtime=25.39 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 14422 0 0 0 2536 3 0 0 25 0 4 0 520767196 370483200 42581 33554432000 4194304 4623224 140735867560720 18446744073709551615 253640515591 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=361800 CPUtime=25.26 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 93201 0 0 0 2513 13 0 0 25 0 4 0 520767196 370483200 42581 33554432000 4194304 4623224 140735867560720 18446744073709551615 4549223 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.57
Current children cumulated vsize (KiB) 361800

[startup+51.1005 s]
/proc/loadavg: 7.80 8.00 7.99 9/184 19293
/proc/meminfo: memFree=29906612/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=381116 CPUtime=203.82 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 279422 0 0 0 20333 49 0 0 25 0 4 0 520767187 390262784 60884 33554432000 4194304 4623224 140735867560720 18446744073709551615 4385096 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 95279 60884 345 105 0 90783 0
[pid=19257/tid=19259] ppid=19255 vsize=381116 CPUtime=51 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 28190 0 0 0 5090 10 0 0 25 0 4 0 520767196 390262784 60884 33554432000 4194304 4623224 140735867560720 18446744073709551615 4289942 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=381116 CPUtime=50.99 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 19456 0 0 0 5093 6 0 0 25 0 4 0 520767196 390262784 60884 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=381116 CPUtime=50.72 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 200022 0 0 0 5045 27 0 0 25 0 4 0 520767196 390262784 60884 33554432000 4194304 4623224 140735867560720 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.82
Current children cumulated vsize (KiB) 381116

[startup+102.306 s]
/proc/loadavg: 7.96 8.01 8.00 9/184 19294
/proc/meminfo: memFree=29665408/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=550516 CPUtime=408.38 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 428947 0 0 0 40756 82 0 0 25 0 4 0 520767187 563728384 89700 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 137629 89700 345 105 0 133133 0
[pid=19257/tid=19259] ppid=19255 vsize=550516 CPUtime=102.2 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 47386 0 0 0 10201 19 0 0 25 0 4 0 520767196 563728384 89700 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=550516 CPUtime=102.2 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 30684 0 0 0 10209 11 0 0 25 0 4 0 520767196 563728384 89700 33554432000 4194304 4623224 140735867560720 18446744073709551615 4377484 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=550516 CPUtime=101.66 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 313139 0 0 0 10122 44 0 0 25 0 4 0 520767196 563728384 89700 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.38
Current children cumulated vsize (KiB) 550516

[startup+162.301 s]
/proc/loadavg: 7.98 8.00 8.00 9/184 19296
/proc/meminfo: memFree=29418620/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=750124 CPUtime=648.05 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 684043 0 0 0 64676 129 0 0 25 0 4 0 520767187 768126976 124914 33554432000 4194304 4623224 140735867560720 18446744073709551615 4497604 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 187531 124914 345 105 0 183035 0
[pid=19257/tid=19259] ppid=19255 vsize=750124 CPUtime=162.19 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 72313 0 0 0 16189 30 0 0 25 0 4 0 520767196 768126976 124914 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=750124 CPUtime=162.19 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 38633 0 0 0 16204 15 0 0 25 0 4 0 520767196 768126976 124914 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=750124 CPUtime=161.35 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 529985 0 0 0 16061 74 0 0 25 0 4 0 520767196 768126976 124914 33554432000 4194304 4623224 140735867560720 18446744073709551615 4364611 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 648.05
Current children cumulated vsize (KiB) 750124

[startup+222.3 s]
/proc/loadavg: 7.99 8.00 8.00 9/184 19298
/proc/meminfo: memFree=29239668/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=798408 CPUtime=887.73 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 1053611 0 0 0 88583 190 0 0 25 0 4 0 520767187 817569792 153745 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 199602 153745 345 105 0 195106 0
[pid=19257/tid=19259] ppid=19255 vsize=798408 CPUtime=222.2 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 79469 0 0 0 22186 34 0 0 25 0 4 0 520767196 817569792 153745 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=798408 CPUtime=222.18 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 50854 0 0 0 22196 22 0 0 25 0 4 0 520767196 817569792 153745 33554432000 4194304 4623224 140735867560720 18446744073709551615 4463987 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=798408 CPUtime=221.03 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 870202 0 0 0 21982 121 0 0 25 0 4 0 520767196 817569792 153745 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 887.73
Current children cumulated vsize (KiB) 798408

[startup+282.3 s]

################
# More data... #
################

[pid=19257] ppid=19255 vsize=1251332 CPUtime=2565.48 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 3076692 0 0 0 256027 521 0 0 25 0 4 0 520767187 1281363968 244511 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510214 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 312833 244511 363 105 0 308337 0
[pid=19257/tid=19259] ppid=19255 vsize=1251332 CPUtime=642.21 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 105061 0 0 0 64181 40 0 0 25 0 4 0 520767196 1281363968 244511 33554432000 4194304 4623224 140735867560720 18446744073709551615 4486229 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1251332 CPUtime=642.17 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 104423 0 0 0 64154 63 0 0 25 0 4 0 520767196 1281363968 244511 33554432000 4194304 4623224 140735867560720 18446744073709551615 4289875 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1251332 CPUtime=638.76 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 2791839 0 0 0 63475 401 0 0 25 0 4 0 520767196 1281363968 244511 33554432000 4194304 4623224 140735867560720 18446744073709551615 4545328 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2565.48
Current children cumulated vsize (KiB) 1251332

[startup+702.301 s]
/proc/loadavg: 8.17 8.13 8.04 9/184 19310
/proc/meminfo: memFree=28386020/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1251332 CPUtime=2805.13 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 3102892 0 0 0 279988 525 0 0 25 0 4 0 520767187 1281363968 248647 33554432000 4194304 4623224 140735867560720 18446744073709551615 4384347 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 312833 248647 346 105 0 308337 0
[pid=19257/tid=19259] ppid=19255 vsize=1251332 CPUtime=702.21 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 105251 0 0 0 70181 40 0 0 25 0 4 0 520767196 1281363968 248647 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1251332 CPUtime=702.16 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 107156 0 0 0 70152 64 0 0 25 0 4 0 520767196 1281363968 248647 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1251332 CPUtime=698.43 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 2814053 0 0 0 69439 404 0 0 25 0 4 0 520767196 1281363968 248647 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2805.13
Current children cumulated vsize (KiB) 1251332

[startup+762.307 s]
/proc/loadavg: 8.16 8.13 8.05 9/184 19312
/proc/meminfo: memFree=28323604/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1322708 CPUtime=3044.83 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 3257757 0 0 0 303931 552 0 0 25 0 4 0 520767187 1354452992 255556 33554432000 4194304 4623224 140735867560720 18446744073709551615 4513433 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 330677 255556 345 105 0 326181 0
[pid=19257/tid=19259] ppid=19255 vsize=1322708 CPUtime=762.21 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 105457 0 0 0 76181 40 0 0 25 0 4 0 520767196 1354452992 255556 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1322708 CPUtime=762.17 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 110411 0 0 0 76149 68 0 0 25 0 4 0 520767196 1354452992 255556 33554432000 4194304 4623224 140735867560720 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1322708 CPUtime=758.09 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 2965014 0 0 0 75383 426 0 0 25 0 4 0 520767196 1354452992 255556 33554432000 4194304 4623224 140735867560720 18446744073709551615 4546020 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3044.83
Current children cumulated vsize (KiB) 1322708

[startup+822.301 s]
/proc/loadavg: 8.22 8.15 8.06 9/184 19314
/proc/meminfo: memFree=28268532/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1257172 CPUtime=3284.48 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 3453062 0 0 0 327862 586 0 0 25 0 4 0 520767187 1287344128 260458 33554432000 4194304 4623224 140735867560720 18446744073709551615 4511665 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 314293 260458 345 105 0 309797 0
[pid=19257/tid=19259] ppid=19255 vsize=1257172 CPUtime=822.21 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 105630 0 0 0 82181 40 0 0 25 0 4 0 520767196 1287344128 260458 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1257172 CPUtime=822.16 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 114938 0 0 0 82144 72 0 0 25 0 4 0 520767196 1287344128 260458 33554432000 4194304 4623224 140735867560720 18446744073709551615 4462966 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1257172 CPUtime=817.76 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 3154890 0 0 0 81321 455 0 0 25 0 4 0 520767196 1287344128 260458 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.48
Current children cumulated vsize (KiB) 1257172

[startup+882.301 s]
/proc/loadavg: 8.21 8.15 8.06 9/184 19315
/proc/meminfo: memFree=28184800/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1329928 CPUtime=3524.15 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 3740103 0 0 0 351780 635 0 0 25 0 4 0 520767187 1361846272 268872 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 332482 268872 345 105 0 327986 0
[pid=19257/tid=19259] ppid=19255 vsize=1329928 CPUtime=882.22 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 105821 0 0 0 88181 41 0 0 25 0 4 0 520767196 1361846272 268872 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1329928 CPUtime=882.16 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 120095 0 0 0 88138 78 0 0 25 0 4 0 520767196 1361846272 268872 33554432000 4194304 4623224 140735867560720 18446744073709551615 4463089 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1329928 CPUtime=877.43 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 3436069 0 0 0 87245 498 0 0 25 0 4 0 520767196 1361846272 268872 33554432000 4194304 4623224 140735867560720 18446744073709551615 4365951 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.15
Current children cumulated vsize (KiB) 1329928

[startup+942.301 s]
/proc/loadavg: 8.19 8.15 8.07 9/184 19317
/proc/meminfo: memFree=28106664/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1329928 CPUtime=3763.83 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 4162440 0 0 0 375671 712 0 0 25 0 4 0 520767187 1361846272 276863 33554432000 4194304 4623224 140735867560720 18446744073709551615 4359016 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 332482 276863 345 105 0 327986 0
[pid=19257/tid=19259] ppid=19255 vsize=1329928 CPUtime=942.22 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 105965 0 0 0 94181 41 0 0 25 0 4 0 520767196 1361846272 276863 33554432000 4194304 4623224 140735867560720 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1329928 CPUtime=942.15 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 127209 0 0 0 94129 86 0 0 25 0 4 0 520767196 1361846272 276863 33554432000 4194304 4623224 140735867560720 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1329928 CPUtime=937.11 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 3850603 0 0 0 93145 566 0 0 25 0 4 0 520767196 1361846272 276863 33554432000 4194304 4623224 140735867560720 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3763.83
Current children cumulated vsize (KiB) 1329928

[startup+1002.3 s]
/proc/loadavg: 8.23 8.17 8.08 9/184 19318
/proc/meminfo: memFree=28042536/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1329928 CPUtime=4003.5 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 4543356 0 0 0 399580 770 0 0 25 0 4 0 520767187 1361846272 280655 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 332482 280655 345 105 0 327986 0
[pid=19257/tid=19259] ppid=19255 vsize=1329928 CPUtime=1002.22 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 106176 0 0 0 100181 41 0 0 25 0 4 0 520767196 1361846272 280655 33554432000 4194304 4623224 140735867560720 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1329928 CPUtime=1002.15 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 129782 0 0 0 100127 88 0 0 25 0 4 0 520767196 1361846272 280655 33554432000 4194304 4623224 140735867560720 18446744073709551615 253640526752 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1329928 CPUtime=996.77 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 4227835 0 0 0 99056 621 0 0 25 0 4 0 520767196 1361846272 280655 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.5
Current children cumulated vsize (KiB) 1329928

[startup+1062.3 s]
/proc/loadavg: 8.19 8.17 8.08 9/184 19320
/proc/meminfo: memFree=27981004/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1357664 CPUtime=4243.17 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 4882424 0 0 0 423492 825 0 0 25 0 4 0 520767187 1390247936 287063 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 339416 287063 345 105 0 334920 0
[pid=19257/tid=19259] ppid=19255 vsize=1357664 CPUtime=1062.22 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 106424 0 0 0 106181 41 0 0 25 0 4 0 520767196 1390247936 287063 33554432000 4194304 4623224 140735867560720 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1357664 CPUtime=1062.16 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 129991 0 0 0 106128 88 0 0 25 0 4 0 520767196 1390247936 287063 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1357664 CPUtime=1056.44 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 4552129 0 0 0 104969 675 0 0 25 0 4 0 520767196 1390247936 287063 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.17
Current children cumulated vsize (KiB) 1357664

[startup+1122.3 s]
/proc/loadavg: 8.16 8.16 8.09 9/184 19322
/proc/meminfo: memFree=27882028/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1396588 CPUtime=4482.85 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 5245621 0 0 0 447405 880 0 0 25 0 4 0 520767187 1430106112 297896 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 349147 297896 345 105 0 344651 0
[pid=19257/tid=19259] ppid=19255 vsize=1396588 CPUtime=1122.23 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 111519 0 0 0 112181 42 0 0 25 0 4 0 520767196 1430106112 297896 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1396588 CPUtime=1122.16 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 130412 0 0 0 112127 89 0 0 25 0 4 0 520767196 1430106112 297896 33554432000 4194304 4623224 140735867560720 18446744073709551615 4377034 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1396588 CPUtime=1116.12 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 4909309 0 0 0 110883 729 0 0 25 0 4 0 520767196 1430106112 297896 33554432000 4194304 4623224 140735867560720 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4482.85
Current children cumulated vsize (KiB) 1396588

[startup+1182.3 s]
/proc/loadavg: 8.10 8.14 8.09 9/184 19323
/proc/meminfo: memFree=27802652/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1418324 CPUtime=4722.52 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 5316037 0 0 0 471359 893 0 0 25 0 4 0 520767187 1452363776 305430 33554432000 4194304 4623224 140735867560720 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 354581 305430 345 105 0 350085 0
[pid=19257/tid=19259] ppid=19255 vsize=1418324 CPUtime=1182.22 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 111704 0 0 0 118180 42 0 0 25 0 4 0 520767196 1452363776 305430 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357403 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1418324 CPUtime=1182.15 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 134080 0 0 0 118125 90 0 0 25 0 4 0 520767196 1452363776 305430 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1418324 CPUtime=1175.78 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 4975167 0 0 0 116839 739 0 0 25 0 4 0 520767196 1452363776 305430 33554432000 4194304 4623224 140735867560720 18446744073709551615 4577664 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.52
Current children cumulated vsize (KiB) 1418324



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.14 8.15 8.09 9/184 19333
/proc/meminfo: memFree=27783864/32951124 swapFree=67111364/67111528
[pid=19257] ppid=19255 vsize=1418688 CPUtime=4800.41 cores=0,2,4,6
/proc/19257/stat : 19257 (SArTagnan) R 19255 19257 18837 0 -1 4202496 5320882 0 0 0 479142 899 0 0 25 0 4 0 520767187 1452736512 310275 33554432000 4194304 4623224 140735867560720 18446744073709551615 4508385 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19257/statm: 354672 310275 345 105 0 350176 0
[pid=19257/tid=19259] ppid=19255 vsize=1418688 CPUtime=1201.73 cores=0,2,4,6
/proc/19257/task/19259/stat : 19259 (SArTagnan) R 19255 19257 18837 0 -1 4202560 111747 0 0 0 120131 42 0 0 25 0 4 0 520767196 1452736512 310275 33554432000 4194304 4623224 140735867560720 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19257/tid=19260] ppid=19255 vsize=1418688 CPUtime=1201.66 cores=0,2,4,6
/proc/19257/task/19260/stat : 19260 (SArTagnan) R 19255 19257 18837 0 -1 4202560 138471 0 0 0 120070 96 0 0 25 0 4 0 520767196 1452736512 310275 33554432000 4194304 4623224 140735867560720 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19257/tid=19261] ppid=19255 vsize=1418688 CPUtime=1195.17 cores=0,2,4,6
/proc/19257/task/19261/stat : 19261 (SArTagnan) R 19255 19257 18837 0 -1 4202560 4975340 0 0 0 118778 739 0 0 25 0 4 0 520767196 1452736512 310275 33554432000 4194304 4623224 140735867560720 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 1418688

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.86
CPU time (s): 4800.49
CPU user time (s): 4791.44
CPU system time (s): 9.04562
CPU usage (%): 399.421
Max. virtual memory (cumulated for all children) (KiB): 1483860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.44
system time used= 9.04562
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5320883
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2600
involuntary context switches= 20828

runsolver used 1.92271 second user time and 4.52331 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-29 17:41:08
IDJOB=3250122
IDBENCH=83244
IDSOLVER=1656
FILE ID=node106/3250122-1304091668
RUNJOBID= node106-1304089256-18855
PBS_JOBID= 13170570
Free space on /tmp= 72156 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/manthey/sudoku-single-hard/sudoku_81x81_unknown.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250122-1304091668/watcher-3250122-1304091668 -o /tmp/evaluation-result-3250122-1304091668/solver-3250122-1304091668 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3250122-1304091668.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cbd78921480e79d133eb06cb2172caa1
RANDOM SEED=1971706789

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28374160 kB
Buffers:        249584 kB
Cached:        2071400 kB
SwapCached:         88 kB
Active:        2761420 kB
Inactive:      1601240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28374160 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            4680 kB
Writeback:           0 kB
AnonPages:     2040928 kB
Mapped:          15500 kB
Slab:           146456 kB
PageTables:       8828 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2596324 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72152 MiB
End job on node106 at 2011-04-29 18:01:12