Trace number 3273970

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.42 1201.76

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n140-s20078956-unsat.cnf
MD5SUM8d05c170d9e6ebfc370bd1d7f7c63d86
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables141
Number of clauses292
Sum of the clauses size876
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3292
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273970-1304086395/watcher-3273970-1304086395 -o /tmp/evaluation-result-3273970-1304086395/solver-3273970-1304086395 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3273970-1304086395.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 446 0 0 0 0 0 0 0 18 0 4 0 501055668 50388992 382 33554432000 4194304 4623224 140735551145264 18446744073709551615 47386876098482 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 12302 382 301 105 0 7806 0
[pid=12516/tid=12517] ppid=12512 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 4 0 501055669 50388992 382 33554432000 4194304 4623224 140735551145264 18446744073709551615 255106825201 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 4 0 501055669 50388992 382 33554432000 4194304 4623224 140735551145264 18446744073709551615 255106825201 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 4 0 501055669 50388992 382 33554432000 4194304 4623224 140735551145264 18446744073709551615 47386876098482 0 0 4096 2 0 0 0 -1 5 0 0 0

[startup+0.109705 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=182640 CPUtime=0.41 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2007 0 0 0 41 0 0 0 19 0 4 0 501055668 187023360 1575 33554432000 4194304 4623224 140735551145264 18446744073709551615 4508170 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 45660 1575 342 105 0 41164 0
[pid=12516/tid=12517] ppid=12512 vsize=182640 CPUtime=0.1 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 371 0 0 0 10 0 0 0 20 0 4 0 501055669 187023360 1575 33554432000 4194304 4623224 140735551145264 18446744073709551615 4463919 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=182640 CPUtime=0.1 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 372 0 0 0 10 0 0 0 20 0 4 0 501055669 187023360 1575 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=182640 CPUtime=0.1 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 518 0 0 0 10 0 0 0 20 0 4 0 501055669 187023360 1575 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550392 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 182640

[startup+0.209688 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=183892 CPUtime=0.81 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2957 0 0 0 81 0 0 0 19 0 4 0 501055668 188305408 2199 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510226 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 45973 2199 342 105 0 41477 0
[pid=12516/tid=12517] ppid=12512 vsize=183892 CPUtime=0.2 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 568 0 0 0 20 0 0 0 20 0 4 0 501055669 188305408 2199 33554432000 4194304 4623224 140735551145264 18446744073709551615 4366369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=183892 CPUtime=0.2 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 569 0 0 0 20 0 0 0 20 0 4 0 501055669 188305408 2199 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=183892 CPUtime=0.2 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 883 0 0 0 20 0 0 0 20 0 4 0 501055669 188305408 2199 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550473 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.81
Current children cumulated vsize (KiB) 183892

[startup+0.300673 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=185120 CPUtime=1.17 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 3706 0 0 0 117 0 0 0 19 0 4 0 501055668 189562880 2745 33554432000 4194304 4623224 140735551145264 18446744073709551615 4517574 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 46280 2745 343 105 0 41784 0
[pid=12516/tid=12517] ppid=12512 vsize=185120 CPUtime=0.29 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 603 0 0 0 29 0 0 0 20 0 4 0 501055669 189562880 2745 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=185120 CPUtime=0.29 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 834 0 0 0 29 0 0 0 20 0 4 0 501055669 189562880 2745 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=185120 CPUtime=0.29 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1165 0 0 0 29 0 0 0 20 0 4 0 501055669 189562880 2745 33554432000 4194304 4623224 140735551145264 18446744073709551615 4549306 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 185120

[startup+0.700636 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=187792 CPUtime=2.78 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 7556 0 0 0 277 1 0 0 19 0 4 0 501055668 192299008 4409 33554432000 4194304 4623224 140735551145264 18446744073709551615 4384653 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 46948 4409 343 105 0 42452 0
[pid=12516/tid=12517] ppid=12512 vsize=187792 CPUtime=0.69 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1240 0 0 0 69 0 0 0 21 0 4 0 501055669 192299008 4409 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=187792 CPUtime=0.69 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1858 0 0 0 69 0 0 0 21 0 4 0 501055669 192299008 4409 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=187792 CPUtime=0.69 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2984 0 0 0 69 0 0 0 21 0 4 0 501055669 192299008 4409 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 187792

[startup+1.50046 s]
/proc/loadavg: 3.72 5.33 6.81 10/184 12524
/proc/meminfo: memFree=24208860/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=195128 CPUtime=5.96 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 12045 0 0 0 595 1 0 0 21 0 4 0 501055668 199811072 7238 33554432000 4194304 4623224 140735551145264 18446744073709551615 4423088 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 48782 7238 343 105 0 44286 0
[pid=12516/tid=12517] ppid=12512 vsize=195128 CPUtime=1.48 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2118 0 0 0 148 0 0 0 23 0 4 0 501055669 199811072 7238 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=195128 CPUtime=1.48 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2817 0 0 0 148 0 0 0 23 0 4 0 501055669 199811072 7238 33554432000 4194304 4623224 140735551145264 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=195128 CPUtime=1.49 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 5141 0 0 0 149 0 0 0 23 0 4 0 501055669 199811072 7238 33554432000 4194304 4623224 140735551145264 18446744073709551615 4546867 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 195128

[startup+3.10118 s]
/proc/loadavg: 3.72 5.33 6.81 10/184 12524
/proc/meminfo: memFree=24184680/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=206092 CPUtime=12.36 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 20494 0 0 0 1234 2 0 0 25 0 4 0 501055668 211038208 10709 33554432000 4194304 4623224 140735551145264 18446744073709551615 4512237 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 51523 10709 350 105 0 47027 0
[pid=12516/tid=12517] ppid=12512 vsize=206092 CPUtime=3.07 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 4409 0 0 0 307 0 0 0 25 0 4 0 501055669 211038208 10709 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=206092 CPUtime=3.08 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 4253 0 0 0 308 0 0 0 25 0 4 0 501055669 211038208 10709 33554432000 4194304 4623224 140735551145264 18446744073709551615 4462984 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=206092 CPUtime=3.08 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 9154 0 0 0 308 0 0 0 25 0 4 0 501055669 211038208 10709 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 206092

[startup+6.30062 s]
/proc/loadavg: 4.06 5.37 6.81 10/184 12524
/proc/meminfo: memFree=24136296/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=212628 CPUtime=25.14 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 34168 0 0 0 2509 5 0 0 25 0 4 0 501055668 217731072 16299 33554432000 4194304 4623224 140735551145264 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 53157 16299 396 105 0 48661 0
[pid=12516/tid=12517] ppid=12512 vsize=212628 CPUtime=6.26 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 5308 0 0 0 625 1 0 0 25 0 4 0 501055669 217731072 16299 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=212628 CPUtime=6.29 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 6750 0 0 0 628 1 0 0 25 0 4 0 501055669 217731072 16299 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=212628 CPUtime=6.29 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 18112 0 0 0 627 2 0 0 25 0 4 0 501055669 217731072 16299 33554432000 4194304 4623224 140735551145264 18446744073709551615 4545845 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 212628

[startup+12.7005 s]
/proc/loadavg: 4.37 5.42 6.82 10/184 12524
/proc/meminfo: memFree=24073100/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=224404 CPUtime=50.7 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 60154 0 0 0 5060 10 0 0 25 0 4 0 501055668 229789696 22707 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 56101 22707 421 105 0 51605 0
[pid=12516/tid=12517] ppid=12512 vsize=224404 CPUtime=12.62 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 7743 0 0 0 1261 1 0 0 25 0 4 0 501055669 229789696 22707 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=224404 CPUtime=12.68 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 9723 0 0 0 1267 1 0 0 25 0 4 0 501055669 229789696 22707 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=224404 CPUtime=12.69 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 35670 0 0 0 1264 5 0 0 25 0 4 0 501055669 229789696 22707 33554432000 4194304 4623224 140735551145264 18446744073709551615 255106429985 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 224404

[startup+25.5012 s]
/proc/loadavg: 5.18 5.54 6.84 10/184 12524
/proc/meminfo: memFree=23980584/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=254192 CPUtime=101.84 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 88931 0 0 0 10169 15 0 0 25 0 4 0 501055668 260292608 34206 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 63548 34206 519 105 0 59052 0
[pid=12516/tid=12517] ppid=12512 vsize=254192 CPUtime=25.34 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 12235 0 0 0 2532 2 0 0 25 0 4 0 501055669 260292608 34206 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=254192 CPUtime=25.48 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 15202 0 0 0 2546 2 0 0 25 0 4 0 501055669 260292608 34206 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377031 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=254192 CPUtime=25.49 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 50889 0 0 0 2541 8 0 0 25 0 4 0 501055669 260292608 34206 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550407 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 254192

[startup+51.1007 s]
/proc/loadavg: 6.14 5.74 6.87 10/184 12525
/proc/meminfo: memFree=23849120/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=302288 CPUtime=204.1 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 144101 0 0 0 20386 24 0 0 25 0 4 0 501055668 309542912 48865 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 75572 48865 637 105 0 71076 0
[pid=12516/tid=12517] ppid=12512 vsize=302288 CPUtime=50.81 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 17592 0 0 0 5077 4 0 0 25 0 4 0 501055669 309542912 48865 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=302288 CPUtime=51.08 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 21547 0 0 0 5105 3 0 0 25 0 4 0 501055669 309542912 48865 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=302288 CPUtime=51.08 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 86721 0 0 0 5095 13 0 0 25 0 4 0 501055669 309542912 48865 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 302288

[startup+102.301 s]
/proc/loadavg: 7.19 6.09 6.92 10/184 12526
/proc/meminfo: memFree=23683944/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=429860 CPUtime=408.65 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 311128 0 0 0 40812 53 0 0 25 0 4 0 501055668 440176640 70595 33554432000 4194304 4623224 140735551145264 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 107465 70595 850 105 0 102969 0
[pid=12516/tid=12517] ppid=12512 vsize=429860 CPUtime=101.74 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 38119 0 0 0 10167 7 0 0 25 0 4 0 501055669 440176640 70595 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377707 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=429860 CPUtime=102.29 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 33480 0 0 0 10224 5 0 0 25 0 4 0 501055669 440176640 70595 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=429860 CPUtime=102.3 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 212650 0 0 0 10195 35 0 0 25 0 4 0 501055669 440176640 70595 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.65
Current children cumulated vsize (KiB) 429860

[startup+162.301 s]

################
# More data... #
################

[pid=12516] ppid=12512 vsize=1000112 CPUtime=2565.73 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 1324160 0 0 0 256345 228 0 0 25 0 4 0 501055668 1024114688 187704 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 250028 187707 419 105 0 245532 0
[pid=12516/tid=12517] ppid=12512 vsize=1000112 CPUtime=638.8 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 121049 0 0 0 63858 22 0 0 25 0 4 0 501055669 1024114688 187707 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1000112 CPUtime=642.3 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 105669 0 0 0 64211 19 0 0 25 0 4 0 501055669 1024114688 187707 33554432000 4194304 4623224 140735551145264 18446744073709551615 4366381 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1000112 CPUtime=642.3 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 939303 0 0 0 64070 160 0 0 25 0 4 0 501055669 1024114688 187707 33554432000 4194304 4623224 140735551145264 18446744073709551615 4577678 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2565.73
Current children cumulated vsize (KiB) 1000112

[startup+702.301 s]
/proc/loadavg: 8.10 7.82 7.46 10/184 12544
/proc/meminfo: memFree=22616400/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1005292 CPUtime=2805.41 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 1559351 0 0 0 280272 269 0 0 25 0 4 0 501055668 1029419008 194177 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 251323 194177 377 105 0 246827 0
[pid=12516/tid=12517] ppid=12512 vsize=1005292 CPUtime=698.48 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 121403 0 0 0 69825 23 0 0 25 0 4 0 501055669 1029419008 194177 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1005292 CPUtime=702.29 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 106060 0 0 0 70210 19 0 0 25 0 4 0 501055669 1029419008 194177 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1005292 CPUtime=702.3 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1131707 0 0 0 70038 192 0 0 25 0 4 0 501055669 1029419008 194177 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2805.41
Current children cumulated vsize (KiB) 1005292

[startup+762.301 s]
/proc/loadavg: 8.25 7.92 7.52 10/184 12547
/proc/meminfo: memFree=22557680/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1036664 CPUtime=3045.11 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 1813614 0 0 0 304199 312 0 0 25 0 4 0 501055668 1061543936 201221 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 259166 201221 367 105 0 254670 0
[pid=12516/tid=12517] ppid=12512 vsize=1036664 CPUtime=758.15 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 122309 0 0 0 75792 23 0 0 25 0 4 0 501055669 1061543936 201221 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1036664 CPUtime=762.31 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 107004 0 0 0 76211 20 0 0 25 0 4 0 501055669 1061543936 201221 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1036664 CPUtime=762.31 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1358759 0 0 0 76001 230 0 0 25 0 4 0 501055669 1061543936 201221 33554432000 4194304 4623224 140735551145264 18446744073709551615 255106465977 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3045.11
Current children cumulated vsize (KiB) 1036664

[startup+822.301 s]
/proc/loadavg: 8.18 7.96 7.56 9/184 12548
/proc/meminfo: memFree=22524556/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1135880 CPUtime=3284.76 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2024451 0 0 0 328128 348 0 0 25 0 4 0 501055668 1163141120 213622 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 283970 213622 386 105 0 279474 0
[pid=12516/tid=12517] ppid=12512 vsize=1135880 CPUtime=817.82 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 126366 0 0 0 81758 24 0 0 25 0 4 0 501055669 1163141120 213622 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1135880 CPUtime=822.3 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 108133 0 0 0 82210 20 0 0 25 0 4 0 501055669 1163141120 213622 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1135880 CPUtime=822.3 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1507364 0 0 0 81976 254 0 0 25 0 4 0 501055669 1163141120 213622 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.76
Current children cumulated vsize (KiB) 1135880

[startup+882.307 s]
/proc/loadavg: 8.15 8.00 7.59 10/184 12550
/proc/meminfo: memFree=22389380/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1225968 CPUtime=3524.46 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2250915 0 0 0 352059 387 0 0 25 0 4 0 501055668 1255391232 231690 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 306492 231690 460 105 0 301996 0
[pid=12516/tid=12517] ppid=12512 vsize=1225968 CPUtime=877.5 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 132728 0 0 0 87725 25 0 0 25 0 4 0 501055669 1255391232 231690 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1225968 CPUtime=882.31 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 108514 0 0 0 88210 21 0 0 25 0 4 0 501055669 1255391232 231690 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1225968 CPUtime=882.31 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1701298 0 0 0 87945 286 0 0 25 0 4 0 501055669 1255391232 231690 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.46
Current children cumulated vsize (KiB) 1225968

[startup+942.301 s]
/proc/loadavg: 8.18 8.03 7.63 10/184 12552
/proc/meminfo: memFree=22360100/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1225968 CPUtime=3764.12 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2381595 0 0 0 376003 409 0 0 25 0 4 0 501055668 1255391232 234297 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 306492 234297 405 105 0 301996 0
[pid=12516/tid=12517] ppid=12512 vsize=1225968 CPUtime=937.17 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 133057 0 0 0 93692 25 0 0 25 0 4 0 501055669 1255391232 234297 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1225968 CPUtime=942.3 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 109242 0 0 0 94209 21 0 0 25 0 4 0 501055669 1255391232 234297 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1225968 CPUtime=942.31 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1826748 0 0 0 93924 307 0 0 25 0 4 0 501055669 1255391232 234297 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 1225968

[startup+1002.3 s]
/proc/loadavg: 8.06 8.02 7.65 10/184 12553
/proc/meminfo: memFree=22283324/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1273972 CPUtime=4003.79 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2574437 0 0 0 399938 441 0 0 25 0 4 0 501055668 1304547328 247160 33554432000 4194304 4623224 140735551145264 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 318493 247160 453 105 0 313997 0
[pid=12516/tid=12517] ppid=12512 vsize=1273972 CPUtime=996.84 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 133690 0 0 0 99658 26 0 0 25 0 4 0 501055669 1304547328 247160 33554432000 4194304 4623224 140735551145264 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1273972 CPUtime=1002.31 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 118180 0 0 0 100208 23 0 0 25 0 4 0 501055669 1304547328 247160 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1273972 CPUtime=1002.3 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 1974984 0 0 0 99900 330 0 0 25 0 4 0 501055669 1304547328 247160 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.79
Current children cumulated vsize (KiB) 1273972

[startup+1062.3 s]
/proc/loadavg: 8.07 8.03 7.67 10/184 12555
/proc/meminfo: memFree=22229120/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1273972 CPUtime=4243.48 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2736591 0 0 0 423875 473 0 0 25 0 4 0 501055668 1304547328 250912 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 318493 250912 434 105 0 313997 0
[pid=12516/tid=12517] ppid=12512 vsize=1273972 CPUtime=1056.52 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 133982 0 0 0 105626 26 0 0 25 0 4 0 501055669 1304547328 250912 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376855 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1273972 CPUtime=1062.31 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 119158 0 0 0 106208 23 0 0 25 0 4 0 501055669 1304547328 250912 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1273972 CPUtime=1062.31 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2135008 0 0 0 105870 361 0 0 25 0 4 0 501055669 1304547328 250912 33554432000 4194304 4623224 140735551145264 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.48
Current children cumulated vsize (KiB) 1273972

[startup+1122.3 s]
/proc/loadavg: 8.07 8.04 7.69 10/184 12556
/proc/meminfo: memFree=22195244/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1273972 CPUtime=4483.15 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 2943931 0 0 0 447809 506 0 0 25 0 4 0 501055668 1304547328 253959 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 318493 253959 430 105 0 313997 0
[pid=12516/tid=12517] ppid=12512 vsize=1273972 CPUtime=1116.19 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 134297 0 0 0 111592 27 0 0 25 0 4 0 501055669 1304547328 253959 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1273972 CPUtime=1122.31 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 119712 0 0 0 112208 23 0 0 25 0 4 0 501055669 1304547328 253959 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376714 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1273972 CPUtime=1122.31 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2338825 0 0 0 111838 393 0 0 25 0 4 0 501055669 1304547328 253959 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4483.15
Current children cumulated vsize (KiB) 1273972

[startup+1182.3 s]
/proc/loadavg: 8.02 8.03 7.71 10/184 12558
/proc/meminfo: memFree=22132112/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1273972 CPUtime=4722.83 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 3190302 0 0 0 471735 548 0 0 25 0 4 0 501055668 1304547328 258094 33554432000 4194304 4623224 140735551145264 18446744073709551615 4511014 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 318493 258094 412 105 0 313997 0
[pid=12516/tid=12517] ppid=12512 vsize=1273972 CPUtime=1175.87 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 134829 0 0 0 117560 27 0 0 25 0 4 0 501055669 1304547328 258094 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1273972 CPUtime=1182.31 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 120241 0 0 0 118208 23 0 0 25 0 4 0 501055669 1304547328 258094 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1273972 CPUtime=1182.31 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2510966 0 0 0 117811 420 0 0 25 0 4 0 501055669 1304547328 258094 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.83
Current children cumulated vsize (KiB) 1273972



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.02 8.02 7.72 9/184 12559
/proc/meminfo: memFree=22120452/32951124 swapFree=67111524/67111528
[pid=12516] ppid=12512 vsize=1273972 CPUtime=4800.34 cores=1,3,5,7
/proc/12516/stat : 12516 (SArTagnan) R 12512 12516 12135 0 -1 4202496 3262125 0 0 0 479474 560 0 0 25 0 4 0 501055668 1304547328 258451 33554432000 4194304 4623224 140735551145264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12516/statm: 318493 258451 355 105 0 313997 0
[pid=12516/tid=12517] ppid=12512 vsize=1273972 CPUtime=1195.16 cores=1,3,5,7
/proc/12516/task/12517/stat : 12517 (SArTagnan) R 12512 12516 12135 0 -1 4202560 135305 0 0 0 119489 27 0 0 25 0 4 0 501055669 1304547328 258451 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=12516/tid=12518] ppid=12512 vsize=1273972 CPUtime=1201.71 cores=1,3,5,7
/proc/12516/task/12518/stat : 12518 (SArTagnan) R 12512 12516 12135 0 -1 4202560 120846 0 0 0 120148 23 0 0 25 0 4 0 501055669 1304547328 258451 33554432000 4194304 4623224 140735551145264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=12516/tid=12519] ppid=12512 vsize=1273972 CPUtime=1201.72 cores=1,3,5,7
/proc/12516/task/12519/stat : 12519 (SArTagnan) R 12512 12516 12135 0 -1 4202560 2581675 0 0 0 119740 432 0 0 25 0 4 0 501055669 1304547328 258451 33554432000 4194304 4623224 140735551145264 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 1273972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.76
CPU time (s): 4800.42
CPU user time (s): 4794.77
CPU system time (s): 5.65414
CPU usage (%): 399.449
Max. virtual memory (cumulated for all children) (KiB): 1339508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.77
system time used= 5.65414
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3262125
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 195
involuntary context switches= 22204

runsolver used 1.70274 second user time and 4.86226 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-29 16:13:15
IDJOB=3273970
IDBENCH=83150
IDSOLVER=1656
FILE ID=node144/3273970-1304086395
RUNJOBID= node144-1304086395-12498
PBS_JOBID= 13170542
Free space on /tmp= 72412 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n140-s20078956-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273970-1304086395/watcher-3273970-1304086395 -o /tmp/evaluation-result-3273970-1304086395/solver-3273970-1304086395 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3273970-1304086395.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d05c170d9e6ebfc370bd1d7f7c63d86
RANDOM SEED=150406654

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24252020 kB
Buffers:       2122040 kB
Cached:        5964472 kB
SwapCached:          4 kB
Active:         159340 kB
Inactive:      7990612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24252020 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             796 kB
Writeback:           0 kB
AnonPages:       62368 kB
Mapped:          14480 kB
Slab:           486004 kB
PageTables:       4732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   183492 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72408 MiB
End job on node144 at 2011-04-29 16:33:19