Trace number 3386387

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.28 1205.2

General information on the benchmark

NameAPPLICATIONS/bitverif/
smulo/smulo064.cnf
MD5SUM472e9d10d7fd1a82d06da0809d0002df
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables47129
Number of clauses141002
Sum of the clauses size329002
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 294000
Number of clauses of size 347000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386387-1305577230/watcher-3386387-1305577230 -o /tmp/evaluation-result-3386387-1305577230/solver-3386387-1305577230 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386387-1305577230.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.38 2.60 1.57 6/502 23047
/proc/meminfo: memFree=23222232/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=27672 CPUtime=0.01 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 2035 0 0 0 1 0 0 0 25 0 1 0 669323921 28336128 1711 33554432000 4194304 4625164 140735922614384 18446744073709551615 270613110528 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/23047/statm: 6918 1711 296 106 0 2421 0

[startup+0.0484839 s]
/proc/loadavg: 6.38 2.60 1.57 6/502 23047
/proc/meminfo: memFree=23222232/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=32288 CPUtime=0.04 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 4187 0 0 0 4 0 0 0 25 0 1 0 669323921 33062912 2772 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/23047/statm: 8072 2772 296 106 0 3575 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 32288

[startup+0.175422 s]
/proc/loadavg: 6.38 2.60 1.57 6/502 23047
/proc/meminfo: memFree=23222232/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=284620 CPUtime=0.48 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 12003 0 0 0 47 1 0 0 25 0 4 0 669323921 291450880 9652 33554432000 4194304 4625164 140735922614384 18446744073709551615 4392570 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 71155 9652 341 106 0 66658 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 284620

[startup+0.300402 s]
/proc/loadavg: 6.38 2.60 1.57 6/502 23047
/proc/meminfo: memFree=23222232/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=285444 CPUtime=0.97 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 12595 0 0 0 96 1 0 0 25 0 4 0 669323921 292294656 9829 33554432000 4194304 4625164 140735922614384 18446744073709551615 270612777986 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 71361 9829 342 106 0 66864 0
Current children cumulated CPU time (s) 0.97
Current children cumulated vsize (KiB) 285444

[startup+0.700327 s]
/proc/loadavg: 6.38 2.60 1.57 6/502 23047
/proc/meminfo: memFree=23222232/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=351092 CPUtime=2.57 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 57538 0 0 0 248 9 0 0 25 0 4 0 669323921 359518208 30473 33554432000 4194304 4625164 140735922614384 18446744073709551615 4306536 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 87773 30478 343 106 0 83276 0
Current children cumulated CPU time (s) 2.57
Current children cumulated vsize (KiB) 351092

[startup+1.50019 s]
/proc/loadavg: 6.59 2.71 1.61 10/506 23051
/proc/meminfo: memFree=23017488/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=408884 CPUtime=5.72 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 111955 0 0 0 556 16 0 0 18 0 4 0 669323921 418697216 51067 33554432000 4194304 4625164 140735922614384 18446744073709551615 4510176 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 102221 51067 345 106 0 97724 0
[pid=23047/tid=23049] ppid=23045 vsize=408884 CPUtime=1.41 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 18425 0 0 0 139 2 0 0 18 0 4 0 669323927 418697216 51067 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=408884 CPUtime=1.41 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 17877 0 0 0 138 3 0 0 18 0 4 0 669323928 418697216 51067 33554432000 4194304 4625164 140735922614384 18446744073709551615 4464263 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=408884 CPUtime=1.4 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 25073 0 0 0 137 3 0 0 25 0 4 0 669323928 418697216 51067 33554432000 4194304 4625164 140735922614384 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.72
Current children cumulated vsize (KiB) 408884

[startup+3.10091 s]
/proc/loadavg: 6.59 2.71 1.61 10/506 23051
/proc/meminfo: memFree=23010668/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=408884 CPUtime=12.11 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 130694 0 0 0 1193 18 0 0 21 0 4 0 669323921 418697216 51749 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511953 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 102221 51749 345 106 0 97724 0
[pid=23047/tid=23049] ppid=23045 vsize=408884 CPUtime=3.01 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 18463 0 0 0 299 2 0 0 21 0 4 0 669323927 418697216 51749 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=408884 CPUtime=3.01 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 17947 0 0 0 298 3 0 0 22 0 4 0 669323928 418697216 51749 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=408884 CPUtime=2.98 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 42640 0 0 0 293 5 0 0 25 0 4 0 669323928 418697216 51749 33554432000 4194304 4625164 140735922614384 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.11
Current children cumulated vsize (KiB) 408884

[startup+6.30034 s]
/proc/loadavg: 6.78 2.81 1.65 10/506 23051
/proc/meminfo: memFree=23000260/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=417232 CPUtime=24.85 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 168246 0 0 0 2461 24 0 0 25 0 4 0 669323921 427245568 54637 33554432000 4194304 4625164 140735922614384 18446744073709551615 4519673 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 104308 54637 345 106 0 99811 0
[pid=23047/tid=23049] ppid=23045 vsize=417232 CPUtime=6.21 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 18514 0 0 0 619 2 0 0 25 0 4 0 669323927 427245568 54637 33554432000 4194304 4625164 140735922614384 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=417232 CPUtime=6.21 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 17968 0 0 0 618 3 0 0 25 0 4 0 669323928 427245568 54637 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=417232 CPUtime=6.13 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 73432 0 0 0 603 10 0 0 25 0 4 0 669323928 427245568 54637 33554432000 4194304 4625164 140735922614384 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.85
Current children cumulated vsize (KiB) 417232

[startup+12.7002 s]
/proc/loadavg: 6.96 2.91 1.69 10/506 23051
/proc/meminfo: memFree=22955932/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=439140 CPUtime=50.34 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 225242 0 0 0 5000 34 0 0 25 0 4 0 669323921 449679360 59767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 109785 59767 345 106 0 105288 0
[pid=23047/tid=23049] ppid=23045 vsize=439140 CPUtime=12.61 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 18734 0 0 0 1259 2 0 0 25 0 4 0 669323927 449679360 59767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=439140 CPUtime=12.61 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 18027 0 0 0 1258 3 0 0 25 0 4 0 669323928 449679360 59767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=439140 CPUtime=12.41 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 115009 0 0 0 1225 16 0 0 25 0 4 0 669323928 449679360 59767 33554432000 4194304 4625164 140735922614384 18446744073709551615 270612759640 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.34
Current children cumulated vsize (KiB) 439140

[startup+25.5009 s]
/proc/loadavg: 7.27 3.11 1.77 10/506 23052
/proc/meminfo: memFree=22932228/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=452000 CPUtime=101.31 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 314731 0 0 0 10086 45 0 0 25 0 4 0 669323921 462848000 65656 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 113000 65656 347 106 0 108503 0
[pid=23047/tid=23049] ppid=23045 vsize=452000 CPUtime=25.41 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 23787 0 0 0 2539 2 0 0 25 0 4 0 669323927 462848000 65656 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=452000 CPUtime=25.41 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 18541 0 0 0 2538 3 0 0 25 0 4 0 669323928 462848000 65656 33554432000 4194304 4625164 140735922614384 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=452000 CPUtime=24.98 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 198323 0 0 0 2472 26 0 0 25 0 4 0 669323928 462848000 65656 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.31
Current children cumulated vsize (KiB) 452000

[startup+51.1004 s]
/proc/loadavg: 8.00 3.69 2.00 10/506 23052
/proc/meminfo: memFree=22847496/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=464952 CPUtime=203.3 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 489953 0 0 0 20257 73 0 0 25 0 4 0 669323921 476110848 76139 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 116238 76139 347 106 0 111741 0
[pid=23047/tid=23049] ppid=23045 vsize=464952 CPUtime=51.01 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 26794 0 0 0 5094 7 0 0 25 0 4 0 669323927 476110848 76139 33554432000 4194304 4625164 140735922614384 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=464952 CPUtime=51.02 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 24574 0 0 0 5098 4 0 0 25 0 4 0 669323928 476110848 76139 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=464952 CPUtime=50.17 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 363911 0 0 0 4968 49 0 0 25 0 4 0 669323928 476110848 76139 33554432000 4194304 4625164 140735922614384 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.3
Current children cumulated vsize (KiB) 464952

[startup+102.319 s]
/proc/loadavg: 8.68 4.54 2.38 10/506 23054
/proc/meminfo: memFree=22698304/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=536216 CPUtime=407.31 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 769600 0 0 0 40614 117 0 0 25 0 4 0 669323921 549085184 93829 33554432000 4194304 4625164 140735922614384 18446744073709551615 4508979 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 134054 93829 347 106 0 129557 0
[pid=23047/tid=23049] ppid=23045 vsize=536216 CPUtime=102.23 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 37957 0 0 0 10212 11 0 0 25 0 4 0 669323927 549085184 93829 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=536216 CPUtime=102.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 27628 0 0 0 10218 5 0 0 25 0 4 0 669323928 549085184 93829 33554432000 4194304 4625164 140735922614384 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=536216 CPUtime=100.53 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 627807 0 0 0 9966 87 0 0 25 0 4 0 669323928 549085184 93829 33554432000 4194304 4625164 140735922614384 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.31
Current children cumulated vsize (KiB) 536216

[startup+162.301 s]
/proc/loadavg: 8.93 5.36 2.79 10/506 23055
/proc/meminfo: memFree=22503096/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=697568 CPUtime=646.24 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 1222486 0 0 0 64436 188 0 0 25 0 4 0 669323921 714309632 119712 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 174392 119712 347 106 0 169895 0
[pid=23047/tid=23049] ppid=23045 vsize=697568 CPUtime=162.21 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 48084 0 0 0 16201 20 0 0 25 0 4 0 669323927 714309632 119712 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=697568 CPUtime=162.21 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 36551 0 0 0 16215 6 0 0 25 0 4 0 669323928 714309632 119712 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=697568 CPUtime=159.51 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 1052568 0 0 0 15805 146 0 0 25 0 4 0 669323928 714309632 119712 33554432000 4194304 4625164 140735922614384 18446744073709551615 270612807858 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.24
Current children cumulated vsize (KiB) 697568

[startup+222.301 s]
/proc/loadavg: 9.18 6.08 3.20 10/506 23057
/proc/meminfo: memFree=22341484/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=778760 CPUtime=885.24 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 1678071 0 0 0 88259 265 0 0 25 0 4 0 669323921 797450240 143826 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 194690 143826 347 106 0 190193 0
[pid=23047/tid=23049] ppid=23045 vsize=778760 CPUtime=222.2 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 70998 0 0 0 22191 29 0 0 25 0 4 0 669323927 797450240 143826 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=778760 CPUtime=222.22 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 39006 0 0 0 22214 8 0 0 25 0 4 0 669323928 797450240 143826 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=778760 CPUtime=218.51 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 1481492 0 0 0 21640 211 0 0 25 0 4 0 669323928 797450240 143826 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339111 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 885.24
Current children cumulated vsize (KiB) 778760

[startup+282.301 s]

################
# More data... #
################

[pid=23047] ppid=23045 vsize=1410360 CPUtime=2797.27 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 3859810 0 0 0 279116 611 0 0 25 0 4 0 669323921 1444208640 283999 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 352590 283999 347 106 0 348093 0
[pid=23047/tid=23049] ppid=23045 vsize=1410360 CPUtime=694.74 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 160271 0 0 0 69396 78 0 0 25 0 4 0 669323927 1444208640 283999 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1410360 CPUtime=702.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 58117 0 0 0 70208 15 0 0 25 0 4 0 669323928 1444208640 283999 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1410360 CPUtime=698 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 3508073 0 0 0 69306 494 0 0 25 0 4 0 669323928 1444208640 283999 33554432000 4194304 4625164 140735922614384 18446744073709551615 4335146 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2797.27
Current children cumulated vsize (KiB) 1410360

[startup+762.32 s]
/proc/loadavg: 9.19 8.66 5.82 10/506 23131
/proc/meminfo: memFree=22921036/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1522900 CPUtime=3036.33 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 3984340 0 0 0 303000 633 0 0 25 0 4 0 669323921 1559449600 297936 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 380725 297936 347 106 0 376228 0
[pid=23047/tid=23049] ppid=23045 vsize=1522900 CPUtime=753.76 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 168361 0 0 0 75296 80 0 0 25 0 4 0 669323927 1559449600 297936 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1522900 CPUtime=762.24 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 60848 0 0 0 76208 16 0 0 25 0 4 0 669323928 1559449600 297936 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1522900 CPUtime=758.02 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 3621705 0 0 0 75289 513 0 0 25 0 4 0 669323928 1559449600 297936 33554432000 4194304 4625164 140735922614384 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3036.33
Current children cumulated vsize (KiB) 1522900

[startup+822.301 s]
/proc/loadavg: 9.07 8.72 6.01 10/506 23133
/proc/meminfo: memFree=22762860/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1546264 CPUtime=3275.28 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 4371836 0 0 0 326837 691 0 0 25 0 4 0 669323921 1583374336 313767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 386566 313767 347 106 0 382069 0
[pid=23047/tid=23049] ppid=23045 vsize=1546264 CPUtime=812.76 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 175487 0 0 0 81193 83 0 0 25 0 4 0 669323927 1583374336 313767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1546264 CPUtime=822.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 61122 0 0 0 82206 17 0 0 25 0 4 0 669323928 1583374336 313767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1546264 CPUtime=818.01 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 4001422 0 0 0 81233 568 0 0 25 0 4 0 669323928 1583374336 313767 33554432000 4194304 4625164 140735922614384 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3275.28
Current children cumulated vsize (KiB) 1546264

[startup+882.3 s]
/proc/loadavg: 9.02 8.77 6.20 11/506 23135
/proc/meminfo: memFree=22639672/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1629848 CPUtime=3514.27 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 4797246 0 0 0 350674 753 0 0 25 0 4 0 669323921 1668964352 331309 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 407462 331309 348 106 0 402965 0
[pid=23047/tid=23049] ppid=23045 vsize=1629848 CPUtime=871.75 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 181025 0 0 0 87089 86 0 0 25 0 4 0 669323927 1668964352 331309 33554432000 4194304 4625164 140735922614384 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1629848 CPUtime=882.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 61714 0 0 0 88206 17 0 0 25 0 4 0 669323928 1668964352 331309 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1629848 CPUtime=878 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 4419786 0 0 0 87174 626 0 0 25 0 4 0 669323928 1668964352 331309 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3514.27
Current children cumulated vsize (KiB) 1629848

[startup+942.301 s]
/proc/loadavg: 9.06 8.82 6.37 11/506 23136
/proc/meminfo: memFree=22524444/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1640804 CPUtime=3753.28 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 5224160 0 0 0 374510 818 0 0 25 0 4 0 669323921 1680183296 347683 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 410201 347683 349 106 0 405704 0
[pid=23047/tid=23049] ppid=23045 vsize=1640804 CPUtime=930.77 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 185964 0 0 0 92989 88 0 0 25 0 4 0 669323927 1680183296 347683 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1640804 CPUtime=942.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 63147 0 0 0 94205 18 0 0 25 0 4 0 669323928 1680183296 347683 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1640804 CPUtime=938.01 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 4839395 0 0 0 93113 688 0 0 25 0 4 0 669323928 1680183296 347683 33554432000 4194304 4625164 140735922614384 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3753.28
Current children cumulated vsize (KiB) 1640804

[startup+1002.3 s]
/proc/loadavg: 9.07 8.87 6.54 11/506 23138
/proc/meminfo: memFree=22405868/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1800008 CPUtime=3992.29 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 5678233 0 0 0 398342 887 0 0 25 0 4 0 669323921 1843208192 371346 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 450002 371346 347 106 0 445505 0
[pid=23047/tid=23049] ppid=23045 vsize=1800008 CPUtime=989.77 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 229090 0 0 0 98882 95 0 0 25 0 4 0 669323927 1843208192 371346 33554432000 4194304 4625164 140735922614384 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1800008 CPUtime=1002.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 65733 0 0 0 100202 21 0 0 25 0 4 0 669323928 1843208192 371346 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1800008 CPUtime=998.01 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 5246705 0 0 0 99054 747 0 0 25 0 4 0 669323928 1843208192 371346 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3992.29
Current children cumulated vsize (KiB) 1800008

[startup+1062.3 s]
/proc/loadavg: 9.12 8.92 6.70 11/506 23139
/proc/meminfo: memFree=22299324/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1810964 CPUtime=4231.29 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 6079012 0 0 0 422185 944 0 0 25 0 4 0 669323921 1854427136 384782 33554432000 4194304 4625164 140735922614384 18446744073709551615 4509011 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 452741 384782 347 106 0 448244 0
[pid=23047/tid=23049] ppid=23045 vsize=1810964 CPUtime=1048.76 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 233052 0 0 0 104779 97 0 0 25 0 4 0 669323927 1854427136 384782 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1810964 CPUtime=1062.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 65946 0 0 0 106202 21 0 0 25 0 4 0 669323928 1854427136 384782 33554432000 4194304 4625164 140735922614384 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1810964 CPUtime=1058.01 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 5642224 0 0 0 105000 801 0 0 25 0 4 0 669323928 1854427136 384782 33554432000 4194304 4625164 140735922614384 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4231.29
Current children cumulated vsize (KiB) 1810964

[startup+1122.3 s]
/proc/loadavg: 9.13 8.96 6.85 11/506 23141
/proc/meminfo: memFree=22202332/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1913700 CPUtime=4470.29 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 6278628 0 0 0 446054 975 0 0 25 0 4 0 669323921 1959628800 400993 33554432000 4194304 4625164 140735922614384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 478425 400993 347 106 0 473928 0
[pid=23047/tid=23049] ppid=23045 vsize=1913700 CPUtime=1107.76 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 237143 0 0 0 110677 99 0 0 25 0 4 0 669323927 1959628800 400993 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1913700 CPUtime=1122.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 66576 0 0 0 112202 21 0 0 25 0 4 0 669323928 1959628800 400993 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1913700 CPUtime=1118.02 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 5835876 0 0 0 110972 830 0 0 25 0 4 0 669323928 1959628800 400993 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4470.29
Current children cumulated vsize (KiB) 1913700

[startup+1182.3 s]
/proc/loadavg: 9.17 9.01 7.00 10/506 23143
/proc/meminfo: memFree=22090940/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1986224 CPUtime=4709.31 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 6634472 0 0 0 469903 1028 0 0 25 0 4 0 669323921 2033893376 420130 33554432000 4194304 4625164 140735922614384 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 496556 420130 348 106 0 492059 0
[pid=23047/tid=23049] ppid=23045 vsize=1986224 CPUtime=1166.78 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 242087 0 0 0 116573 105 0 0 25 0 4 0 669323927 2033893376 420130 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1986224 CPUtime=1182.23 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 66898 0 0 0 118202 21 0 0 25 0 4 0 669323928 2033893376 420130 33554432000 4194304 4625164 140735922614384 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1986224 CPUtime=1178.01 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 6185550 0 0 0 116925 876 0 0 25 0 4 0 669323928 2033893376 420130 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4709.31
Current children cumulated vsize (KiB) 1986224



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.1 s]
/proc/loadavg: 9.40 9.07 7.07 10/506 23143
/proc/meminfo: memFree=22062776/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1986224 CPUtime=4800.17 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 6813204 0 0 0 478962 1055 0 0 25 0 4 0 669323921 2033893376 425196 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 496556 425196 347 106 0 492059 0
[pid=23047/tid=23049] ppid=23045 vsize=1986224 CPUtime=1189.19 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 244264 0 0 0 118811 108 0 0 25 0 4 0 669323927 2033893376 425199 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1986224 CPUtime=1205.05 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 67113 0 0 0 120484 21 0 0 25 0 4 0 669323928 2033893376 425199 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1986224 CPUtime=1200.83 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 6361465 0 0 0 119183 900 0 0 25 0 4 0 669323928 2033893376 425201 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 1986224

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.1 s]
/proc/loadavg: 9.40 9.07 7.07 10/506 23143
/proc/meminfo: memFree=22062776/32951124 swapFree=60609076/67111528
[pid=23047] ppid=23045 vsize=1986224 CPUtime=4800.17 cores=0,2,4,6
/proc/23047/stat : 23047 (SArTagnan) R 23045 23047 22974 0 -1 4202496 6813204 0 0 0 478962 1055 0 0 25 0 4 0 669323921 2033893376 425196 33554432000 4194304 4625164 140735922614384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/23047/statm: 496556 425196 347 106 0 492059 0
[pid=23047/tid=23049] ppid=23045 vsize=1986224 CPUtime=1189.19 cores=0,2,4,6
/proc/23047/task/23049/stat : 23049 (SArTagnan) R 23045 23047 22974 0 -1 4202560 244264 0 0 0 118811 108 0 0 25 0 4 0 669323927 2033893376 425199 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=23047/tid=23050] ppid=23045 vsize=1986224 CPUtime=1205.05 cores=0,2,4,6
/proc/23047/task/23050/stat : 23050 (SArTagnan) R 23045 23047 22974 0 -1 4202560 67113 0 0 0 120484 21 0 0 25 0 4 0 669323928 2033893376 425199 33554432000 4194304 4625164 140735922614384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=23047/tid=23051] ppid=23045 vsize=1986224 CPUtime=1200.83 cores=0,2,4,6
/proc/23047/task/23051/stat : 23051 (SArTagnan) R 23045 23047 22974 0 -1 4202560 6361465 0 0 0 119183 900 0 0 25 0 4 0 669323928 2033893376 425201 33554432000 4194304 4625164 140735922614384 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 1986224

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.2
CPU time (s): 4800.28
CPU user time (s): 4789.65
CPU system time (s): 10.6274
CPU usage (%): 398.298
Max. virtual memory (cumulated for all children) (KiB): 2051760

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4789.65
system time used= 10.6274
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6813613
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3029
involuntary context switches= 33576

runsolver used 5.51916 second user time and 14.2368 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-16 22:20:30
IDJOB=3386387
IDBENCH=70791
IDSOLVER=1871
FILE ID=node108/3386387-1305577230
RUNJOBID= node108-1305577160-22992
PBS_JOBID= 13350217
Free space on /tmp= 73436 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/APPLICATIONS/bitverif/smulo/smulo064.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386387-1305577230/watcher-3386387-1305577230 -o /tmp/evaluation-result-3386387-1305577230/solver-3386387-1305577230 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386387-1305577230.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 472e9d10d7fd1a82d06da0809d0002df
RANDOM SEED=1693148894

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23222512 kB
Buffers:         66848 kB
Cached:         716956 kB
SwapCached:      25796 kB
Active:        2183396 kB
Inactive:      7326156 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23222512 kB
SwapTotal:    67111528 kB
SwapFree:     60609076 kB
Dirty:            2752 kB
Writeback:          28 kB
AnonPages:     8709328 kB
Mapped:          29236 kB
Slab:            81844 kB
PageTables:      67884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135974556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73448 MiB
End job on node108 at 2011-05-16 22:40:37