Trace number 3439331

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001.2 5011.66

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
MD5SUM9ffa0325c9e00b41c025f41d20ec5a0c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1745.74
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses49070
Sum of the clauses size98700
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 249050
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439331-1306960629/watcher-3439331-1306960629 -o /tmp/evaluation-result-3439331-1306960629/solver-3439331-1306960629 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439331-1306960629.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/462 28210
/proc/meminfo: memFree=24568344/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=21060 CPUtime=0.01 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 948 0 0 0 1 0 0 0 23 0 1 0 886293419 21565440 634 33554432000 4194304 4625164 140735379499040 18446744073709551615 252457763285 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/28210/statm: 5265 645 298 106 0 768 0
[pid=28210/tid=28211] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 47604365313968 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 0 0 0 0 0 0 0 0 24 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=96920 CPUtime=0 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886293421 99246080 1657 33554432000 4194304 4625164 140735379499040 18446744073709551615 252469863478 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.151786 s]
/proc/loadavg: 0.00 0.00 0.00 2/462 28210
/proc/meminfo: memFree=24568344/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=515404 CPUtime=8.09 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 30759 0 0 0 805 4 0 0 19 0 8 0 886293419 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 128851 21886 370 106 0 124354 0
[pid=28210/tid=28211] ppid=28208 vsize=515404 CPUtime=1 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2220 0 0 0 100 0 0 0 18 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4464333 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=515404 CPUtime=0.99 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2863 0 0 0 99 0 0 0 18 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=515404 CPUtime=1 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3143 0 0 0 100 0 0 0 19 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=515404 CPUtime=0.99 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2284 0 0 0 99 0 0 0 19 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=515404 CPUtime=1.01 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2561 0 0 0 101 0 0 0 19 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4434951 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=515404 CPUtime=1.01 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2619 0 0 0 101 0 0 0 19 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=515404 CPUtime=1.01 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 1637 0 0 0 101 0 0 0 19 0 8 0 886293421 527773696 21886 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8.09
Current children cumulated vsize (KiB) 515404

[startup+1.13665 s]
/proc/loadavg: 0.00 0.00 0.00 2/462 28210
/proc/meminfo: memFree=24568344/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=522152 CPUtime=8.89 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 36777 0 0 0 884 5 0 0 19 0 8 0 886293419 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4512054 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 130538 25055 410 106 0 126041 0
[pid=28210/tid=28211] ppid=28208 vsize=522152 CPUtime=1.1 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3046 0 0 0 110 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=522152 CPUtime=1.09 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2886 0 0 0 109 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4469375 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=522152 CPUtime=1.1 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3528 0 0 0 110 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 252457763001 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=522152 CPUtime=1.09 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3087 0 0 0 109 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4488023 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=522152 CPUtime=1.11 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2602 0 0 0 111 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=522152 CPUtime=1.11 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2664 0 0 0 111 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=522152 CPUtime=1.11 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 1673 0 0 0 111 0 0 0 19 0 8 0 886293421 534683648 25055 33554432000 4194304 4625164 140735379499040 18446744073709551615 4288805 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8.89
Current children cumulated vsize (KiB) 522152

[startup+1.23663 s]
/proc/loadavg: 0.00 0.00 0.00 2/462 28210
/proc/meminfo: memFree=24568344/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=522152 CPUtime=9.69 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 38060 0 0 0 964 5 0 0 19 0 8 0 886293419 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 130538 23781 398 106 0 126041 0
[pid=28210/tid=28211] ppid=28208 vsize=522152 CPUtime=1.2 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3091 0 0 0 120 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=522152 CPUtime=1.19 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2915 0 0 0 119 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 252457724297 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=522152 CPUtime=1.2 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3720 0 0 0 120 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4547277 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=522152 CPUtime=1.19 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3114 0 0 0 119 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=522152 CPUtime=1.21 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2667 0 0 0 121 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4348867 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=522152 CPUtime=1.21 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3455 0 0 0 121 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=522152 CPUtime=1.21 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 1697 0 0 0 121 0 0 0 19 0 8 0 886293421 534683648 23781 33554432000 4194304 4625164 140735379499040 18446744073709551615 4464266 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9.69
Current children cumulated vsize (KiB) 522152

[startup+1.33661 s]
/proc/loadavg: 0.00 0.00 0.00 2/462 28210
/proc/meminfo: memFree=24568344/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=522488 CPUtime=10.49 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 40272 0 0 0 1044 5 0 0 19 0 8 0 886293419 535027712 25734 33554432000 4194304 4625164 140735379499040 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 130622 25734 423 106 0 126125 0
[pid=28210/tid=28211] ppid=28208 vsize=522488 CPUtime=1.3 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3148 0 0 0 130 0 0 0 19 0 8 0 886293421 535027712 25734 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=522488 CPUtime=1.29 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2953 0 0 0 129 0 0 0 19 0 8 0 886293421 535027712 25738 33554432000 4194304 4625164 140735379499040 18446744073709551615 4464351 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=522488 CPUtime=1.3 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 4492 0 0 0 130 0 0 0 19 0 8 0 886293421 535027712 25738 33554432000 4194304 4625164 140735379499040 18446744073709551615 4579595 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=522488 CPUtime=1.29 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3180 0 0 0 129 0 0 0 19 0 8 0 886293421 535027712 25738 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=522488 CPUtime=1.3 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3594 0 0 0 130 0 0 0 19 0 8 0 886293421 535027712 25738 33554432000 4194304 4625164 140735379499040 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=522488 CPUtime=1.3 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3534 0 0 0 130 0 0 0 19 0 8 0 886293421 535027712 25738 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=522488 CPUtime=1.31 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 1729 0 0 0 131 0 0 0 19 0 8 0 886293421 535027712 25738 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 10.49
Current children cumulated vsize (KiB) 522488

[startup+1.53658 s]
/proc/loadavg: 0.00 0.00 0.00 2/462 28210
/proc/meminfo: memFree=24568344/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=522780 CPUtime=12.08 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 41726 0 0 0 1203 5 0 0 19 0 8 0 886293419 535326720 27120 33554432000 4194304 4625164 140735379499040 18446744073709551615 4519346 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 130695 27122 422 106 0 126198 0
[pid=28210/tid=28211] ppid=28208 vsize=522780 CPUtime=1.5 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3269 0 0 0 150 0 0 0 20 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=522780 CPUtime=1.49 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3076 0 0 0 149 0 0 0 19 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4485995 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=522780 CPUtime=1.5 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 4749 0 0 0 150 0 0 0 19 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352053 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=522780 CPUtime=1.49 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3277 0 0 0 149 0 0 0 20 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=522780 CPUtime=1.5 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3774 0 0 0 150 0 0 0 19 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=522780 CPUtime=1.5 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 3680 0 0 0 150 0 0 0 19 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=522780 CPUtime=1.51 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 1731 0 0 0 151 0 0 0 19 0 8 0 886293421 535326720 27122 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.08
Current children cumulated vsize (KiB) 522780

[startup+3.10129 s]
/proc/loadavg: 0.64 0.13 0.04 9/470 28218
/proc/meminfo: memFree=24405352/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=552988 CPUtime=24.67 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 73941 0 0 0 2458 9 0 0 24 0 8 0 886293419 566259712 40684 33554432000 4194304 4625164 140735379499040 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 138247 40684 451 106 0 133750 0
[pid=28210/tid=28211] ppid=28208 vsize=552988 CPUtime=3.09 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 7280 0 0 0 308 1 0 0 24 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=552988 CPUtime=3.07 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 4660 0 0 0 307 0 0 0 24 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4466334 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=552988 CPUtime=3.04 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 15785 0 0 0 303 1 0 0 24 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=552988 CPUtime=3.07 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 5069 0 0 0 307 0 0 0 25 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=552988 CPUtime=3.08 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 6327 0 0 0 308 0 0 0 24 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4436880 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=552988 CPUtime=3.08 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 6102 0 0 0 308 0 0 0 24 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4339569 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=552988 CPUtime=3.09 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 2959 0 0 0 309 0 0 0 24 0 8 0 886293421 566259712 40693 33554432000 4194304 4625164 140735379499040 18446744073709551615 4467266 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.67
Current children cumulated vsize (KiB) 552988

[startup+6.30069 s]
/proc/loadavg: 1.23 0.26 0.09 9/470 28219
/proc/meminfo: memFree=24343600/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=565872 CPUtime=50.13 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 114177 0 0 0 4997 16 0 0 25 0 8 0 886293419 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 141468 64910 772 106 0 136971 0
[pid=28210/tid=28211] ppid=28208 vsize=565872 CPUtime=6.27 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 8150 0 0 0 626 1 0 0 25 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=565872 CPUtime=6.25 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 6965 0 0 0 624 1 0 0 18 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=565872 CPUtime=6.2 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 28941 0 0 0 617 3 0 0 25 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=565872 CPUtime=6.25 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 7598 0 0 0 625 0 0 0 25 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=565872 CPUtime=6.27 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 9262 0 0 0 626 1 0 0 25 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=565872 CPUtime=6.27 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 8911 0 0 0 626 1 0 0 25 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=565872 CPUtime=6.27 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 5127 0 0 0 627 0 0 0 25 0 8 0 886293421 579452928 64910 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 18084124

[startup+4722.3 s]
/proc/loadavg: 8.06 8.06 7.98 9/470 28364
/proc/meminfo: memFree=10258880/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=18084124 CPUtime=37695.3 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 38601653 0 0 0 3763340 6192 0 0 25 0 8 0 886293419 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 4521031 3569965 424 106 0 4516534 0
[pid=28210/tid=28211] ppid=28208 vsize=18084124 CPUtime=4694.17 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 312408 0 0 0 469344 73 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=18084124 CPUtime=4721.66 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 243214 0 0 0 472056 110 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=18084124 CPUtime=4716.81 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 29133690 0 0 0 467281 4400 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=18084124 CPUtime=4681.09 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 315911 0 0 0 468016 93 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=18084124 CPUtime=4720.81 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 356083 0 0 0 471991 90 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=18084124 CPUtime=4722.09 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 319953 0 0 0 472122 87 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=18084124 CPUtime=4721.1 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 238971 0 0 0 472038 72 0 0 25 0 8 0 886293421 18518142976 3569965 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37695.3
Current children cumulated vsize (KiB) 18084124

[startup+4782.3 s]
/proc/loadavg: 8.02 8.05 7.98 9/470 28366
/proc/meminfo: memFree=10161876/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=18084124 CPUtime=38174.4 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 39112668 0 0 0 3811171 6269 0 0 25 0 8 0 886293419 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 4521031 3594244 367 106 0 4516534 0
[pid=28210/tid=28211] ppid=28208 vsize=18084124 CPUtime=4754.17 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 312961 0 0 0 475344 73 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=18084124 CPUtime=4781.65 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 243584 0 0 0 478055 110 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=18084124 CPUtime=4776.8 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 29614655 0 0 0 473209 4471 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4579607 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=18084124 CPUtime=4740.17 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 317471 0 0 0 473922 95 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=18084124 CPUtime=4780.81 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 356696 0 0 0 477990 91 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4329705 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=18084124 CPUtime=4782.09 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 321706 0 0 0 478122 87 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=18084124 CPUtime=4781.11 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 240178 0 0 0 478038 73 0 0 25 0 8 0 886293421 18518142976 3594244 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38174.4
Current children cumulated vsize (KiB) 18084124

[startup+4842.3 s]
/proc/loadavg: 8.05 8.05 7.99 9/470 28367
/proc/meminfo: memFree=10087188/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=18102668 CPUtime=38653.4 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 39501347 0 0 0 3859013 6332 0 0 25 0 8 0 886293419 18537132032 3611590 33554432000 4194304 4625164 140735379499040 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 4525667 3611590 353 106 0 4521170 0
[pid=28210/tid=28211] ppid=28208 vsize=18102668 CPUtime=4814.17 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 313250 0 0 0 481344 73 0 0 25 0 8 0 886293421 18537132032 3611592 33554432000 4194304 4625164 140735379499040 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=18102668 CPUtime=4841.66 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 243749 0 0 0 484056 110 0 0 25 0 8 0 886293421 18537132032 3611592 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=18102668 CPUtime=4836.8 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 29988100 0 0 0 479151 4529 0 0 25 0 8 0 886293421 18537132032 3611592 33554432000 4194304 4625164 140735379499040 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=18102668 CPUtime=4799.24 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 317954 0 0 0 479829 95 0 0 25 0 8 0 886293421 18537132032 3611594 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=18102668 CPUtime=4840.79 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 356862 0 0 0 483988 91 0 0 25 0 8 0 886293421 18537132032 3611595 33554432000 4194304 4625164 140735379499040 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=18102668 CPUtime=4842.09 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 322329 0 0 0 484121 88 0 0 25 0 8 0 886293421 18537132032 3611596 33554432000 4194304 4625164 140735379499040 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=18102668 CPUtime=4841.11 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 241313 0 0 0 484037 74 0 0 25 0 8 0 886293421 18537132032 3611596 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38653.4
Current children cumulated vsize (KiB) 18102668

[startup+4902.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/470 28369
/proc/meminfo: memFree=9982004/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=18228828 CPUtime=39132.5 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 39909673 0 0 0 3906863 6391 0 0 25 0 8 0 886293419 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 4557207 3640621 390 106 0 4552710 0
[pid=28210/tid=28211] ppid=28208 vsize=18228828 CPUtime=4874.17 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 313269 0 0 0 487344 73 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=18228828 CPUtime=4901.67 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 244010 0 0 0 490056 111 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=18228828 CPUtime=4896.8 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 30368929 0 0 0 485096 4584 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=18228828 CPUtime=4858.32 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 319392 0 0 0 485737 95 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=18228828 CPUtime=4900.78 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 357096 0 0 0 489987 91 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=18228828 CPUtime=4902.09 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 322372 0 0 0 490121 88 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=18228828 CPUtime=4901.12 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 241395 0 0 0 490038 74 0 0 25 0 8 0 886293421 18666319872 3640621 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39132.5
Current children cumulated vsize (KiB) 18228828

[startup+4962.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/470 28371
/proc/meminfo: memFree=9884256/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=18275768 CPUtime=39611.6 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 40333285 0 0 0 3954705 6456 0 0 25 0 8 0 886293419 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 4568942 3663320 391 106 0 4564445 0
[pid=28210/tid=28211] ppid=28208 vsize=18275768 CPUtime=4934.17 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 313278 0 0 0 493344 73 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=18275768 CPUtime=4961.67 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 244190 0 0 0 496056 111 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4340066 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=18275768 CPUtime=4956.8 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 30768640 0 0 0 491036 4644 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4552410 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=18275768 CPUtime=4917.38 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 319589 0 0 0 491643 95 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=18275768 CPUtime=4960.77 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 357117 0 0 0 495986 91 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=18275768 CPUtime=4962.09 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 322780 0 0 0 496121 88 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4330776 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=18275768 CPUtime=4961.12 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 241404 0 0 0 496038 74 0 0 25 0 8 0 886293421 18714386432 3663320 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39611.6
Current children cumulated vsize (KiB) 18275768



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011 s]
/proc/loadavg: 8.06 8.06 8.00 9/470 28372
/proc/meminfo: memFree=9749452/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=18306816 CPUtime=40000.5 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) R 28208 28210 28183 0 -1 4202496 40852855 0 0 0 3993517 6536 0 0 25 0 8 0 886293419 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 4576704 3697205 455 106 0 4572207 0
[pid=28210/tid=28211] ppid=28208 vsize=18306816 CPUtime=4982.89 cores=0-7
/proc/28210/task/28211/stat : 28211 (SArTagnan) R 28208 28210 28183 0 -1 4202560 313446 0 0 0 498216 73 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4488054 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28210/tid=28212] ppid=28208 vsize=18306816 CPUtime=5010.39 cores=0-7
/proc/28210/task/28212/stat : 28212 (SArTagnan) R 28208 28210 28183 0 -1 4202560 245152 0 0 0 500928 111 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28210/tid=28213] ppid=28208 vsize=18306816 CPUtime=5005.52 cores=0-7
/proc/28210/task/28213/stat : 28213 (SArTagnan) R 28208 28210 28183 0 -1 4202560 31253771 0 0 0 495834 4718 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=18306816 CPUtime=4965.33 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4202560 320664 0 0 0 496438 95 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28210/tid=28215] ppid=28208 vsize=18306816 CPUtime=5009.46 cores=0-7
/proc/28210/task/28215/stat : 28215 (SArTagnan) R 28208 28210 28183 0 -1 4202560 357353 0 0 0 500855 91 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28210/tid=28216] ppid=28208 vsize=18306816 CPUtime=5010.81 cores=0-7
/proc/28210/task/28216/stat : 28216 (SArTagnan) R 28208 28210 28183 0 -1 4202560 322936 0 0 0 500993 88 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28210/tid=28217] ppid=28208 vsize=18306816 CPUtime=5009.83 cores=0-7
/proc/28210/task/28217/stat : 28217 (SArTagnan) R 28208 28210 28183 0 -1 4202560 242014 0 0 0 500909 74 0 0 25 0 8 0 886293421 18746179584 3697205 33554432000 4194304 4625164 140735379499040 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 18306816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.2 s]
/proc/loadavg: 8.06 8.06 8.00 9/470 28372
/proc/meminfo: memFree=9749452/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=0 CPUtime=40000.8 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) Z 28208 28210 28183 0 -1 4203548 40852855 0 0 0 3993525 6554 0 0 25 0 2 0 886293419 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 0 0 0 0 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=0 CPUtime=4965.51 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4203588 320664 0 0 0 496438 113 0 0 25 0 2 0 886293421 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

[startup+5011.6 s]
/proc/loadavg: 8.06 8.06 8.00 2/465 28373
/proc/meminfo: memFree=17720956/32951124 swapFree=56297244/67111528
[pid=28210] ppid=28208 vsize=0 CPUtime=40001.2 cores=0-7
/proc/28210/stat : 28210 (SArTagnan) Z 28208 28210 28183 0 -1 4203548 40852855 0 0 0 3993525 6594 0 0 25 0 2 0 886293419 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28210/statm: 0 0 0 0 0 0 0
[pid=28210/tid=28214] ppid=28208 vsize=0 CPUtime=4965.91 cores=0-7
/proc/28210/task/28214/stat : 28214 (SArTagnan) R 28208 28210 28183 0 -1 4203588 320664 0 0 0 496438 153 0 0 25 0 2 0 886293421 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40001.2
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.66
CPU time (s): 40001.2
CPU user time (s): 39935.3
CPU system time (s): 65.998
CPU usage (%): 798.164
Max. virtual memory (cumulated for all children) (KiB): 22855672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39935.3
system time used= 65.998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40852855
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 174082
involuntary context switches= 129770

runsolver used 20.0659 second user time and 57.9902 second system time

The end

Launcher Data 

Begin job on node111 at 2011-06-01 22:37:09
IDJOB=3439331
IDBENCH=83988
IDSOLVER=1936
FILE ID=node111/3439331-1306960629
RUNJOBID= node111-1306960629-28198
PBS_JOBID= 13497642
Free space on /tmp= 73856 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439331-1306960629/watcher-3439331-1306960629 -o /tmp/evaluation-result-3439331-1306960629/solver-3439331-1306960629 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439331-1306960629.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9ffa0325c9e00b41c025f41d20ec5a0c
RANDOM SEED=481871933

node111.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5428.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24568632 kB
Buffers:        197936 kB
Cached:         524772 kB
SwapCached:      11780 kB
Active:        7595344 kB
Inactive:       520296 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24568632 kB
SwapTotal:    67111528 kB
SwapFree:     56297244 kB
Dirty:             804 kB
Writeback:           0 kB
AnonPages:     7390144 kB
Mapped:          26960 kB
Slab:           130452 kB
PageTables:      65884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 149064748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73856 MiB
End job on node111 at 2011-06-02 00:00:42