Trace number 3438666

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.4 5010.24

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n130-s30940966-unsat.cnf
MD5SUMca44a78076b8228fbb99ecc0147f157f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of clauses276
Sum of the clauses size828
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3276
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438666-1306921331/watcher-3438666-1306921331 -o /tmp/evaluation-result-3438666-1306921331/solver-3438666-1306921331 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438666-1306921331.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.05 8.08 7.16 2/462 26082
/proc/meminfo: memFree=24845924/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=90324 CPUtime=0.03 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 474 0 0 0 3 0 0 0 25 0 8 0 882363625 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 47318637410224 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 22581 411 300 106 0 18084 0
[pid=26082/tid=26083] ppid=26080 vsize=90324 CPUtime=0.01 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 47318637410226 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=90324 CPUtime=0 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 47318637410226 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=90324 CPUtime=0 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=90324 CPUtime=0 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 252458122225 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=90324 CPUtime=0 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 47318637410226 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=90324 CPUtime=0.01 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 47318637410226 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=90324 CPUtime=0.01 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 882363626 92491776 411 33554432000 4194304 4625164 140735571049424 18446744073709551615 47318637410226 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.056785 s]
/proc/loadavg: 8.05 8.08 7.16 2/462 26082
/proc/meminfo: memFree=24845924/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=353572 CPUtime=0.29 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 1272 0 0 0 29 0 0 0 18 0 8 0 882363625 362057728 1136 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 88393 1136 351 106 0 83896 0
[pid=26082/tid=26083] ppid=26080 vsize=353572 CPUtime=0.04 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 154 0 0 0 4 0 0 0 18 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352331 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=353572 CPUtime=0.03 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 87 0 0 0 3 0 0 0 25 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=353572 CPUtime=0 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 31 0 0 0 0 0 0 0 25 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 4327775 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=353572 CPUtime=0.03 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 103 0 0 0 3 0 0 0 18 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352691 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=353572 CPUtime=0.01 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 26 0 0 0 1 0 0 0 25 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 252458170862 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=353572 CPUtime=0.05 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 137 0 0 0 5 0 0 0 18 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=353572 CPUtime=0.05 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 109 0 0 0 5 0 0 0 18 0 8 0 882363626 362057728 1137 33554432000 4194304 4625164 140735571049424 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 353572

[startup+0.124718 s]
/proc/loadavg: 8.05 8.08 7.16 2/462 26082
/proc/meminfo: memFree=24845924/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=355532 CPUtime=0.76 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 2932 0 0 0 76 0 0 0 18 0 8 0 882363625 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 88883 2123 351 106 0 84386 0
[pid=26082/tid=26083] ppid=26080 vsize=355532 CPUtime=0.11 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 380 0 0 0 11 0 0 0 18 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=355532 CPUtime=0.1 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 403 0 0 0 10 0 0 0 25 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352243 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=355532 CPUtime=0 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 31 0 0 0 0 0 0 0 25 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4327775 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=355532 CPUtime=0.09 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273 0 0 0 9 0 0 0 18 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4462506 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=355532 CPUtime=0.07 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 267 0 0 0 7 0 0 0 25 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 252458109111 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=355532 CPUtime=0.11 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 395 0 0 0 11 0 0 0 18 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=355532 CPUtime=0.11 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) D 26080 26082 25972 0 -1 4202560 374 0 0 0 11 0 0 0 18 0 8 0 882363626 364064768 2123 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 355532

[startup+0.486393 s]
/proc/loadavg: 8.05 8.08 7.16 2/462 26082
/proc/meminfo: memFree=24845924/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=373196 CPUtime=8.17 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 18271 0 0 0 814 3 0 0 19 0 8 0 882363625 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512017 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 93299 10912 351 106 0 88802 0
[pid=26082/tid=26083] ppid=26080 vsize=373196 CPUtime=1.04 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2089 0 0 0 104 0 0 0 19 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=373196 CPUtime=1.03 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2173 0 0 0 103 0 0 0 25 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=373196 CPUtime=0.88 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 3866 0 0 0 88 0 0 0 25 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=373196 CPUtime=1.03 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 1976 0 0 0 103 0 0 0 19 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=373196 CPUtime=0.99 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2075 0 0 0 99 0 0 0 19 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4348870 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=373196 CPUtime=1.04 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2106 0 0 0 104 0 0 0 19 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=373196 CPUtime=1.05 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2062 0 0 0 105 0 0 0 19 0 8 0 882363626 382152704 10912 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 8.17
Current children cumulated vsize (KiB) 373196

[startup+1.16151 s]
/proc/loadavg: 8.05 8.08 7.16 2/462 26082
/proc/meminfo: memFree=24845924/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=374892 CPUtime=8.97 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 19865 0 0 0 894 3 0 0 19 0 8 0 882363625 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512142 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 93723 11504 351 106 0 89226 0
[pid=26082/tid=26083] ppid=26080 vsize=374892 CPUtime=1.14 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2129 0 0 0 114 0 0 0 19 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=374892 CPUtime=1.13 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2192 0 0 0 113 0 0 0 25 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=374892 CPUtime=0.98 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 4607 0 0 0 98 0 0 0 25 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339848 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=374892 CPUtime=1.13 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 1983 0 0 0 113 0 0 0 19 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=374892 CPUtime=1.09 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2099 0 0 0 109 0 0 0 19 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4435488 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=374892 CPUtime=1.14 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2127 0 0 0 114 0 0 0 19 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=374892 CPUtime=1.15 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2757 0 0 0 115 0 0 0 19 0 8 0 882363626 383889408 11504 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351672 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 8.97
Current children cumulated vsize (KiB) 374892

[startup+1.50045 s]
/proc/loadavg: 8.05 8.08 7.16 2/462 26082
/proc/meminfo: memFree=24845924/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=382040 CPUtime=11.68 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 25778 0 0 0 1165 3 0 0 20 0 8 0 882363625 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 95510 13950 351 106 0 91013 0
[pid=26082/tid=26083] ppid=26080 vsize=382040 CPUtime=1.48 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2998 0 0 0 148 0 0 0 19 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=382040 CPUtime=1.47 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2318 0 0 0 147 0 0 0 25 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4288672 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=382040 CPUtime=1.31 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 6808 0 0 0 131 0 0 0 25 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 252457732992 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=382040 CPUtime=1.47 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2770 0 0 0 147 0 0 0 19 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352760 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=382040 CPUtime=1.43 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2863 0 0 0 143 0 0 0 19 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=382040 CPUtime=1.47 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2954 0 0 0 147 0 0 0 19 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351878 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=382040 CPUtime=1.49 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 2854 0 0 0 149 0 0 0 19 0 8 0 882363626 391208960 13950 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.68
Current children cumulated vsize (KiB) 382040

[startup+3.10115 s]
/proc/loadavg: 8.12 8.10 7.17 9/470 26091
/proc/meminfo: memFree=24762792/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=400952 CPUtime=24.45 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 41081 0 0 0 2440 5 0 0 25 0 8 0 882363625 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 100238 21298 352 106 0 95741 0
[pid=26082/tid=26083] ppid=26080 vsize=400952 CPUtime=3.08 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 4744 0 0 0 308 0 0 0 25 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=400952 CPUtime=3.07 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 4844 0 0 0 307 0 0 0 25 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=400952 CPUtime=2.92 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 11880 0 0 0 291 1 0 0 25 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=400952 CPUtime=3.06 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 4407 0 0 0 306 0 0 0 25 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=400952 CPUtime=2.99 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 4429 0 0 0 299 0 0 0 24 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4348804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=400952 CPUtime=3.07 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 4383 0 0 0 307 0 0 0 24 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 252457724277 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=400952 CPUtime=3.09 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 3333 0 0 0 309 0 0 0 25 0 8 0 882363626 410574848 21298 33554432000 4194304 4625164 140735571049424 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.45
Current children cumulated vsize (KiB) 400952

[startup+6.31755 s]
/proc/loadavg: 8.11 8.10 7.17 9/470 26091
/proc/meminfo: memFree=24717220/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=424884 CPUtime=50.14 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 71157 0 0 0 5004 10 0 0 25 0 8 0 882363625 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4519478 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26082/statm: 106221 32623 362 106 0 101724 0
[pid=26082/tid=26083] ppid=26080 vsize=424884 CPUtime=6.3 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 7294 0 0 0 630 0 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=424884 CPUtime=6.29 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 7530 0 0 0 628 1 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=424884 CPUtime=6.14 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 24617 0 0 0 611 3 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=424884 CPUtime=6.28 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 6773 0 0 0 628 0 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=424884 CPUtime=6.16 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 7164 0 0 0 615 1 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=424884 CPUtime=6.29 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 6342 0 0 0 628 1 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=424884 CPUtime=6.3 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 7028 0 0 0 630 0 0 0 25 0 8 0 882363626 435081216 32623 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=26082/tid=26084] ppid=26080 vsize=5097632 CPUtime=4662.4 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 299314 0 0 0 466181 59 0 0 25 0 8 0 882363626 5219975168 1063819 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5097632 CPUtime=4662.25 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 10219091 0 0 0 464568 1657 0 0 25 0 8 0 882363626 5219975168 1063819 33554432000 4194304 4625164 140735571049424 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5097632 CPUtime=4661.23 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 210959 0 0 0 466080 43 0 0 25 0 8 0 882363626 5219975168 1063819 33554432000 4194304 4625164 140735571049424 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5097632 CPUtime=4653.31 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273244 0 0 0 465275 56 0 0 25 0 8 0 882363626 5219975168 1063819 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5097632 CPUtime=4662.18 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 82506 0 0 0 466169 49 0 0 25 0 8 0 882363626 5219975168 1063819 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5097632 CPUtime=4662.44 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234719 0 0 0 466193 51 0 0 25 0 8 0 882363626 5219975168 1063819 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37224.1
Current children cumulated vsize (KiB) 5097632

[startup+4722.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/470 26228
/proc/meminfo: memFree=20568092/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=5146464 CPUtime=37703.1 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 13607184 0 0 0 3767964 2347 0 0 25 0 8 0 882363625 5269979136 1062508 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512190 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26082/statm: 1286616 1062031 351 106 0 1282119 0
[pid=26082/tid=26083] ppid=26080 vsize=5146464 CPUtime=4721.6 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 224956 0 0 0 472109 51 0 0 25 0 8 0 882363626 5269979136 1061958 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=5146464 CPUtime=4722.4 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 299558 0 0 0 472181 59 0 0 25 0 8 0 882363626 5269979136 1061958 33554432000 4194304 4625164 140735571049424 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5146464 CPUtime=4722.25 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 10416960 0 0 0 470533 1692 0 0 25 0 8 0 882363626 5269979136 1061519 33554432000 4194304 4625164 140735571049424 18446744073709551615 252458109063 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5146464 CPUtime=4721.22 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 210983 0 0 0 472079 43 0 0 25 0 8 0 882363626 5269979136 1061519 33554432000 4194304 4625164 140735571049424 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5146464 CPUtime=4713.31 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273275 0 0 0 471275 56 0 0 25 0 8 0 882363626 5269979136 1061519 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5146464 CPUtime=4722.18 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 82562 0 0 0 472169 49 0 0 25 0 8 0 882363626 5269979136 1061007 33554432000 4194304 4625164 140735571049424 18446744073709551615 4462600 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5146464 CPUtime=4722.44 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234745 0 0 0 472193 51 0 0 25 0 8 0 882363626 5269979136 1061007 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37703.1
Current children cumulated vsize (KiB) 5146464

[startup+4782.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/470 26239
/proc/meminfo: memFree=20569740/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=5080928 CPUtime=38182.1 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 13816654 0 0 0 3815825 2386 0 0 25 0 8 0 882363625 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26082/statm: 1270232 1068831 662 106 0 1265735 0
[pid=26082/tid=26083] ppid=26080 vsize=5080928 CPUtime=4781.6 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 225061 0 0 0 478109 51 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=5080928 CPUtime=4782.38 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 299670 0 0 0 478178 60 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5080928 CPUtime=4782.25 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 10606841 0 0 0 476498 1727 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5080928 CPUtime=4781.21 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 211000 0 0 0 478078 43 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5080928 CPUtime=4773.31 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273297 0 0 0 477275 56 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5080928 CPUtime=4782.18 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 82684 0 0 0 478168 50 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5080928 CPUtime=4782.44 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234767 0 0 0 478193 51 0 0 25 0 8 0 882363626 5202870272 1068831 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38182.1
Current children cumulated vsize (KiB) 5080928

[startup+4842.3 s]
/proc/loadavg: 8.11 8.07 8.01 9/470 26241
/proc/meminfo: memFree=20556932/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=5146464 CPUtime=38661.1 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 13988449 0 0 0 3863693 2421 0 0 25 0 8 0 882363625 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26082/statm: 1286616 1069918 648 106 0 1282119 0
[pid=26082/tid=26083] ppid=26080 vsize=5146464 CPUtime=4841.6 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 225152 0 0 0 484109 51 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=5146464 CPUtime=4842.39 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 299998 0 0 0 484178 61 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351811 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5146464 CPUtime=4842.26 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 10776650 0 0 0 482467 1759 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5146464 CPUtime=4841.19 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 211021 0 0 0 484076 43 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4330859 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5146464 CPUtime=4833.31 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273325 0 0 0 483275 56 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5146464 CPUtime=4842.17 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 83333 0 0 0 484165 52 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5146464 CPUtime=4842.44 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234792 0 0 0 484193 51 0 0 25 0 8 0 882363626 5269979136 1069918 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38661.1
Current children cumulated vsize (KiB) 5146464

[startup+4902.3 s]
/proc/loadavg: 8.13 8.08 8.01 9/470 26242
/proc/meminfo: memFree=20572028/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=5146464 CPUtime=39140.3 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 14058520 0 0 0 3911589 2439 0 0 25 0 8 0 882363625 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4392987 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26082/statm: 1286616 1065596 354 106 0 1282119 0
[pid=26082/tid=26083] ppid=26080 vsize=5146464 CPUtime=4901.61 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 225940 0 0 0 490109 52 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=5146464 CPUtime=4902.41 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 300194 0 0 0 490180 61 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5146464 CPUtime=4902.27 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 10845452 0 0 0 488453 1774 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5146464 CPUtime=4901.19 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 211037 0 0 0 490076 43 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5146464 CPUtime=4893.33 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273345 0 0 0 489277 56 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5146464 CPUtime=4902.19 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 83498 0 0 0 490167 52 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5146464 CPUtime=4902.46 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234815 0 0 0 490195 51 0 0 25 0 8 0 882363626 5269979136 1065596 33554432000 4194304 4625164 140735571049424 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39140.3
Current children cumulated vsize (KiB) 5146464

[startup+4962.3 s]
/proc/loadavg: 8.09 8.08 8.01 9/470 26244
/proc/meminfo: memFree=20538384/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=5160432 CPUtime=39619.2 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 14193640 0 0 0 3959457 2463 0 0 25 0 8 0 882363625 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26082/statm: 1290108 1074522 546 106 0 1285611 0
[pid=26082/tid=26083] ppid=26080 vsize=5160432 CPUtime=4961.6 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 225952 0 0 0 496108 52 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4330825 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=5160432 CPUtime=4962.39 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 300301 0 0 0 496178 61 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5160432 CPUtime=4962.25 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 10928635 0 0 0 494437 1788 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5160432 CPUtime=4961.17 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 211049 0 0 0 496073 44 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5160432 CPUtime=4953.32 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273363 0 0 0 495276 56 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5160432 CPUtime=4962.17 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 83498 0 0 0 496165 52 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5160432 CPUtime=4962.45 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234832 0 0 0 496194 51 0 0 25 0 8 0 882363626 5284282368 1074522 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39619.2
Current children cumulated vsize (KiB) 5160432



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010 s]
/proc/loadavg: 8.04 8.07 8.01 9/470 26245
/proc/meminfo: memFree=20525192/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=5160432 CPUtime=40000.1 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4202496 14408363 0 0 0 3997512 2501 0 0 25 0 8 0 882363625 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26082/statm: 1290108 1077548 549 106 0 1285611 0
[pid=26082/tid=26083] ppid=26080 vsize=5160432 CPUtime=5009.32 cores=0-7
/proc/26082/task/26083/stat : 26083 (SArTagnan) R 26080 26082 25972 0 -1 4202560 225958 0 0 0 500880 52 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26082/tid=26084] ppid=26080 vsize=5160432 CPUtime=5010.11 cores=0-7
/proc/26082/task/26084/stat : 26084 (SArTagnan) R 26080 26082 25972 0 -1 4202560 300353 0 0 0 500950 61 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26082/tid=26085] ppid=26080 vsize=5160432 CPUtime=5009.98 cores=0-7
/proc/26082/task/26085/stat : 26085 (SArTagnan) R 26080 26082 25972 0 -1 4202560 11085987 0 0 0 499182 1816 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26082/tid=26086] ppid=26080 vsize=5160432 CPUtime=5008.88 cores=0-7
/proc/26082/task/26086/stat : 26086 (SArTagnan) R 26080 26082 25972 0 -1 4202560 211063 0 0 0 500844 44 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26082/tid=26087] ppid=26080 vsize=5160432 CPUtime=5001.03 cores=0-7
/proc/26082/task/26087/stat : 26087 (SArTagnan) R 26080 26082 25972 0 -1 4202560 273377 0 0 0 500047 56 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26082/tid=26088] ppid=26080 vsize=5160432 CPUtime=5009.89 cores=0-7
/proc/26082/task/26088/stat : 26088 (SArTagnan) R 26080 26082 25972 0 -1 4202560 83498 0 0 0 500936 53 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26082/tid=26089] ppid=26080 vsize=5160432 CPUtime=5010.17 cores=0-7
/proc/26082/task/26089/stat : 26089 (SArTagnan) R 26080 26082 25972 0 -1 4202560 234844 0 0 0 500966 51 0 0 25 0 8 0 882363626 5284282368 1077548 33554432000 4194304 4625164 140735571049424 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 5160432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.22 s]
/proc/loadavg: 8.04 8.07 8.01 2/464 26246
/proc/meminfo: memFree=22463820/32951124 swapFree=56297244/67111528
[pid=26082] ppid=26080 vsize=0 CPUtime=40000.4 cores=0-7
/proc/26082/stat : 26082 (SArTagnan) R 26080 26082 25972 0 -1 4203524 14408363 0 0 0 3997519 2520 0 0 25 0 1 0 882363625 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26082/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.24
CPU time (s): 40000.4
CPU user time (s): 39975.2
CPU system time (s): 25.2262
CPU usage (%): 798.374
Max. virtual memory (cumulated for all children) (KiB): 5249280

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39975.2
system time used= 25.2262
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14408363
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2783
involuntary context switches= 119326

runsolver used 20.8118 second user time and 57.7292 second system time

The end

Launcher Data 

Begin job on node111 at 2011-06-01 11:42:12
IDJOB=3438666
IDBENCH=83148
IDSOLVER=1936
FILE ID=node111/3438666-1306921331
RUNJOBID= node111-1306919552-25986
PBS_JOBID= 13488533
Free space on /tmp= 73928 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n130-s30940966-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438666-1306921331/watcher-3438666-1306921331 -o /tmp/evaluation-result-3438666-1306921331/solver-3438666-1306921331 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438666-1306921331.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ca44a78076b8228fbb99ecc0147f157f
RANDOM SEED=1803448753

node111.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5428.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24846204 kB
Buffers:        173836 kB
Cached:         271668 kB
SwapCached:      11772 kB
Active:        7534072 kB
Inactive:       304520 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24846204 kB
SwapTotal:    67111528 kB
SwapFree:     56297244 kB
Dirty:             400 kB
Writeback:           0 kB
AnonPages:     7390976 kB
Mapped:          27384 kB
Slab:           130488 kB
PageTables:      65700 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 149058984 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73928 MiB
End job on node111 at 2011-06-01 13:05:44