Trace number 3439791

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001.2 5010.5

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m42-q585-n40-p15-s54275047.cnf
MD5SUM67948a6aed9ea09317abe3c8a9a27a03
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark30.0564
Satisfiable
(Un)Satisfiability was proved
Number of variables1590
Number of clauses272291
Sum of the clauses size546092
Maximum clause length42
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2272251
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439791-1306965741/watcher-3439791-1306965741 -o /tmp/evaluation-result-3439791-1306965741/solver-3439791-1306965741 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439791-1306965741.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.08 8.01 1/457 20862
/proc/meminfo: memFree=30406808/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=25784 CPUtime=0 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 882 0 0 0 0 0 0 0 25 0 1 0 808173888 26402816 542 33554432000 4194304 4625164 140737161688688 18446744073709551615 248089741447 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/20862/statm: 6446 542 296 106 0 1949 0

[startup+0.052635 s]
/proc/loadavg: 8.12 8.08 8.01 1/457 20862
/proc/meminfo: memFree=30406808/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=28540 CPUtime=0.04 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 2735 0 0 0 4 0 0 0 25 0 1 0 808173888 29224960 1019 33554432000 4194304 4625164 140737161688688 18446744073709551615 4283504 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/20862/statm: 7135 1020 296 106 0 2638 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 28540

[startup+0.100558 s]
/proc/loadavg: 8.12 8.08 8.01 1/457 20862
/proc/meminfo: memFree=30406808/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=387396 CPUtime=0.16 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 9398 0 0 0 16 0 0 0 18 0 8 0 808173888 396693504 7669 33554432000 4194304 4625164 140737161688688 18446744073709551615 4500173 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 96849 7670 339 106 0 92352 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 387396

[startup+0.300526 s]
/proc/loadavg: 8.12 8.08 8.01 1/457 20862
/proc/meminfo: memFree=30406808/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=546408 CPUtime=1.72 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 34503 0 0 0 169 3 0 0 18 0 8 0 808173888 559521792 23722 33554432000 4194304 4625164 140737161688688 18446744073709551615 4360200 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 136602 23722 392 106 0 132105 0
Current children cumulated CPU time (s) 1.72
Current children cumulated vsize (KiB) 546408

[startup+0.700455 s]
/proc/loadavg: 8.12 8.08 8.01 1/457 20862
/proc/meminfo: memFree=30406808/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=558480 CPUtime=4.9 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 52518 0 0 0 484 6 0 0 18 0 8 0 808173888 571883520 33084 33554432000 4194304 4625164 140737161688688 18446744073709551615 4513492 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 139620 33085 389 106 0 135123 0
Current children cumulated CPU time (s) 4.9
Current children cumulated vsize (KiB) 558480

[startup+1.50031 s]
/proc/loadavg: 8.12 8.08 8.01 9/465 20870
/proc/meminfo: memFree=30262044/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=568108 CPUtime=11.29 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 64864 0 0 0 1121 8 0 0 19 0 8 0 808173888 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4512042 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 142027 43890 398 106 0 137530 0
[pid=20862/tid=20864] ppid=20860 vsize=568108 CPUtime=1.4 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4260 0 0 0 140 0 0 0 25 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 248089353673 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=568108 CPUtime=1.4 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 3445 0 0 0 140 0 0 0 25 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=568108 CPUtime=1.4 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4524 0 0 0 140 0 0 0 20 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4328594 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=568108 CPUtime=1.34 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4875 0 0 0 134 0 0 0 25 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=568108 CPUtime=1.4 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4805 0 0 0 140 0 0 0 19 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4348844 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=568108 CPUtime=1.4 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4940 0 0 0 140 0 0 0 20 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352157 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=568108 CPUtime=1.4 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4580 0 0 0 140 0 0 0 25 0 8 0 808173896 581742592 43890 33554432000 4194304 4625164 140737161688688 18446744073709551615 4467393 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.29
Current children cumulated vsize (KiB) 568108

[startup+3.10103 s]
/proc/loadavg: 8.12 8.08 8.01 9/465 20870
/proc/meminfo: memFree=30223852/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=582756 CPUtime=24.08 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 88505 0 0 0 2396 12 0 0 24 0 8 0 808173888 596742144 56092 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511956 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 145689 56092 475 106 0 141192 0
[pid=20862/tid=20864] ppid=20860 vsize=582756 CPUtime=3.01 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 6989 0 0 0 300 1 0 0 25 0 8 0 808173896 596742144 56092 33554432000 4194304 4625164 140737161688688 18446744073709551615 248089354664 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=582756 CPUtime=3 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 3962 0 0 0 300 0 0 0 25 0 8 0 808173896 596742144 56092 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=582756 CPUtime=3 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 8704 0 0 0 299 1 0 0 25 0 8 0 808173896 596742144 56092 33554432000 4194304 4625164 140737161688688 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=582756 CPUtime=2.91 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 7632 0 0 0 291 0 0 0 25 0 8 0 808173896 596742144 56093 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=582756 CPUtime=2.99 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 7295 0 0 0 299 0 0 0 25 0 8 0 808173896 596742144 56093 33554432000 4194304 4625164 140737161688688 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=582756 CPUtime=3 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 7568 0 0 0 299 1 0 0 25 0 8 0 808173896 596742144 56093 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=582756 CPUtime=3 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 5341 0 0 0 300 0 0 0 25 0 8 0 808173896 596742144 56093 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.08
Current children cumulated vsize (KiB) 582756

[startup+6.30047 s]
/proc/loadavg: 8.11 8.08 8.01 9/465 20870
/proc/meminfo: memFree=30140156/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=582756 CPUtime=49.63 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 115899 0 0 0 4946 17 0 0 25 0 8 0 808173888 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4512249 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 145689 69098 532 106 0 141192 0
[pid=20862/tid=20864] ppid=20860 vsize=582756 CPUtime=6.2 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 11408 0 0 0 619 1 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=582756 CPUtime=6.2 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 4401 0 0 0 620 0 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=582756 CPUtime=6.2 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 15350 0 0 0 619 1 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4547468 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=582756 CPUtime=6.07 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 11985 0 0 0 606 1 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=582756 CPUtime=6.2 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 10962 0 0 0 618 2 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 248089353414 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=582756 CPUtime=6.2 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 12271 0 0 0 619 1 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4317225 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=582756 CPUtime=6.2 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 5613 0 0 0 620 0 0 0 25 0 8 0 808173896 596742144 69098 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.63
Current children cumulated vsize (KiB) 582756

[startup+12.7003 s]
/proc/loadavg: 8.18 8.09 8.01 9/465 20870
/proc/meminfo: memFree=29975020/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=712604 CPUtime=100.71 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 178806 0 0 0 10045 26 0 0 25 0 8 0 808173888 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4512887 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 178151 110860 1164 106 0 173654 0
[pid=20862/tid=20864] ppid=20860 vsize=712604 CPUtime=12.6 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 16597 0 0 0 1258 2 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=712604 CPUtime=12.6 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 8036 0 0 0 1259 1 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=712604 CPUtime=12.6 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 32995 0 0 0 1256 4 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4554848 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=712604 CPUtime=12.37 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 17952 0 0 0 1235 2 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4467266 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=712604 CPUtime=12.6 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 16469 0 0 0 1258 2 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=712604 CPUtime=12.61 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 18615 0 0 0 1258 3 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=712604 CPUtime=12.6 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 8447 0 0 0 1259 1 0 0 25 0 8 0 808173896 729706496 110860 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.71
Current children cumulated vsize (KiB) 712604

[startup+25.5011 s]
/proc/loadavg: 8.14 8.09 8.01 9/465 20870
/proc/meminfo: memFree=29783688/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=1010356 CPUtime=202.91 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 292603 0 0 0 20247 44 0 0 25 0 8 0 808173888 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 252589 157219 1272 106 0 248092 0
[pid=20862/tid=20864] ppid=20860 vsize=1010356 CPUtime=25.41 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 19355 0 0 0 2538 3 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=1010356 CPUtime=25.4 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 13821 0 0 0 2538 2 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=1010356 CPUtime=25.4 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 72743 0 0 0 2531 9 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4547594 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=1010356 CPUtime=24.96 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 27469 0 0 0 2493 3 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=1010356 CPUtime=25.4 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 27163 0 0 0 2536 4 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=1010356 CPUtime=25.4 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 37041 0 0 0 2534 6 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330791 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=1010356 CPUtime=25.4 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 10808 0 0 0 2538 2 0 0 25 0 8 0 808173896 1034604544 157219 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.91
Current children cumulated vsize (KiB) 1010356

[startup+51.1006 s]
/proc/loadavg: 8.09 8.08 8.01 9/465 20871
/proc/meminfo: memFree=29590136/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=1227776 CPUtime=407.31 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 503381 0 0 0 40652 79 0 0 25 0 8 0 808173888 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511938 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 306944 209034 740 106 0 302447 0
[pid=20862/tid=20864] ppid=20860 vsize=1227776 CPUtime=51.01 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 29906 0 0 0 5096 5 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=1227776 CPUtime=50.99 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 16520 0 0 0 5096 3 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=1227776 CPUtime=51 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 182860 0 0 0 5074 26 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=1227776 CPUtime=50.16 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 53780 0 0 0 5009 7 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=1227776 CPUtime=51 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 42872 0 0 0 5094 6 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4319152 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=1227776 CPUtime=51 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 43938 0 0 0 5092 8 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4317543 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=1227776 CPUtime=51 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 17222 0 0 0 5097 3 0 0 25 0 8 0 808173896 1257242624 209034 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.31

################
# More data... #
################

[pid=20862/tid=20866] ppid=20860 vsize=6653132 CPUtime=4662.24 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 30570059 0 0 0 461408 4816 0 0 25 0 8 0 808173896 6812807168 1357808 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=6653132 CPUtime=4589.87 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 285291 0 0 0 458928 59 0 0 25 0 8 0 808173896 6812807168 1357808 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=6653132 CPUtime=4662.28 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 237527 0 0 0 466185 43 0 0 25 0 8 0 808173896 6812807168 1357808 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329656 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=6653132 CPUtime=4662.32 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 309491 0 0 0 466169 63 0 0 25 0 8 0 808173896 6812807168 1357808 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=6653132 CPUtime=4662.27 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 178800 0 0 0 466126 101 0 0 25 0 8 0 808173896 6812807168 1357808 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37223
Current children cumulated vsize (KiB) 6653132

[startup+4722.32 s]
/proc/loadavg: 8.04 8.05 8.00 9/465 21010
/proc/meminfo: memFree=24936568/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=6653132 CPUtime=37702.2 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 34705752 0 0 0 3764412 5805 0 0 25 0 8 0 808173888 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 1663283 1364786 349 106 0 1658786 0
[pid=20862/tid=20864] ppid=20860 vsize=6653132 CPUtime=4722.31 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 270068 0 0 0 472181 50 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=6653132 CPUtime=4720.04 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 398701 0 0 0 471756 248 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=6653132 CPUtime=4722.27 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 31130136 0 0 0 467324 4903 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4334435 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=6653132 CPUtime=4648.96 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 285415 0 0 0 464836 60 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=6653132 CPUtime=4722.3 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 237709 0 0 0 472187 43 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=6653132 CPUtime=4722.34 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 309703 0 0 0 472171 63 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=6653132 CPUtime=4722.3 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 179098 0 0 0 472128 102 0 0 25 0 8 0 808173896 6812807168 1364786 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37702.2
Current children cumulated vsize (KiB) 6653132

[startup+4782.3 s]
/proc/loadavg: 8.09 8.06 8.00 9/465 21012
/proc/meminfo: memFree=24878980/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=6718668 CPUtime=38181.1 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 35045442 0 0 0 3812249 5862 0 0 25 0 8 0 808173888 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 1679667 1376945 349 106 0 1675170 0
[pid=20862/tid=20864] ppid=20860 vsize=6718668 CPUtime=4782.3 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 270239 0 0 0 478180 50 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=6718668 CPUtime=4780.02 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 401616 0 0 0 477749 253 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=6718668 CPUtime=4782.25 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 31459314 0 0 0 473272 4953 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=6718668 CPUtime=4708.03 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 285722 0 0 0 470743 60 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=6718668 CPUtime=4782.29 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 237928 0 0 0 478186 43 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=6718668 CPUtime=4782.32 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 310008 0 0 0 478169 63 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=6718668 CPUtime=4782.28 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 179203 0 0 0 478126 102 0 0 25 0 8 0 808173896 6879916032 1376945 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38181.1
Current children cumulated vsize (KiB) 6718668

[startup+4842.3 s]
/proc/loadavg: 8.03 8.05 8.00 9/465 21014
/proc/meminfo: memFree=24831428/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=6784204 CPUtime=38660.2 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 35489949 0 0 0 3860085 5932 0 0 25 0 8 0 808173888 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 1696051 1391700 394 106 0 1691554 0
[pid=20862/tid=20864] ppid=20860 vsize=6784204 CPUtime=4842.3 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 270423 0 0 0 484180 50 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330892 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=6784204 CPUtime=4840.01 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 405954 0 0 0 483746 255 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352174 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=6784204 CPUtime=4842.26 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 31891356 0 0 0 479207 5019 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=6784204 CPUtime=4767.09 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 285896 0 0 0 476649 60 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=6784204 CPUtime=4842.29 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 238207 0 0 0 484186 43 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=6784204 CPUtime=4842.32 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 310163 0 0 0 484169 63 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=6784204 CPUtime=4842.29 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 179399 0 0 0 484127 102 0 0 25 0 8 0 808173896 6947024896 1391700 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38660.2
Current children cumulated vsize (KiB) 6784204

[startup+4902.3 s]
/proc/loadavg: 8.07 8.05 8.00 9/465 21015
/proc/meminfo: memFree=24825548/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=6718668 CPUtime=39139.2 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 35823276 0 0 0 3907937 5987 0 0 25 0 8 0 808173888 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 1679667 1392799 349 106 0 1675170 0
[pid=20862/tid=20864] ppid=20860 vsize=6718668 CPUtime=4902.3 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 270723 0 0 0 490180 50 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=6718668 CPUtime=4899.99 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 407876 0 0 0 489742 257 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=6718668 CPUtime=4902.25 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 32217231 0 0 0 485156 5069 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=6718668 CPUtime=4826.17 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 286054 0 0 0 482557 60 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=6718668 CPUtime=4902.28 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 238558 0 0 0 490185 43 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329838 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=6718668 CPUtime=4902.32 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 310294 0 0 0 490169 63 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=6718668 CPUtime=4902.29 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 179442 0 0 0 490127 102 0 0 25 0 8 0 808173896 6879916032 1392799 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39139.2
Current children cumulated vsize (KiB) 6718668

[startup+4962.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/465 21017
/proc/meminfo: memFree=24667272/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=7214760 CPUtime=39618.3 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 36167202 0 0 0 3955789 6040 0 0 25 0 8 0 808173888 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 1803690 1432275 349 106 0 1799193 0
[pid=20862/tid=20864] ppid=20860 vsize=7214760 CPUtime=4962.31 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 271036 0 0 0 496180 51 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=7214760 CPUtime=4959.96 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 411593 0 0 0 495734 262 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=7214760 CPUtime=4962.25 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 32274107 0 0 0 491148 5077 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4547348 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=7214760 CPUtime=4885.23 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 286212 0 0 0 488463 60 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=7214760 CPUtime=4962.28 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 238763 0 0 0 496185 43 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=7214760 CPUtime=4962.32 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 310707 0 0 0 496169 63 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4488006 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=7214760 CPUtime=4962.29 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 179694 0 0 0 496127 102 0 0 25 0 8 0 808173896 7387914240 1432275 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39618.3
Current children cumulated vsize (KiB) 7214760



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.2 s]
/proc/loadavg: 8.07 8.05 8.00 9/465 21018
/proc/meminfo: memFree=24639808/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=7214760 CPUtime=40000.8 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) R 20860 20862 20439 0 -1 4202496 36421926 0 0 0 3994002 6082 0 0 25 0 8 0 808173888 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 1803690 1439183 349 106 0 1799193 0
[pid=20862/tid=20864] ppid=20860 vsize=7214760 CPUtime=5010.22 cores=0-7
/proc/20862/task/20864/stat : 20864 (SArTagnan) R 20860 20862 20439 0 -1 4202560 271182 0 0 0 500971 51 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20862/tid=20865] ppid=20860 vsize=7214760 CPUtime=5007.87 cores=0-7
/proc/20862/task/20865/stat : 20865 (SArTagnan) R 20860 20862 20439 0 -1 4202560 411714 0 0 0 500525 262 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20862/tid=20866] ppid=20860 vsize=7214760 CPUtime=5010.17 cores=0-7
/proc/20862/task/20866/stat : 20866 (SArTagnan) R 20860 20862 20439 0 -1 4202560 32485439 0 0 0 495907 5110 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=7214760 CPUtime=4932.4 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4202560 286335 0 0 0 493180 60 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20862/tid=20868] ppid=20860 vsize=7214760 CPUtime=5010.2 cores=0-7
/proc/20862/task/20868/stat : 20868 (SArTagnan) R 20860 20862 20439 0 -1 4202560 238978 0 0 0 500977 43 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=20862/tid=20869] ppid=20860 vsize=7214760 CPUtime=5010.24 cores=0-7
/proc/20862/task/20869/stat : 20869 (SArTagnan) R 20860 20862 20439 0 -1 4202560 310815 0 0 0 500961 63 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4330864 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20862/tid=20870] ppid=20860 vsize=7214760 CPUtime=5010.2 cores=0-7
/proc/20862/task/20870/stat : 20870 (SArTagnan) R 20860 20862 20439 0 -1 4202560 179852 0 0 0 500918 102 0 0 25 0 8 0 808173896 7387914240 1439183 33554432000 4194304 4625164 140737161688688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 7214760

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.4 s]
/proc/loadavg: 8.07 8.05 8.00 2/460 21019
/proc/meminfo: memFree=28191860/32950928 swapFree=45617076/67111528
[pid=20862] ppid=20860 vsize=0 CPUtime=40001.1 cores=0-7
/proc/20862/stat : 20862 (SArTagnan) Z 20860 20862 20439 0 -1 4203548 36421985 0 0 0 3994011 6101 0 0 25 0 2 0 808173888 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20862/statm: 0 0 0 0 0 0 0
[pid=20862/tid=20867] ppid=20860 vsize=0 CPUtime=4932.6 cores=0-7
/proc/20862/task/20867/stat : 20867 (SArTagnan) R 20860 20862 20439 0 -1 4203588 286335 0 0 0 493181 79 0 0 25 0 2 0 808173896 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.5
CPU time (s): 40001.2
CPU user time (s): 39940.1
CPU system time (s): 61.0947
CPU usage (%): 798.348
Max. virtual memory (cumulated for all children) (KiB): 8203856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39940.1
system time used= 61.0947
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36421985
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8908
involuntary context switches= 166982

runsolver used 19.758 second user time and 58.0552 second system time

The end

Launcher Data 

Begin job on node123 at 2011-06-02 00:02:21
IDJOB=3439791
IDBENCH=88225
IDSOLVER=1936
FILE ID=node123/3439791-1306965741
RUNJOBID= node123-1306960628-20453
PBS_JOBID= 13497630
Free space on /tmp= 73804 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m42-q585-n40-p15-s54275047.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439791-1306965741/watcher-3439791-1306965741 -o /tmp/evaluation-result-3439791-1306965741/solver-3439791-1306965741 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439791-1306965741.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 67948a6aed9ea09317abe3c8a9a27a03
RANDOM SEED=473587786

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30406964 kB
Buffers:        169248 kB
Cached:         159416 kB
SwapCached:       9456 kB
Active:        2105412 kB
Inactive:       167100 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30406964 kB
SwapTotal:    67111528 kB
SwapFree:     45617076 kB
Dirty:            3692 kB
Writeback:           0 kB
AnonPages:     1942588 kB
Mapped:          22400 kB
Slab:           122032 kB
PageTables:      78348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 133348464 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73804 MiB
End job on node123 at 2011-06-02 01:25:53